ImageImageImageImageImage

SoTD: Bargnani's defensive numbers over 4 years

Moderators: Morris_Shatford, 7 Footer, DG88, niQ, Duffman100, tsherkin, Reeko, lebron stopper, HiJiNX

User avatar
BorisDK1
Assistant Coach
Posts: 4,282
And1: 240
Joined: Jul 04, 2010

Re: SoTD: Bargnani's defensive numbers over 4 years 

Post#461 » by BorisDK1 » Tue Aug 24, 2010 4:13 am

TdotRaps09 wrote:
Choker wrote:Why the **** is this thread still going on?


+1

I never really understood the point of it in the first place.

Let me explain.

If Bargnani is the sole and primary problem with our defense, then our offseason task becomes quite simple: move Bargnani for whatever, we'll be a better team. If Jose is the primary difficulty for us defensively, and Bargnani is a secondary problem exacerbated by having other slow defenders on the court with him against other teams' starters, then our offseason task becomes much more complex.

I allege the latter is true. Others allege the former is true. I am using direct analysis of each player from every possession of this past year to justify my view, others are using a series of formulas analyzing production peripheral to each player (or perhaps combinations of two) to justify theirs.
User avatar
Indeed
RealGM
Posts: 21,743
And1: 3,625
Joined: Aug 21, 2009

Re: SoTD: Bargnani's defensive numbers over 4 years 

Post#462 » by Indeed » Tue Aug 24, 2010 4:30 am

BorisDK1 wrote:
TdotRaps09 wrote:
Choker wrote:Why the **** is this thread still going on?


+1

I never really understood the point of it in the first place.

Let me explain.

If Bargnani is the sole and primary problem with our defense, then our offseason task becomes quite simple: move Bargnani for whatever, we'll be a better team. If Jose is the primary difficulty for us defensively, and Bargnani is a secondary problem exacerbated by having other slow defenders on the court with him against other teams' starters, then our offseason task becomes much more complex.

I allege the latter is true. Others allege the former is true. I am using direct analysis of each player from every possession of this past year to justify my view, others are using a series of formulas analyzing production peripheral to each player (or perhaps combinations of two) to justify theirs.


I guess we also considered the offensive end, and possibility to hide our weaknesses.
I am wondering the departure of Hedo means Jose and Bargnani can be co-exist. However, you also pointed out that our team isn't playing any better when Jose comes off the bench.
User avatar
BorisDK1
Assistant Coach
Posts: 4,282
And1: 240
Joined: Jul 04, 2010

Re: SoTD: Bargnani's defensive numbers over 4 years 

Post#463 » by BorisDK1 » Tue Aug 24, 2010 4:37 am

Indeed wrote:I guess we also considered the offensive end, and possibility to hide our weaknesses.
I am wondering the departure of Hedo means Jose and Bargnani can be co-exist. However, you also pointed out that our team isn't playing any better when Jose comes off the bench.

Well, we were up until about the All-Star break when the entire team (not just Bosh) kind of fell apart. The team's defensive rating was 109.5 from the day when Jose returned from injury - Feb 10 (last game prior to All-Star Break). Bargnani, of all people, was playing quite well defensively - facing a lot of possessions, getting a goodly amount of stops, etc.

Now, 109.5 ain't good, but it ain't 113.1, either.
User avatar
Courtside
RealGM
Posts: 19,460
And1: 14,205
Joined: Jul 25, 2002

Re: SoTD: Bargnani's defensive numbers over 4 years 

Post#464 » by Courtside » Tue Aug 24, 2010 4:41 am

The departure of Hedo is one positive step, as Kleiza and Wright are both more capable (and usually willing) defenders. If Calderon is also moved, or has his playing time reduced, that will also be a positive step. That's 2 positions improved. DeMar should be better, but how much is yet to be seen. That's a 3rd position improved, though the mix of minutes between Barbosa and Weems will factor into this a little.

The last one - PF - is a bit harder. Bosh was a capable defender when he wanted to be, but often times just didn't give it as much as he could. At first glance, Amir looks like he'll be an improvement over CB at the 4 spot also, but he's yet to prove he can play starter minutes over an extended period of time, and the next best PF is a rookie. He might have a defensive mindset, but to say he'll be as good as even a coasting Bosh is a stretch - though possible - since little will be expected of him offensively.

So does Andrea improve a little on his own accord, or will any improvement be attributed only to the improved defense around the rest of the line up? You can guess with a decent degree of accuracy which posters will go which way on that one.
Ripp
General Manager
Posts: 9,269
And1: 324
Joined: Dec 27, 2009

Re: SoTD: Bargnani's defensive numbers over 4 years 

Post#465 » by Ripp » Tue Aug 24, 2010 5:08 am

BorisDK1 wrote:How do you project anything with on/off court data? At least part of that tool is based on who's replacing you, and only partially measures (and indirectly!) what you're doing. Can I project performance with the DRat from PDSS? Sure. I can see who's failing more vs. who's succeeding more, I can see what aspects of whose game needs work, etc.

Ah, I don't mean in some abstract way. Like, given a team Ortg and Drtg (not in the Oliver sense, in the basketballvalue.com sense), I can get a pretty good prediction of how many games that the team will win next year (Google Pythagorean wins if you haven't seen this before.) It isn't perfect, but it does a solid job....that is why Hollinger and some of these other guys can pretty quickly forecast how many wins a team will get fairly early into the season (of course, Hollinger is going to use more complicated stuff that builds on this basic idea, but you get the point.)
Can one do the same with PDSS? How do I take the ratings for each player produced by PDSS and then produce an estimate of what the team Drtg will be next season? Or for the last 60 games of the current season, given that I've looked at the first 22? You can do that pretty well with variants of on/off...can you do the same with PDSS? In particular, if I cannot...then who cares what PDSS says?


BorisDK1 wrote:Oliver's justification for his formulae (which took him a lot more time in experimentation, research and development and peer review than your brief critique, for one) is that at some point you cannot talk about an individual's defense without measuring how the team performed, that you have to reconcile them both at some way. It's ridiculous to speak of Amir Johnson as having a great defensive year when he's on a horrid defensive team: at some point, he was unable to singly prevent the badness and is partially responsible. That is a reasonable point, one that you're not interacting with at all.

Fine, Oliver is certainly allowed to make this assumption. But it is an assumption, nothing more. How do I test and see if this modeling assumption is correct?
BTW, like I said...his formula CAN be interpreted as saying that Amir is a good defender. Hell, if Amir has a Stop% of 100% and thus the second term in the equation is negative, but the first term (the team number) is positive, are we to conclude that Amir is a terrible defender? Despite having a Stop% of 100%?


BorisDK1 wrote:
It is very easy to do this with On/Off or even better, APM based tools. However, it appears to not necessarily work well with these Oliver ratings:
http://hoyaprospectus.blogspot.com/2008 ... tings.html
http://sonicscentral.com/apbrmetrics/vi ... 42fad1ee78

So I ask again, how do I go from this individual defensive number to an estimate of how a particular lineup will perform, for example?

There are a lot of methodological errors in the first article. Firstly, again, that's using the estimated system, not PDSS. Secondly, usage was not factored in with his use of the offensive rating - you cannot isolate efficiency from usage.

Regarding the first article...we aren't discussing offensive ratings in this thread anyway, so I'm not sure why you brought it up. I'm referring to the defensive correlation he did. And yes, as you say, he did the estimated rather than PDSS. Of course, given the difficulty of calculating PDSS explicitly, who knows whether PDSS would given radically different numbers or not..


The second one was answered sufficiently well by Neil Paine, which of course nobody responded to.

Nope; Neil's answer didn't answer the OPs question, before there isn't much of a difference between the possession estimates for guys who play on the same team...typically minutes are a very good proxy for this. The poster's question was, how the hell can we have a team where ALL of the major big minute guys have great Oliver offensive and defensive ratings, yet have a terrible team? His point is that there is very likely something wrong with the formula.

I think you missed something again - maybe in extreme excitement for being able to use "WTF?" to starting a paragraph. :)

I saw your correction in the post following mine, and will respond there, if you do not mind...


I'm not condemning him for changing the formula. I'm saying that what is the justification for either of them? Instead of 1/2, why not 1/4, 1/8, whatever? Which leads to a better stop percentage formula? Or rather, how do we compare different stop percentage formulas and find the weighting that is most consistent with reality?

The FMwt formula assigns the value on what the team is actually doing, not on some absolute number divorced from reality in that game/series of games/season. Oliver justifies this by pointing to high school or college teams who might play zone and hold opponents' shooting really low, but give up a ton of offensive rebounds. The value of that team's forced misses are far lower than a team who gives up a lot of scores but controls the defensive board.

I understand the formula, and read the justification listed on page 204 (but do not have access to that of Chapter 3, or Appendix 1, where I guess he justifies it further.) The thing is, there are many such formulas one can come up with that have the exact same properties, that trade off between the opposing team's ability to shoot and their ability to grab offensive rebounds. Why is this particular one the right way to go? Why not Fmwt squared? Why is his particular way to trade off between the two variables the correct one?


BorisDK1 wrote:My point is that his comment applies to both. Both techniques make strong modeling assumptions that may or may not be correct. But anyway, let's revisit this comment once you've told me how to get from individual ratings to say lineup ratings and team ratings.

No, it really doesn't apply to both in the same way. The first method is an estimate, the latter is far, far more exact.

Exact in doing...what? If I have two clocks that both have two different times on them, how do I know which one is better? Am I to prefer clock #2, just because it gives time out to 100ths of seconds, and never actually check if any of the times it gives are right? I need some sort of objective reference to compare both clocks to. For all I know, both clocks are useless...I need some way to verify.

So what is the objective reference I'm comparing Oliver's individual defensive ratings to? This is why I'm asking you how one goes from individual defensive ratings to team defensive ratings. Or prediction, etc..
A Tolkienesque strategy war game made by me: http://www.warlords.co
Ripp
General Manager
Posts: 9,269
And1: 324
Joined: Dec 27, 2009

Re: SoTD: Bargnani's defensive numbers over 4 years 

Post#466 » by Ripp » Tue Aug 24, 2010 5:56 am

BorisDK1 wrote:My apologies.

That should be "FFTM" - forced free throw missed. My bad, I caused that confusion.

Hrm, ok. I guess it makes more sense, now. Although, the factor of 1/10 seems like it is far off...a FT is worth roughly 1/2 of a possessions, not 1/10th of one.

And so you bookkeep the rest (Free Throws Made) with this "Scoring Possessions Allowed" variable:

Code: Select all

Scoring possessions allowed = FGA + .45 * (FFT + FFTM) * (1 - (1 - (FFT / (FFT + FFTM))^2 ) )


Such an odd formula...the squared term doesn't make much sense, if the goal is to only count possessions I was involved in. Should be more like "FGA+.45*(FFT+FFTM)". And are three pointers tracked separately from regular FGAs?

I'm pretty impressed that you tried to track all of this for the entire Raps team. Sounds like an assload of work.

What were the final season totals for each player, for each of these stats (FGA, FFT, etc)? If you could summarize it for the season, box-score style, that would be pretty useful.
A Tolkienesque strategy war game made by me: http://www.warlords.co
User avatar
BorisDK1
Assistant Coach
Posts: 4,282
And1: 240
Joined: Jul 04, 2010

Re: SoTD: Bargnani's defensive numbers over 4 years 

Post#467 » by BorisDK1 » Tue Aug 24, 2010 6:33 am

Ripp wrote:Hrm, ok. I guess it makes more sense, now. Although, the factor of 1/10 seems like it is far off...a FT is worth roughly 1/2 of a possessions, not 1/10th of one.

I'm not sure why 10 ended up being the denominator, there, but I know if you change that to 2 or remove it entirely all of a sudden the weight of a missed free throw becomes enormous and disrupts everything.
Such an odd formula...the squared term doesn't make much sense, if the goal is to only count possessions I was involved in. Should be more like "FGA+.45*(FFT+FFTM)". And are three pointers tracked separately from regular FGAs?

I don't have advanced mathematical degrees - 1st year calculus in university was my limit. You'd have to ask Dr. Oliver, who holds several advanced degrees in mathematics and engineering. It looks like something from a quadratic equation, but I couldn't explain the math behind it.

As I said earlier, I did not track 3FGA this year and much to my chagrin, as I want to apply the Net Points formulas from Oliver and find it unsatisfying just estimating generally pts / FG.
I'm pretty impressed that you tried to track all of this for the entire Raps team. Sounds like an assload of work.

What were the final season totals for each player, for each of these stats (FGA, FFT, etc)? If you could summarize it for the season, box-score style, that would be pretty useful.

I've posted these in this thread a couple of times. You can download the spreadsheet here. All the totals are found at the bottom of the tab marked "All Games". It also exists in a .pdf file (please ignore the last page, I need to edit it still) here.

I posted the results of all 82 games at raptorspace.com as well in the Game Threads.
User avatar
BorisDK1
Assistant Coach
Posts: 4,282
And1: 240
Joined: Jul 04, 2010

Re: SoTD: Bargnani's defensive numbers over 4 years 

Post#468 » by BorisDK1 » Tue Aug 24, 2010 6:52 am

Ripp wrote:Ah, I don't mean in some abstract way. Like, given a team Ortg and Drtg (not in the Oliver sense, in the basketballvalue.com sense), I can get a pretty good prediction of how many games that the team will win next year (Google Pythagorean wins if you haven't seen this before.) It isn't perfect, but it does a solid job....that is why Hollinger and some of these other guys can pretty quickly forecast how many wins a team will get fairly early into the season (of course, Hollinger is going to use more complicated stuff that builds on this basic idea, but you get the point.)
Can one do the same with PDSS? How do I take the ratings for each player produced by PDSS and then produce an estimate of what the team Drtg will be next season? Or for the last 60 games of the current season, given that I've looked at the first 22? You can do that pretty well with variants of on/off...can you do the same with PDSS? In particular, if I cannot...then who cares what PDSS says?

Individual pythagorean wins with PDSS? Sure. Oliver actually has a Net Points formula estimating points allowed with the estimated DRat, which will only be more accurate when the exact totals are known. I'm not happy with the way it's working right now in some ways because I didn't track 3FGA, but next year that shouldn't be a problem.

As far as predicting team DRat? This team next year? No. Too much flux in personnel, too many unknowns, too many still unresolved questions. I don't think any system is going to accurately predict this team's defensive performance 1) until more things get resolved, namely, Calderon's future and 2) until we see this team at least play against non-summer league competition.
BorisDK1 wrote:Fine, Oliver is certainly allowed to make this assumption. But it is an assumption, nothing more. How do I test and see if this modeling assumption is correct?
BTW, like I said...his formula CAN be interpreted as saying that Amir is a good defender. Hell, if Amir has a Stop% of 100% and thus the second term in the equation is negative, but the first term (the team number) is positive, are we to conclude that Amir is a terrible defender? Despite having a Stop% of 100%?

What "second term" are you talking about? Are you talking about the estimaed DRat yet again? The two are not the same formulas...build a bridge, and get over it.
Regarding the first article...we aren't discussing offensive ratings in this thread anyway, so I'm not sure why you brought it up. I'm referring to the defensive correlation he did. And yes, as you say, he did the estimated rather than PDSS. Of course, given the difficulty of calculating PDSS explicitly, who knows whether PDSS would given radically different numbers or not..

Are assists reliable in the NBA? Then PDSS compiled by a competent and informed person is equally reliable.
Nope; Neil's answer didn't answer the OPs question, before there isn't much of a difference between the possession estimates for guys who play on the same team...typically minutes are a very good proxy for this. The poster's question was, how the hell can we have a team where ALL of the major big minute guys have great Oliver offensive and defensive ratings, yet have a terrible team? His point is that there is very likely something wrong with the formula.

Neil answered that question perfectly, by pointing out that you can't divvy these things up by minutes, but by individual possessions used. You evidently missed out on the fact that he's talking about summing the individual possessions, and not team possessions. I'd suggest that's due to unfamiliarity with Oliver's methodology.

Offensive Rating without usage isn't a meaningful metric. A guy can have an ORat of 138.2 - doesn't mean he's a good offensive player or that he was on a good offensive team. He may have just been extremely efficient on minuscule usage. You seem to think that the offensive rating is indicating team efficiency while he's out there: not true. The individual offensive rating measured Points Produced / 100 Individual Possessions. I think this is yet another case of you not being conversant in these metrics and making some basic mistakes of fact.

Individual ORat does not equal on court team offensive efficiency. Please be clear on that. That's why that article was so flawed, because it tried to use the two concepts interchangeably. Similarily, the DRat (either estimated or PDSS) is not just a measure of on-court team defensive rating while a player is out there: it includes team defensive performance, but it's basketball's equivalent of an Earned Run Average.
I understand the formula, and read the justification listed on page 204 (but do not have access to that of Chapter 3, or Appendix 1, where I guess he justifies it further.) The thing is, there are many such formulas one can come up with that have the exact same properties, that trade off between the opposing team's ability to shoot and their ability to grab offensive rebounds. Why is this particular one the right way to go? Why not Fmwt squared? Why is his particular way to trade off between the two variables the correct one?

Why not?

Honestly, you're trying to apply a universal negative here and it's not going to work. Prove there's something flawed in it, or move on.
Exact in doing...what?

Tracking individual defensive performance, obviously.
If I have two clocks that both have two different times on them, how do I know which one is better?

The one that isn't a guesstimate based on extremely limited data would tend to be better, no?
Am I to prefer clock #2, just because it gives time out to 100ths of seconds, and never actually check if any of the times it gives are right? I need some sort of objective reference to compare both clocks to. For all I know, both clocks are useless...I need some way to verify.

A hermeneutic of suspicion is only going to take you so far.
So what is the objective reference I'm comparing Oliver's individual defensive ratings to? This is why I'm asking you how one goes from individual defensive ratings to team defensive ratings. Or prediction, etc..

What do you mean, "what objective reference"? What objective reference is any basketball metric compared to? It's a measure of individual defensive performance based on the outcome of every play during the course of a basketball game. From that, you can easily develop a stop%, DPoss% and ultimately a defensive rating. Does it communicate a lot more directly about players than peripheral analysis? IMO, yes.

It's as meaningful as any other efficiency-based individual metric for any of the functions you name.
Scouta
Banned User
Posts: 1,926
And1: 1
Joined: Jul 31, 2010
Location: Mississauga
Contact:

Re: SoTD: Bargnani's defensive numbers over 4 years 

Post#469 » by Scouta » Tue Aug 24, 2010 7:07 am

32 pages and no sign of HARRY PALMER??????????? :o :o :o :o :o :o :o :o :o
User avatar
darth_federer
Retired Mod
Retired Mod
Posts: 29,060
And1: 922
Joined: Apr 12, 2009
Contact:

Re: SoTD: Bargnani's defensive numbers over 4 years 

Post#470 » by darth_federer » Tue Aug 24, 2010 7:16 am

Damn, my head hurts. I read all of Boris's posts because I wanted to learn something but Im not sure I understood everything. Yogi is right. We need more discussion about the Dance Pak or Allen Iverson.

The only thing about PDSS is that I think its hard to quantify everything.

I trust your basketball knowledge and your integrity because you did do this for an entire season, but I think there are way too many variables.

Quantifying that into one holy grail type stat doesnt seem right. Im sure PDSS plays a big part when calculating defensive numbers (the Raptors have a guy who is always ticking a clipboard when shots are taken/missed) but there are too many variables. Broken plays, guys playing out of the system (who do you assign blame to then?), individual rules for opposing players e.t.c.

I mean how do you know what a coach has planned. Maybe a player funnels his opponent into help defenders to pressure him and force him to give up the ball. How do you know that its not a defensive breakdown? What if this was the gameplan, but a help defender failed to rotate in time and you have a layup or a open pass for a dunk. How do you measure that?

We used to use some matchup zone for our basketball team. But there was one guy who was totally clueless. He either overplayed his man or he gave him too much space. That kinda screwed things up for the rest of us because we couldnt just cover our man/zone. So who gets the blame then if the opponent scores? One guy threw you out of whack and made it easy for the opposing team to score.

Having played basketball, there are so many variables. Im sure you know about this, but I dont know how you can quantify that into a set of numbers. Maybe Im just missing something. :)
Image

Profanity wrote:This is why I question a Canadian team in our league. it's a govt conspiracy trina to sell all our milk to Russia. They let the raptors participate to not let canadians demand crossing taxes. it will backfire one day.
Ripp
General Manager
Posts: 9,269
And1: 324
Joined: Dec 27, 2009

Re: SoTD: Bargnani's defensive numbers over 4 years 

Post#471 » by Ripp » Tue Aug 24, 2010 7:30 am

BorisDK1 wrote:
Ripp wrote:Hrm, ok. I guess it makes more sense, now. Although, the factor of 1/10 seems like it is far off...a FT is worth roughly 1/2 of a possessions, not 1/10th of one.

I'm not sure why 10 ended up being the denominator, there, but I know if you change that to 2 or remove it entirely all of a sudden the weight of a missed free throw becomes enormous and disrupts everything.
Such an odd formula...the squared term doesn't make much sense, if the goal is to only count possessions I was involved in. Should be more like "FGA+.45*(FFT+FFTM)". And are three pointers tracked separately from regular FGAs?

I don't have advanced mathematical degrees - 1st year calculus in university was my limit. You'd have to ask Dr. Oliver, who holds several advanced degrees in mathematics and engineering. It looks like something from a quadratic equation, but I couldn't explain the math behind it.

Yeah so none of this stuff should required advanced math....it is relatively simple modeling. Oliver is estimating the number of defensive possessions a player was involved in. I suspect that quadratic term is some sort of correction he is doing to the posession estimate, but am not sure. Would be nice to be able to answer this question w/o buying the book. Too bad it isn't all online..


As I said earlier, I did not track 3FGA this year and much to my chagrin, as I want to apply the Net Points formulas from Oliver and find it unsatisfying just estimating generally pts / FG.

Ouch. That is going to make the formula pretty off, right? You are effectively then treating twos and threes exactly the same?


I'm pretty impressed that you tried to track all of this for the entire Raps team. Sounds like an assload of work.

What were the final season totals for each player, for each of these stats (FGA, FFT, etc)? If you could summarize it for the season, box-score style, that would be pretty useful.

I've posted these in this thread a couple of times. You can download the spreadsheet here. All the totals are found at the bottom of the tab marked "All Games". It also exists in a .pdf file (please ignore the last page, I need to edit it still) [url=

Code: Select all

http://www.mediafire.com/?k7hbzunay6uzt4n
]here[/url].

Is there any chance you can just post the totals here in this thread? That way I can avoid downloading large files, and we can all discuss and look at them together. Season totals for each category and each player would be interesting to look at.
A Tolkienesque strategy war game made by me: http://www.warlords.co
Crazy-Canuck
RealGM
Posts: 29,874
And1: 7,836
Joined: Nov 24, 2003

Re: SoTD: Bargnani's defensive numbers over 4 years 

Post#472 » by Crazy-Canuck » Tue Aug 24, 2010 7:40 am

darth_federer wrote:Damn, my head hurts. I read all of Boris's posts because I wanted to learn something. Yogi is right. We need more discussion about the Dance Pak or Allen Iverson.

Somebody start a Bosh thread or something.

The only thing about PDSS is that I think its hard to quantify everything.

I trust your basketball knowledge and your integrity because you did do this for an entire season, but I think there are way too many variables.

Quantifying that into one holy grail type stat doesnt seem right. Im sure PDSS plays a big part when calculating defensive numbers (the Raptors have a guy who is always ticking a clipboard when shots are taken/missed) but there are too many variables. Broken plays, guys playing out of the system (who do you assign blame to then?), individual rules for opposing players e.t.c.

I mean how do you know what a coach has planned. Maybe a player funnels his opponent into help defenders to pressure him and force him to give up the ball. How do you know that its not a defensive breakdown? What if this was the gameplan, but a help defender failed to rotate in time and you have a layup or a open pass for a dunk. How do you measure that?

Having played basketball, there are so many variables. I dont know how you can quantify that into a set of numbers. Maybe Im just missing something. :)


The same things can be said of the stats presented by SS or Ripp.

Have no idea which is better, but my eye tells me that the Raps are bad as a defensive team. I've always believed that our perimeter D was atrocious, so its good that someone can present some stats that can back it up.
Ripp
General Manager
Posts: 9,269
And1: 324
Joined: Dec 27, 2009

Re: SoTD: Bargnani's defensive numbers over 4 years 

Post#473 » by Ripp » Tue Aug 24, 2010 9:04 am

BorisDK1 wrote:
Ripp wrote:Ah, I don't mean in some abstract way. Like, given a team Ortg and Drtg (not in the Oliver sense, in the basketballvalue.com sense), I can get a pretty good prediction of how many games that the team will win next year (Google Pythagorean wins if you haven't seen this before.) It isn't perfect, but it does a solid job....that is why Hollinger and some of these other guys can pretty quickly forecast how many wins a team will get fairly early into the season (of course, Hollinger is going to use more complicated stuff that builds on this basic idea, but you get the point.)
Can one do the same with PDSS? How do I take the ratings for each player produced by PDSS and then produce an estimate of what the team Drtg will be next season? Or for the last 60 games of the current season, given that I've looked at the first 22? You can do that pretty well with variants of on/off...can you do the same with PDSS? In particular, if I cannot...then who cares what PDSS says?

Individual pythagorean wins with PDSS? Sure. Oliver actually has a Net Points formula estimating points allowed with the estimated DRat, which will only be more accurate when the exact totals are known. I'm not happy with the way it's working right now in some ways because I didn't track 3FGA, but next year that shouldn't be a problem.

As far as predicting team DRat? This team next year? No. Too much flux in personnel, too many unknowns, too many still unresolved questions. I don't think any system is going to accurately predict this team's defensive performance 1) until more things get resolved, namely, Calderon's future and 2) until we see this team at least play against non-summer league competition.

I'll discuss what I mean at the end of this post.

What "second term" are you talking about? Are you talking about the estimaed DRat yet again? The two are not the same formulas...build a bridge, and get over it.

Focus on the equation for the PDSS based DRat. You have a first term that is the same for every player on a team. You have a second term that is a function of Stop% (among other variables), and thus varies from player to player.
As I stated, both of these Oliver DRats involve adding a TEAM DRat number to some other number (the second term in your equation, I don't want to c/p it again) that corresponds solely to that only of an individual. Like, if you want to compute this PDSS Drtg number, you first compute Stop% for Amir, then one for Jose Calderon. If Amir's Stop% is 100%, this second term will be a big negative number (say, -8 or -9.) If Jose's were say 0%, this second term is a big positive number (say +8 or +9.)
Yet depending on the overall average defensive performance of the Raps, the Drtgs for both players might be very high.
My point is that this second term has a pretty natural interpretation as how a player impacts his team defense (either he improves it or worsens it.) But if I understand you correctly, it isn't important if he improves or worsens the defense, but what the final defensive number is? Or am I misunderstanding you?


Are assists reliable in the NBA? Then PDSS compiled by a competent and informed person is equally reliable.

Err, but what people usually do is to compile raw counting stats like assists, blocks, rebounds, etc. You instead are not presenting the raw counting stats you kept track of, but a formula involving your new counting stats. Just because I think assists are reliable in the NBA doesn't mean I necessarily think PER is reliable, or WS, or WP, etc.
Like I said earlier, I like the raw counting stats you kept, but don't have much personal confidence in this particular statistic involving those raw counting stats.

Nope; Neil's answer didn't answer the OPs question, before there isn't much of a difference between the possession estimates for guys who play on the same team...typically minutes are a very good proxy for this. The poster's question was, how the hell can we have a team where ALL of the major big minute guys have great Oliver offensive and defensive ratings, yet have a terrible team? His point is that there is very likely something wrong with the formula.

Neil answered that question perfectly, by pointing out that you can't divvy these things up by minutes, but by individual possessions used. You evidently missed out on the fact that he's talking about summing the individual possessions, and not team possessions. I'd suggest that's due to unfamiliarity with Oliver's methodology.

The 6 or 7 guys who lead a team in minutes played almost certainly consume most of the defensive and offensive possessions. If those 6 or 7 guys all have their Ortgs much higher than Drtgs, and the team has a bad Ortg/Drtg differential (and thus not very many wins), then something is wrong. Saying that some guys who aren't playing very many minutes are the ones chewing up all the possessions is not a good explanation for this discrepancy (think about what this means...you have guys playing no minutes Think at a very intuitive level about what you are saying. We have a team where the top 6 or 7 guys in minutes played ALL of an Ortg much higher than their Drtgs. These are the top dogs on the team, the guys leading the team in minutes played.
Yet the overall team as a whole has an Ortg less than the Drtg...substantially so, in fact. And you are saying that this is fine, because if we weighted instead by usage, then it would normalize out?

Offensive Rating without usage isn't a meaningful metric. A guy can have an ORat of 138.2 - doesn't mean he's a good offensive player or that he was on a good offensive team. He may have just been extremely efficient on minuscule usage. You seem to think that the offensive rating is indicating team efficiency while he's out there: not true. The individual offensive rating measured Points Produced / 100 Individual Possessions. I think this is yet another case of you not being conversant in these metrics and making some basic mistakes of fact.

The top 6 or 7 guys in minutes played on a team will represent the lion's share of the possessions consumed. I'm more than familiar with the metrics...in fact, familiar enough with them that I can step back and see if they pass basic smell tests, and make intuitive sense :D

Individual ORat does not equal on court team offensive efficiency. Please be clear on that. That's why that article was so flawed, because it tried to use the two concepts interchangeably. Similarily, the DRat (either estimated or PDSS) is not just a measure of on-court team defensive rating while a player is out there: it includes team defensive performance, but it's basketball's equivalent of an Earned Run Average.

I understand that. But how do I go from these individual ORats to the team ORat? That is my point...ultimately, if we want to check that the model we've built works well, it sure would be nice if it matched what actual game results are (e.g., team Ortg, team Drtg, same quantities for lineups, and finally Wins and Losses.)

I understand the formula, and read the justification listed on page 204 (but do not have access to that of Chapter 3, or Appendix 1, where I guess he justifies it further.) The thing is, there are many such formulas one can come up with that have the exact same properties, that trade off between the opposing team's ability to shoot and their ability to grab offensive rebounds. Why is this particular one the right way to go? Why not Fmwt squared? Why is his particular way to trade off between the two variables the correct one?

Why not?

Honestly, you're trying to apply a universal negative here and it's not going to work. Prove there's something flawed in it, or move on.

That is not how statistical methodology works. You justify different quantities you use, not say, "Well, what else would you use?" Ideally you justify it by showing that nothing else makes sense, and moreover there are independent ways to show that any other choice leads to a bad outcome. In practice, you find some sort of weaker justification. And if you cannot do this, then you say that the choice is a bit ad hoc and arbitrary.


What do you mean, "what objective reference"? What objective reference is any basketball metric compared to? It's a measure of individual defensive performance based on the outcome of every play during the course of a basketball game. From that, you can easily develop a stop%, DPoss% and ultimately a defensive rating. Does it communicate a lot more directly about players than peripheral analysis? IMO, yes.

It's as meaningful as any other efficiency-based individual metric for any of the functions you name.

No. I don't trust or believe for example Berri's Wins Produced, because you cannot use it to predict what is going to happen in games. Things like PER and +/- based approaches can be...that is why I have confidence that they have some value.
This is the point I'm making....if you have a formula and have some quantity that you cannot justify, then why can't someone else take your formula and change the value 10 in your formula to a billion, and claim his formula is better than yours? How do you show him that yours is right (or at least, better), and his is wrong?
It is easy to do this with variants of PER and +/-....you try to predict the number of games won at the end of the season by your favorite team (or better yet, all NBA teams.) You can do this successfully with some techniques (i.e., within some margin of error), but less successfully with certain other techniques.
A Tolkienesque strategy war game made by me: http://www.warlords.co
User avatar
supersub15
Retired Mod
Retired Mod
Posts: 16,846
And1: 27
Joined: Dec 16, 2003
Location: God, family, Raps and Man U

Re: SoTD: Bargnani's defensive numbers over 4 years 

Post#474 » by supersub15 » Tue Aug 24, 2010 10:16 am

BorisDK1 wrote:
supersub15 wrote:I know what team DRTG is measuring, but when 4000+ minutes of data with Bargnani and another 4000+ minutes without Bargnani show 2 completely different outcomes, with the same teammates, the same system, and the same opponent, there's only one conclusion to make. I am not using it haphazardly here.

You told me that Jack was better than Calderon defensively according to PDSS, yet we got destroyed worse than with Calderon, when Jack played with Bargnani.

I am probably not going to convince you otherwise, and that's fine. Let's agree to disagree. :D

Jack performed much better defensively than Calderon did. I pointed out what happened when Calderon didn't play. 82games.com cannot tell you 1) who was responsible for how much of what, 2) what caused it, 3) against whom it was caused, which are all necessary for any on/off court counting to be particularly meaningful. You are trying to use those metrics with far greater weight and scope than they're warranted. Contrary to this presentation, your stats do not isolate for one or two or even three players: teams, last I looked, still are comprised of five players on the floor at once. Your tabulations are very, very noisy and really don't deal with any player or combination of players in a direct fashion. That's not to say they're meaningless, just that they are more limited than you'd like to think.

Ultimately, I think the disconnect is that I'm a basketball guy (I'm a coach and former official) who has become conversant in statistical measures and wants to use them for the purpose of basketball teaching and coaching; you're a statistical guy who might not have the background in the game that I do, from a theoretical standpoint. I think there's probably going to be a bit of a disconnect there, neither side being completely right, but I think we have to learn from each other and there is room for a lot of accord.


DRTG (and, by extension, ORTG) are as straightforward in their calculations as can be. There is NO noise involved: Pts Allowed / Possessions (we are 100% certain of of points allowed and 100% certain of the number of possessions). You can argue about the conclusions drawn from their use, but you can't say that they are noisy.

You have introduced PDSS to the masses, but as Ripp has shown, it has major holes, but you are brandying it about as if it is the Holy Grail of defensive stats. If anything, there is major noise in PDSS, and not the other way around.

You have tried to convince us that OFF/ON does not equal causation, and that Jose Calderon is the source of all defensive evil, but - so far - you have failed to explain why the team over 4 years and 4000 minutes of play, has a DRTG of 104.9 when Bargnani isn't on the floor at the same time as Jose Calderon. Wouldn't teams exploit Calderon the same way, regardless if Bargnani is there or not? The more likely explanation is that Jose Calderon gets beat at the point of attack, but is met by a rotating big more often than not when Bargnani isn't playing, whereas the opponent gets free drive to the rim when Bargnani is playing. Look, you may explain a 2 or 3 point variation in ON/OFF DRTG, but there is no way you can explain a +9 pts variation with stuff like noise.

Now, you've also said that Bargnani and Bosh were the second-best defenders on the team. If that is true, how the hell do we end up with a 113 rating when they're on the floor together and, worse, go up to 114.7 when they play with Jack instead of Calderon?

Sorry, but your theories and stats do not jive with the results...

Edit: Boris, forgot to add that I thoroughly enjoyed this discussion. Wow, 32 pages and still going! Bargnani sure brings out the best and worst in us :D
Dam
Banned User
Posts: 742
And1: 0
Joined: Nov 15, 2007

Re: SoTD: Bargnani's defensive numbers over 4 years 

Post#475 » by Dam » Tue Aug 24, 2010 11:23 am

Wow...
No Bargs and Raps +9pts (offense/defense)....right?
So..trade him (or bench him) and this team is a contender (or thereabouts)... no? :lol:

You are a very basketball expert (not only stats)...well done!!! :lol: :lol: :lol:
User avatar
J-Roc
RealGM
Posts: 33,150
And1: 7,550
Joined: Aug 02, 2008
Location: Sunnyvale
       

Re: SoTD: Bargnani's defensive numbers over 4 years 

Post#476 » by J-Roc » Tue Aug 24, 2010 11:23 am

Only on the Raps forum is there a deep discussion over who is actually worse defensively, our starting PG or starting C.
theonlyeastcoastrapsfan
RealGM
Posts: 26,820
And1: 9,000
Joined: Mar 14, 2006
Location: Hotlantic Canada
 

Re: SoTD: Bargnani's defensive numbers over 4 years 

Post#477 » by theonlyeastcoastrapsfan » Tue Aug 24, 2010 12:11 pm

What do you mean by Bargs brings out the best and worst in us Sub? Seems to me got a bunch of people trying to use an equation to tell us what degree of bad a defender Bargs is. Last I checked the answer to that question wasn't a number.

There's no math equation that will tell you concretely to what degree each player was responsible. So why argue details when you know your answer isn't going to be absolute anyway.

If you asked those who watch games, I'm sure all would say okay man defender, needs to work on weakside defense and that Raps has problems all around, defensively, especially in the SL which was way more slanted toward offense. Amir is very active defensively, weems and wright and even Beli guarded well at times. Our frontcourt intimidated no one, our pg's were blown by, and our wings were slow and lazy, and frail and inexperienced, respectively. That was the source of our defensive woes. Unless you think Bargs can join any team and cause the same impact there. Save the number crunching and just blame Colangelo, that's where the buck stops. If it's a player, he can change them, if it's a coach he can change them.

The numbers are what they are, but they don't tell you more than the info put into them. Looking at both combined I'd say the conclusions to be drawn is that last year's system did not work, and Bargs can cause problems for his defensive assignments but is not an effective help defender, that will allow a team to get away with poor defenders at other positions. And Amir, may actually be underrated defensively. Maybe, it's not Bargs that repalces Bosh, but Amri and Davis, while it just allows Bargs to be even more bargsy and we get a version of CB4 with a defensive over offensive focus.
MrBojangelz71
Banned User
Posts: 6,835
And1: 929
Joined: Oct 24, 2006
Location: Center of the World

Re: SoTD: Bargnani's defensive numbers over 4 years 

Post#478 » by MrBojangelz71 » Tue Aug 24, 2010 12:49 pm

theonlyeastcoastrapsfan wrote:What do you mean by Bargs brings out the best and worst in us Sub? Seems to me got a bunch of people trying to use and equation to tell us what degree of bad a defender Bargs is. Last I checked the answer to that question wasn't a number.

There's no math equation that will tell you concretely to what degree each player was responsible. So why argue details when you know your answer isn't going to be absolute anyway.

If you asked those who watch games, I'm sure all would say okay man defender, needs to work on weakside defense and that Raps has problems all around, defensively, especially in the SL which was way more slanted toward offense. Amir is very active defensively, weems and wright and even Beli guarded well at times. Our frontcourt intimidated no one, our pg's were blown by, and our wings were slow and lazy, and frail and inexperienced, respectively. That was the source of our defensive woes. Unless you think Bargs can join any team and cause the same impact there. Save the number crunching and just blame Colangelo, that's where the buck stops. If it's a player, he can change them, if it's a coach he can change them.

The numbers are what they are, but they don't tell you more than the info put into them. Looking at both combined I'd say the conclusions to be drawn is that last year's system did not work, and Bargs can cause problems for his defensive assignments but is not an effective help defender, that will allow a team to get away with poor defenders at other positions. And Amir, may actually be underrated defensively. Maybe, it's not Bargs that repalces Bosh, but Amri and Davis, while it just allows Bargs to be even more bargsy and we get a version of CB4 with a defensive over offensive focus.


Agree with what you are saying to a degree.

The system as a whole was/is flawed and it exploited the apparent weaknesses that player such as AB have defensively. I think the underlying assertion being made is that you can't just target one person's (AB/Jose) inadequacies towards defending and imply that was the entire problem with our defensive record. That is just absurd. Yet, AB haters are trying to do just that, regardless of what other evidence is put forth that suggest otherwise.

I like the fact that Boris analyzed each and every defensive play last season and calculated multiple scenarios accounting for factors that aren't calculated into certain stats. It offers a different perspective. I am not saying that it provides a thorough account of what ailed us, but it gives us a much different perspective to judge our defensive deficiencies.

You can single out AB if it makes you feel better, but if you want to analyze this in a reasonable fashion, there were multiple problems occurring on a consistent bases that made us a very bad defensive team.

Blaming BC is neither here nor there. At some point the players on the floor have to adapt and step up. These are NBA players, they posses the athletic skills and IQ to make it into the NBA and at some point they have to take it upon themselves to prove they belong. A GM can't swap out 4 or 5 players mid season to compensate for the crap taking place on the floor. BC has swapped out 30 plus players since his undertaking of the team and at some point players themselves have to be responsible for what they are or aren't doing properly.

PJ Carlesimo stated during the off season that in order for a team such as the Raptors to turn it around, you have to allow a young group of players to stay intact under one system (both defensively and offensively) for multiple seasons. it is the only way you can grow as a team and become respectable within a defensive scheme. Expecting to have 8 or 9 new faces every season coming into camp and learning the system, each other and the coaching tendencies every season will lead to mediocrity. That seems to be the general direction we are heading towards. Lets hope that we become more fluid within the system Jay and PJ are trying to implement and grow cohesively within it over the next 2 to 3 seasons, keeping a general core of 5 to6 players during each of the seasons.
User avatar
BorisDK1
Assistant Coach
Posts: 4,282
And1: 240
Joined: Jul 04, 2010

Re: SoTD: Bargnani's defensive numbers over 4 years 

Post#479 » by BorisDK1 » Tue Aug 24, 2010 1:10 pm

darth_federer wrote:Damn, my head hurts. I read all of Boris's posts because I wanted to learn something but Im not sure I understood everything. Yogi is right. We need more discussion about the Dance Pak or Allen Iverson.

The only thing about PDSS is that I think its hard to quantify everything.

I trust your basketball knowledge and your integrity because you did do this for an entire season, but I think there are way too many variables.

Quantifying that into one holy grail type stat doesnt seem right. Im sure PDSS plays a big part when calculating defensive numbers (the Raptors have a guy who is always ticking a clipboard when shots are taken/missed) but there are too many variables. Broken plays, guys playing out of the system (who do you assign blame to then?), individual rules for opposing players e.t.c.

I mean how do you know what a coach has planned. Maybe a player funnels his opponent into help defenders to pressure him and force him to give up the ball. How do you know that its not a defensive breakdown? What if this was the gameplan, but a help defender failed to rotate in time and you have a layup or a open pass for a dunk. How do you measure that?

We used to use some matchup zone for our basketball team. But there was one guy who was totally clueless. He either overplayed his man or he gave him too much space. That kinda screwed things up for the rest of us because we couldnt just cover our man/zone. So who gets the blame then if the opponent scores? One guy threw you out of whack and made it easy for the opposing team to score.

Having played basketball, there are so many variables. Im sure you know about this, but I dont know how you can quantify that into a set of numbers. Maybe Im just missing something. :)

I don't think it's quite as hard as you're making it out to be. I don't deny that there are some things that are incredibly difficult, but that's why shared blame exists and that's also why "team" (that catch-all category indicating "thin air" exists). And really, there's about one play per game that is really, really difficult. But that's why I have PVR and can re-watch things ad infinitum, and ultimately I come up with a solution that's at least partially satisfying. I'd say it's no more difficult or subjective than assigning assists, yet everybody takes that as gospel.

What a coach has planned really isn't as difficult to determine as you make it sound, and really not as relevant. At the end of the day, it's a simple system ("who gave up that score? who produced that stop?") and it's not meant to be mind-splittingly complicated.

What I can assure you is that even as a coach, when I tabulate a result, the answer is at least mostly satisfying and in the vast majority of instances (say, 98%), completely satisfying. This system isn't complicated enough to be fraught with unreliability, IMO.
User avatar
BorisDK1
Assistant Coach
Posts: 4,282
And1: 240
Joined: Jul 04, 2010

Re: SoTD: Bargnani's defensive numbers over 4 years 

Post#480 » by BorisDK1 » Tue Aug 24, 2010 1:16 pm

Ripp wrote:Yeah so none of this stuff should required advanced math....it is relatively simple modeling.

Oh, so you're an APM guy but you reject advanced math? You don't get that the statistical models made for basketball come from the field of...statistical math? Of course they require advanced math.
Oliver is estimating the number of defensive possessions a player was involved in. I suspect that quadratic term is some sort of correction he is doing to the posession estimate, but am not sure. Would be nice to be able to answer this question w/o buying the book. Too bad it isn't all online..

Yeah, that $17 is a total bear of a burden.
Ouch. That is going to make the formula pretty off, right? You are effectively then treating twos and threes exactly the same?

It doesn't work entirely neatly for Net Points estimates, no. We can estimate the value of a FGA and I'm sure there wouldn't be much variance, but we'll see how that pans out next year.
Is there any chance you can just post the totals here in this thread? That way I can avoid downloading large files, and we can all discuss and look at them together. Season totals for each category and each player would be interesting to look at.

The .pdf file with all the results is < 100 kb. You could fit 15 of them onto an average 3.5" floppy disk. Maybe some effort on your end is required...

Return to Toronto Raptors