ImageImageImageImageImage

Is PDSS a good way to analyze the Raptors defense?

Moderators: Morris_Shatford, 7 Footer, DG88, niQ, Duffman100, tsherkin, Reeko, lebron stopper, HiJiNX

Reignman
Banned User
Posts: 19,281
And1: 391
Joined: Aug 12, 2004
Location: 2014 playoffs at the ACC!

Re: Is PDSS a good way to analyze the Raptors defense? 

Post#161 » by Reignman » Thu Aug 26, 2010 1:02 pm

BorisDK1 wrote:
Reignman wrote:yeah, it's quite funny actually. On top of that Boris has failed to answer a very important question that SS keeps asking. Yes, I read the above, and calling thousands of mins of data "noise" seems like a cop out answer here. Seems like everyone is pushing their own agenda and won't concede anything.

And lastly, if PDSS says Bargs is an above average defender or a top 3 defender amongst rotation guys on last seasons team then anyone with common sense should be questioning the data / formula used.

Reignman, I think you are engaging in misrepresentation about half as bad as Ripp. :) I have engaged what supersub has said, I've expressed my concerns that it is indirect analysis, that there is considerable noise (which supersub agreed with, but then said the noise somehow goes away when you go further back into the past), that despite admitting that on/off court data does not isolate one player (or even pass judgment on the quality of that player's defense) supersub has tried claiming that that actually happens just by including older data on teams past (which I believe to be untenable).

That aside, I am quite willing to engage that data. Lineups with Bargnani didn't do particularly well on the defensive end than other ones: I think we all get that. The point of PDSS is to further narrow down why that is the case: who gave up how much of what? is what it's trying to show. I am fully willing to consider and evaluate on/off court and APM data; by contrast, supersub and Ripp are 100% unwilling to even consider PDSS as having anything meaningful to say. So my question, is really - who's interacting less with their opponent? IMO, I think it can't be said that it's me...

At the end of the day, I keep coming back to the fact that we need to synthesize some data and at the end of the day, take the questions that the stats bring up (because stats provoke questions, not answers - you have to find the answers on the basketball court) and do business there. It seems supersub and ripp in this conversation up to this point aren't really doing that. And I'd love to get to there eventually, but it might take some time and some doing.


Thanks for the response Boris. To clarify, I love the work you've done and there is some great value in it. After mulling over the pros/cons of both PDSS and DRTG on/off I get the feeling that neither metric can truly capture the overall defensive capabilities of a player.

PDSS captures the 1 vs.1 stuff great; however, it can't differentiate between positions and positional defensive responsibilities / team defense. As we all know, different positions (particularly frontcourts) carry different burdens on defense. I realize you've tracked the data yourself but when it comes to help defense it becomes very murky and handing out grades can get very subjective.

In the same light, DRTG doesn't seem to be able to capture intricate details such as what was actually happening on the floor that caused one 5 man unit to be terrible while another isn't but it gives you an overall view (through deduction) of how some players fair. Now over a small sample size DRTG on/off can be very misleading but over 9000+ mins there has to be some merits to certain players that consistently show up positive over others that consistently show up negative. (After 9000 mins the variables really start to equalize for all rotation players)

Lastly, after reading / participating in this debate for the last 2 or 3 days it's funny that we've come to conclusions that we've already known. In 1 vs. 1 situations Bargs is pretty good but in situations where he needs to provide a ton of help (as has been the case more often than not with our shoddy perimeter D) you start to see some major holes in his game. I mean, there's a reason his own coach said he doesn't understand the concept of help D, why his GM is constantly talking about him improving his defense/rebounding and why opposing players/coaches like Gerald Wallace/SVG find the need to take pot shots at our frontcourt.

So while I agree that Jose doesn't make life any easier for Bargs (believe me, I've been talking about Jose and his faults for about 3 years now) I also believe Bargs himself needs to make tangible improvement with his help defense.
User avatar
BorisDK1
Assistant Coach
Posts: 4,282
And1: 240
Joined: Jul 04, 2010

Re: Is PDSS a good way to analyze the Raptors defense? 

Post#162 » by BorisDK1 » Thu Aug 26, 2010 1:05 pm

Ripp wrote:It isn't my number, it is the team Drtg from say basketball-reference.com or basketballvalue.com. Certainly not my property or invention.
Also, this was a piece of infomation that is given to PDSS...yet it doesn't even regurgitate the number it was given.
It also doesn't know what the team Drtg for different lineups, nor does it know it for say the 4th quarter.

Ripp, you know that's not true. You tried to make that allegation based on DPoss% instead of the individual defensive possessions, and once you summed those - voilà, it was really freaking accurate...

It strains credulity to see arguments already refuted see the light of day yet again.
User avatar
ranger001
Retired Mod
Retired Mod
Posts: 26,938
And1: 3,752
Joined: Feb 23, 2001
   

Re: Is PDSS a good way to analyze the Raptors defense? 

Post#163 » by ranger001 » Thu Aug 26, 2010 1:14 pm

BorisDK1 wrote:
ranger001 wrote:Shouldn't some blame be assigned to the pf/c though who gives up offensive rebounds? An offensive rebound leads to a fg at a higher percentage than a regular fg. If a guy is giving these up it hurts the team defensively and should count negatively towards the guy giving them up.

Well, there's a two-pronged answer for this. Should I assign blame directly? No, because no points were directly scored on the offensive rebound. And that's what we're assigning blame for: points, not other things. (The same argument might be made for the point guard who allows a ballhandler to blow right past him and drop a pass off for a layup to the player who was guarded by one of our bigs who came over to stop the drive. That score generally gets assigned to "team", not the point guard who allowed the drive - but the drive itself didn't directly result in the score, in a sense.)

Indirectly, though, there is a result...

Do you agree though that an individual that gives up a lot of offensive rebounds is a defensive liability(and the pg who just lets his man through and passes it for the assists as the big rotates on the pg)? Points do get scored due to offensive rebounds, directly or indirectly, and a team that gives up lots of offensive rebounds generally loses. So while in PDSS any fga given up due to the oreb may be debited to someone else if its passed off the fga is partially due to the offensive board given up.

As a coach I'm sure you hate when your team gives up too many offensive boards.
Ripp
General Manager
Posts: 9,269
And1: 324
Joined: Dec 27, 2009

Re: Is PDSS a good way to analyze the Raptors defense? 

Post#164 » by Ripp » Thu Aug 26, 2010 1:19 pm

BorisDK1 wrote:
Ripp wrote:It isn't my number, it is the team Drtg from say basketball-reference.com or basketballvalue.com. Certainly not my property or invention.
Also, this was a piece of infomation that is given to PDSS...yet it doesn't even regurgitate the number it was given.
It also doesn't know what the team Drtg for different lineups, nor does it know it for say the 4th quarter.

Ripp, you know that's not true. You tried to make that allegation based on DPoss% instead of the individual defensive possessions, and once you summed those - voilà, it was really freaking accurate...

It strains credulity to see arguments already refuted see the light of day yet again.


No, it failed on most of the major-minute lineups played by the Raps this season...as I showed, for some of the lineups (in particular, the Calderjackoglu lineup) it is simply mathematically impossible for PDSS to guess the performance of accurately; absolutely no weighting scheme exists will give you anything close to the right answers.
Regarding the total cumulative Drtg for the season...first, as you yourself showed, it did not get this number exactly. And if you think about it, this is silly...there should be zero error. What sort of useless algorithm cannot even repeat back to me the very number I gave it? I give it the team's DRat for the season...why the heck can't it then compute this very accurately, or preferably with zero error?
Like I keep saying, it is easy to create ratings systems that (1) fail to predict lineup performance and (2) more accurately regurgitate season DRat for a team than PDSS did. Why is PDSS superior to any of these defensive rating systems that fail at job (1), but do better than PDSS at job (2)?
A Tolkienesque strategy war game made by me: http://www.warlords.co
User avatar
Courtside
RealGM
Posts: 19,460
And1: 14,205
Joined: Jul 25, 2002

Re: Is PDSS a good way to analyze the Raptors defense? 

Post#165 » by Courtside » Thu Aug 26, 2010 1:25 pm

BorisDK1 wrote:
Ripp wrote:It isn't my number, it is the team Drtg from say basketball-reference.com or basketballvalue.com. Certainly not my property or invention.
Also, this was a piece of infomation that is given to PDSS...yet it doesn't even regurgitate the number it was given.
It also doesn't know what the team Drtg for different lineups, nor does it know it for say the 4th quarter.

Ripp, you know that's not true. You tried to make that allegation based on DPoss% instead of the individual defensive possessions, and once you summed those - voilà, it was really freaking accurate...

It strains credulity to see arguments already refuted see the light of day yet again.

Boris - your work and extended time explaining and re-explaining things is immensely appreciated by everyone. Even the guys you're debating with have been complimentary in this regard, but as a someone you'd probably come to consider an ally here, I'd like to ask that you remember the "attack the post, not the poster" guideline that forums generally follow.

As big a smile as some of your quips have given me ( lol'd at the fertilizer and diesel fuel bit), I think we'd rather see you stick around over the long term as a respected, level headed poster and not some guy who always takes subtle jabs at those who don't/won't/can't accept or understand everything you're giving them. We all cross the line once in a while and get things out of our system, so if you need to lose it then just go ahead and do so - that would be preferred to become the snide guy that stays within the TOS, but continually makes subtle or not-so-subtle jabs at other posters.
Calderon
Banned User
Posts: 1,254
And1: 199
Joined: Jan 21, 2009

Re: Is PDSS a good way to analyze the Raptors defense? 

Post#166 » by Calderon » Thu Aug 26, 2010 1:29 pm

not some guy who always takes subtle jabs at those who don't/won't/can't accept or understand everything you're giving them.

Get used to it.
disoblige
Head Coach
Posts: 7,266
And1: 1,244
Joined: Oct 19, 2006
   

Re: Is PDSS a good way to analyze the Raptors defense? 

Post#167 » by disoblige » Thu Aug 26, 2010 1:34 pm

Ripp wrote:
No, it failed on most of the major-minute lineups played by the Raps this season...as I showed, for some of the lineups (in particular, the Calderjackoglu lineup) it is simply mathematically impossible for PDSS to guess the performance of accurately; absolutely no weighting scheme exists will give you anything close to the right answers.
Regarding the total cumulative Drtg for the season...first, as you yourself showed, it did not get this number exactly. And if you think about it, this is silly...there should be zero error. What sort of useless algorithm cannot even repeat back to me the very number I gave it? I give it the team's DRat for the season...why the heck can't it then compute this very accurately, or preferably with zero error?
Like I keep saying, it is easy to create ratings systems that (1) fail to predict lineup performance and (2) more accurately regurgitate season DRat for a team than PDSS did. Why is PDSS superior to any of these defensive rating systems that fail at job (1), but do better than PDSS at job (2)?


because some value were rounded?
User avatar
Courtside
RealGM
Posts: 19,460
And1: 14,205
Joined: Jul 25, 2002

Re: Is PDSS a good way to analyze the Raptors defense? 

Post#168 » by Courtside » Thu Aug 26, 2010 1:36 pm

Calderon wrote:
not some guy who always takes subtle jabs at those who don't/won't/can't accept or understand everything you're giving them.

Get used to it.

Yeah - that's sort of par for the course around here. We even have posters whose sigs are jabs and digs at those they disagree with... I just think it would be a huge loss to this forum if every post or thread by Boris ended up in some bitchfest and he decided to pass on RealGM and stay at Raptorsrealm or wherever he's been posting.


Boris, Ripp and Supersub - did any of you read my post on the previous page regarding the inclusion of defensive rebounding and help stats into PDSS? I think they would go a long way to helping the numbers correspond better with what we see on the court, and with other defensive stats available.
wanker
Banned User
Posts: 726
And1: 4
Joined: Jul 13, 2010

Re: Is PDSS a good way to analyze the Raptors defense? 

Post#169 » by wanker » Thu Aug 26, 2010 1:38 pm

What's PDSS?
Reignman
Banned User
Posts: 19,281
And1: 391
Joined: Aug 12, 2004
Location: 2014 playoffs at the ACC!

Re: Is PDSS a good way to analyze the Raptors defense? 

Post#170 » by Reignman » Thu Aug 26, 2010 1:39 pm

As long as people don't speak in absolutes when it comes to analyzing basketball using stats there can be some great discussion. It really is a useful tool and can help qualify / disqualify certain statements.

At least that's what I get out of it. For eg, 2 years ago I started saying that Jose and Bargs should never be in the starting lineup together or they shouldn't play heavy mins together and now this pretty much cements it for me.
dagger
RealGM
Posts: 41,372
And1: 14,415
Joined: Aug 19, 2002
         

Re: Is PDSS a good way to analyze the Raptors defense? 

Post#171 » by dagger » Thu Aug 26, 2010 1:45 pm

Courtside wrote:Boris - your work and extended time explaining and re-explaining things is immensely appreciated by everyone. Even the guys you're debating with have been complimentary in this regard, but as a someone you'd probably come to consider an ally here, I'd like to ask that you remember the "attack the post, not the poster" guideline that forums generally follow.

As big a smile as some of your quips have given me ( lol'd at the fertilizer and diesel fuel bit), I think we'd rather see you stick around over the long term as a respected, level headed poster and not some guy who always takes subtle jabs at those who don't/won't/can't accept or understand everything you're giving them. We all cross the line once in a while and get things out of our system, so if you need to lose it then just go ahead and do so - that would be preferred to become the snide guy that stays within the TOS, but continually makes subtle or not-so-subtle jabs at other posters.


Amen
We need different analytical observations just as we need/get all kinds of subjective conclusions. Boris' point about the league changing is bang on, and it's a criticial issue for the team, let alone those who follow it. Chisholm's column yesterday, posted as a thread, about the changing nature of the point guard position since the hand check rule was introduced, merely emphasized what half this board has been saying for months - that the position has changed rapidly. There's been an in-flood of young, speedy point guards like Rose, Wall, Paul, Jennings, Collison and Lawson to name a few, and neither of our point guards is an adequate starter for a contending team, not because they always would have been had there been no hand check rule, but because the context in which they play has changed irrevocably. Today's prototypical defending PG has to have good lateral quicks and the ability to get up into a ball-handlers grill long enough to force the offence towards help, not give it a wide open lane to the bucket. The same can be said, to a lesser extent, about the shooting guard position, but at least there we have the athleticism necessary to mold good defenders. It's not surprising to me that Jose's defensive performance is poor. When he entered the league, this New Age point guard we seek wasn't even recognized as something distinct - players like Nash were outliers, freaks, but now high octane point guard play is becoming the norm.

(Ironically, Kobe Bryant argued last week that the international influence in the NBA is creating more hybrids who can play multiple positions - bigs with guard skills - and that this trend is going to continue and it's good for the game, that traditional concepts of position will mean less going forward. I can't imagine who on our team might fight that role.) :lol: :lol:
2019 will never be forgotten because FLAGS FLY FOREVER
Ripp
General Manager
Posts: 9,269
And1: 324
Joined: Dec 27, 2009

Re: Is PDSS a good way to analyze the Raptors defense? 

Post#172 » by Ripp » Thu Aug 26, 2010 1:52 pm

Disoblige: No, he is claiming that the inaccuracy is due to him not tracking 3 pointers, and that it would improve once he does so. But as I say, even if it gave back exactly the number I gave it, this would not be very impressive. Algorithms have to do more than spit out what you gave them, they have to pass additional tests.

Courtside: I agree with you. Like, I love the stat sheet Boris did, and would love to see more things tracked. The more things tracked, the better imo.
As an aside, there is an existing technique (statistical +/-) that attempts to use both on/off stats as well as box score data to understand the NBA....the basketball-reference.com blog sometime chats about it. It does a very good job of predicting lineup performance and games won by teams...and I've found some ways to substantially improve it further. Once I finish with this stuff, I'd like to investigate incorporating some of the Synergy defensive data, which will hopefully boost the predictive power even further.
But yeah, ultimately I'm interested in tools that can actually do a good job of predicting real-world performance, predicting how good Team X's defense will be the season, etc.
A Tolkienesque strategy war game made by me: http://www.warlords.co
elmer_yuck
Veteran
Posts: 2,631
And1: 683
Joined: Dec 17, 2004

Re: Is PDSS a good way to analyze the Raptors defense? 

Post#173 » by elmer_yuck » Thu Aug 26, 2010 2:26 pm

I'm sorry, but I think Boris sounds like a pompous condescending jerk.
Unwilling to take criticism, but quite willing to criticize others.
I like having statheads on the board, but analyzing defense in basketball is not an exact science, no matter how much Boris tells us the opposite.
andreafan
Banned User
Posts: 1,782
And1: 1
Joined: May 01, 2010
Location: somewhere in canada ,not sure

Re: Is PDSS a good way to analyze the Raptors defense? 

Post#174 » by andreafan » Thu Aug 26, 2010 2:39 pm

elmer_yuck wrote:I'm sorry, but I think Boris sounds like a pompous condescending jerk.
Unwilling to take criticism, but quite willing to criticize others.
I like having statheads on the board, but analyzing defense in basketball is not an exact science, no matter how much Boris tells us the opposite.

Yup, yuck and the same applies to his twin, no need to mention his name he knows who he is. :)
User avatar
Truthrising
RealGM
Posts: 12,412
And1: 8,012
Joined: Nov 07, 2009
       

Re: Is PDSS a good way to analyze the Raptors defense? 

Post#175 » by Truthrising » Thu Aug 26, 2010 2:46 pm

elmer_yuck wrote:I'm sorry, but I think Supersub, Ripp and BorisDK sounds like a pompous condescending jerk.
Unwilling to take criticism, but quite willing to criticize others.
I like having statheads on the board, but analyzing defense in basketball is not an exact science, no matter how much Supersub, Ripp and BorisDK tells us the opposite.


:dontknow:
Masai's to do list
Trade - Ibaka
elmer_yuck
Veteran
Posts: 2,631
And1: 683
Joined: Dec 17, 2004

Re: Is PDSS a good way to analyze the Raptors defense? 

Post#176 » by elmer_yuck » Thu Aug 26, 2010 2:51 pm

Supersub and Ripp are much more polite, and willing to recognize flaws in their analysis.
That's what I'd like to see in Boris.
andreafan
Banned User
Posts: 1,782
And1: 1
Joined: May 01, 2010
Location: somewhere in canada ,not sure

Re: Is PDSS a good way to analyze the Raptors defense? 

Post#177 » by andreafan » Thu Aug 26, 2010 2:52 pm

truthrising wrote:
elmer_yuck wrote:I'm sorry, but I think Supersub, Ripp and BorisDK sounds like a pompous condescending jerk.
Unwilling to take criticism, but quite willing to criticize others.
I like having statheads on the board, but analyzing defense in basketball is not an exact science, no matter how much Supersub, Ripp and BorisDK tells us the opposite.


:dontknow:

:lol: :lol: :lol:
dagger
RealGM
Posts: 41,372
And1: 14,415
Joined: Aug 19, 2002
         

Re: Is PDSS a good way to analyze the Raptors defense? 

Post#178 » by dagger » Thu Aug 26, 2010 3:00 pm

elmer_yuck wrote:Supersub and Ripp are much more polite, and willing to recognize flaws in their analysis.
That's what I'd like to see in Boris.


You're such arse it's unbelievable. Ripp has been dipping deep into condescension like, "You don't understand statistics"... blah, blah.

If there is one thing that we can count on from your ilk - yes, ilk, it's pejorative - is hypsocrisy and loads of it.

I know I am a rude poster. But you actually think you're something your not, and you extend that cloak of hypocrisy to the rest of your greasy mob.
2019 will never be forgotten because FLAGS FLY FOREVER
User avatar
BorisDK1
Assistant Coach
Posts: 4,282
And1: 240
Joined: Jul 04, 2010

Re: Is PDSS a good way to analyze the Raptors defense? 

Post#179 » by BorisDK1 » Thu Aug 26, 2010 3:03 pm

Ripp wrote:No, it failed on most of the major-minute lineups played by the Raps this season...as I showed, for some of the lineups (in particular, the Calderjackoglu lineup) it is simply mathematically impossible for PDSS to guess the performance of accurately; absolutely no weighting scheme exists will give you anything close to the right answers.

PDSS data judges individual performance in team, not lineup, context. It doesn't attempt to show what you are asking, so how does it "fail"? It "fails" in the exact same way lineup data or on/off court data demonstratively shows individual culpability (it doesn't handle that question at all). It fails in the same way I'm going to fail buying rutabaga for dinner tonight: I'm not going to try, and it's not going to get done. :)
Regarding the total cumulative Drtg for the season...first, as you yourself showed, it did not get this number exactly.

The problems you asserted was that the number of individual possessions as estimated by you multiplying DPoss% and minutes played didn't match up. As I warned you from the beginning, that wasn't going to work and you have to sum individual possessions to match team possessions (which worked really well). So there was no problem with the # of possessions portion of this analysis at all. Where the problem did come in going back was in individual points allowed, and that happened because I didn't differentiate between 3FGA and FGA and had to estimate the value of a FGA. In rounding, this didn't work out completely well and will be rectified next year when I do distinguish 3FGA. That's hardly a fatal flaw. :)

Your initial assertion, however, did turn out to be unfounded. Let's just be clear on that.
Like I keep saying, it is easy to create ratings systems that (1) fail to predict lineup performance and (2) more accurately regurgitate season DRat for a team than PDSS did. Why is PDSS superior to any of these defensive rating systems that fail at job (1), but do better than PDSS at job (2)?

But you haven't done a better job than PDSS at anything other than making up random formulae to waste people's time. ;) And how can PDSS "fail at lineup performance", exactly? It should predict individual performance of those players quite well, especially when you're looking at the individual elements of the DRat. Why might a given lineup vary? Limited sample size? Superior opposition? I don't know - and further, neither do you because as much as you might love APM or on/off court data, it doesn't tell you why anything happens. You might want to pretend that it does, but it doesn't.

And that's where statistical analysis has to go the basketball floor. At that point, we have a serious disconnect because I have yet to hear you give one basketball reason for any of the things you want to point to. I can explain where I got everything I have (it actually happened, and it was tabulated as I watched it), but you don't really have much explanatory power as to why it happened. You can point out that there is a problem or a benefit, but not why. And that's where the disconnect is, because you're not taking your observations to the basketball floor. And you're always going to have a tough time dealing with things.

As much as you want to say that PDSS can't predict lineups, on/off court data has to look and shrug about providing answers as to whom is doing what and how much of it. Its explanatory power as to how what people are actually doing on the basketball floor seems pretty limited. I understand that you think lineup data should have the final say. My point has always been that there needs to be synthesis, not abject dismissal (which, sadly, you've chosen to do - mostly because you don't like the results, let's just lay those cards on the table right now).
elmer_yuck
Veteran
Posts: 2,631
And1: 683
Joined: Dec 17, 2004

Re: Is PDSS a good way to analyze the Raptors defense? 

Post#180 » by elmer_yuck » Thu Aug 26, 2010 3:09 pm

dagger wrote:
elmer_yuck wrote:Supersub and Ripp are much more polite, and willing to recognize flaws in their analysis.
That's what I'd like to see in Boris.


You're such arse it's unbelievable. Ripp has been dipping deep into condescension like, "You don't understand statistics"... blah, blah.

If there is one thing that we can count on from your ilk - yes, ilk, it's pejorative - is hypsocrisy and loads of it.

I know I am a rude poster. But you actually think you're something your not, and you extend that cloak of hypocrisy to the rest of your greasy mob.


For my response, I'll just use andreafan's response to everything:
:lol: :lol: :D :roll: :roll:

Return to Toronto Raptors