Stat guys Duncan vs Garnett (bear with me)

Moderator: Doctor MJ

drza
Analyst
Posts: 3,518
And1: 1,852
Joined: May 22, 2001

Re: Stat guys Duncan vs Garnett (bear with me) 

Post#21 » by drza » Sat Apr 19, 2014 4:18 pm

Chicago76 wrote:Long post, so bear with me:

I've been thinking a bit about RAPM lately. Specifically, how RAPM is essentially a linear solution to a non-linear problem and how that can impact value estimates. We know that lineup A vs. lineup B won't necessarily have a close outcome with respect to the RAPM values estimated. Players aren't robots. We also know lineups are non-randomized and limited as are player minutes. This means player rotations can often complicate the system's ability to identify which player is responsible for the relative outcome vs. another lineup. This is the mathematical error portion and people who are much better versed in the nuts and bolts of the mathematics can run circles around me (and the rest of us) on this part.

When I refer to a non-linear problem, the issues I'm trying to wrap my head around relate to redundancies, synergies, team construction philosophy, and team quality. These issues could suppress or exaggerate a player's RAPM outside of mathematical error/deviation computations.

Team quality is the most intuitive, with the two core issues here being diminishing returns and coasting. Adding a +5 RAPM player to a good lineup is not likely to produce incremental improvement equivalent to adding the same player to a bad team, all else equal. As the quality of teammates increases, a player's incremental impact should decrease. This is the direct RAPM player impact of a good team. Indirectly, good teams are also prone to coasting on leads more frequently, which would suggest that the Ortg-Drtg differential of a good team is to some extent suppressed. If you're up by 15 with 9 minutes left in the game, a team doesn't need to keep their foot down to destroy someone by 25. They just need to play a low-risk/low energy style that will maintain their probability of a W while conserving energy for the demands of the rest of the season. Intuitively, this makes sense to me, although to test it someone would need to look at NPI changes when high impact players face substantial teammate quality changes season over season. There are exceptions (Garnett being a good one w BOS). There is also the issue that high impact players frequently change teams when they are being underutilized and/or their attitude is negatively affecting their play, which would suggest an RAPM bounce the post-team change. Generally though, I would expect this principle to hold true.

What is interesting is comparing RAPM MIN Garnett vs. Duncan over the same period and grouping them according to how good their respective teams were when both were off (simple +/- per 100). 2002-07, MIN had 4 years of -10 per 100 or worse without Garnett. His average normalized RAPM (from Doc's spreadsheet) in those years was 9.8. For the other two years where MIN posted better off-Garnett numbers (-4.2 and +1), his RAPM was only +6.0. Duncan’s Spurs always had better off-Duncan numbers. He was +8 the two years the Spurs posted solid off-Duncan numbers (+2.5 or higher) and Duncan was +9.5 in the other 5 years, four of which were years the team was around 0 to -1 with Duncan on the bench. This still doesn’t explain BOS Garnett though.

The other component I'm thinking about is the more complicated issues of synergies/redundancies and team construction philosophy. This is on a team level. I'm not looking at this from a player characteristic or portability angle. If we suspend reality for a moment and assume that all teams are equal with respect to talent evaluation, drafting, wheeling/dealing, FA acquisition, every player is paid in accordance with their production, and every team spends the exact same amount of money, then every team in the league is mediocre and talent/ability is perfectly distributed across the league. There is a continuum of construction strategy ranging from high risk/high reward to low risk/low reward. The high risk and reward team would be assembled in a way that everyone had a very specific role they performed very well. Players are compartmentalized with respect to skill set and the team relies upon discrete skill sets feeding others to create a perfectly synergistic and additive RAPM output with no redundancies. This team would win a lot until one of those pieces either gets hurt or slumps. Then they would suck horribly. The low risk/low reward team would feature built in redundancies. This team would never hit the same level of play as the first team, but they'd be able to hum along with an insurance policy against injury or a player slump.

The low risk strategy is the Spurs in a nutshell, except they are obviously far above average from a talent evaluation and personnel management standpoint. They were remarkably consistent, regardless of who might have missed stretches of the season with injury. Duncan played at least 33mpg in his first 11 non-CBA shortened seasons. Apart from a 63-win season, they never won more than 60 games, but they always won at least 53. They hit 56-58 wins more than half the time, with the other seasons not too far off (53, 54, 59, 60). In Duncan’s first 10 years, they weren’t superlatively dominant in the way that many dynasties are where they can reel off consecutive titles or finals appearances. They never even went to the WCF in consecutive years. They were consistently good and over the long run they were able to win a title every 2-3 years with reasonably deep bench play and a variety of players who rose to the occasion in key moments. This is what redundant teams do. They maintain a consistent level of play, and quite likely individual player RAPMs among many of their most important players were suppressed a bit. BOS was a bit more compartmentalized w/ Allen, Rondo, and Garnett in particular. They didn’t have a way of playing around the issue of Garnett being on the bench quite as easily as the Spurs did with Duncan. Part of that may be that Garnett offers an extremely rare skill set that happens to be valuable. But another part might be construction or Popovich’s ability to do things with alternate lineups Rivers couldn’t.

Curious to hear what others think of my little theory. Re: Garnett v. Duncan, I think you can make a reasonable case for either. Their respective RAPMs are close enough, due to statistical error and the issues I mentioned, that the case isn’t made or lost for either on the basis of RAPM. Someone’s selection of one over the other will be determined more by what the selector places importance upon rather than a clear cut statistical case.


Not even getting into the math, but just philosophically, there is a very interesting interpretation to be made from your post. RAPM was never conceived to measure who the best basketball player is...it is intended to be a measure of how much a player contributes to their team's success.

So if your argument that you're making above turns out to hold water, you're essentially making a reasonably compelling argument that over the bulk of their careers Duncan didn't have to impact the games as much for his team to be successful. This wouldn't necessarily prove that Garnett or Duncan were better, but it would indicate that Duncan wasn't as vital to his team's fortunes through the years as Garnett.

And what makes that a really interesting argument, is that it's the EXACT argument that Garnett supporters have been making since the 90s. That Duncan is an AMAZING player, but that he's been blessed to be on a team with excellent materials and a great system. This in no way knocks Duncan at all. But what it does is provide context to the comparison. Because if the root of the case for Duncan over Garnett is based on team success...and if we're honest, that's the ENTIRE basis for the majority of people...then it is hugely vital to acknowledge that Duncan's teams were designed and executed such that he didn't have to be relied on so heavily for the team's success.

You can't get carried away too far in either direction with that particular line of logic. But it is definitely food for thought
Creator of the Hoops Lab: tinyurl.com/mpo2brj
Contributor to NylonCalculusDOTcom
Contributor to TYTSports: https://www.youtube.com/playlist?list=PLTbFEVCpx9shKEsZl7FcRHzpGO1dPoimk
Follow on Twitter: @ProfessorDrz
User avatar
ronnymac2
RealGM
Posts: 10,890
And1: 4,881
Joined: Apr 11, 2008
   

Re: Stat guys Duncan vs Garnett (bear with me) 

Post#22 » by ronnymac2 » Sat Apr 19, 2014 9:03 pm

drza wrote:RAPM was never conceived to measure who the best basketball player is...it is intended to be a measure of how much a player contributes to their team's success.


Thank you.

In my personal experience with RAPM, the best effect it has on my analysis of players is that it removes doubt that a player can have a certain level of impact in reality.

The biggest example in my experience is in fact KG (Nash to a lesser extent). I always liked KG and thought he was an elite, top 3-5 player in the league based on who he was as a player, on what he had become. I've thought this since probably 2002, and even as my understanding of the game matured and improved, I felt that way.

I'm not a ring-counter, but some of the arguments against KG (and Nash), especially critiquing their unique style of impact, did give me worry that I was wrong. I doubted my analysis. Maybe KG was closer to Chris Webber. Maybe Nash didn't deserve those MVPs.

What RAPM does for me is measure a player's true impact in a real-life scenario. It erases doubt. It also opens my mind and makes me less prejudiced against players with a non-traditional style of impact like Kevin Garnett (or Jason Kidd for instance).

It also gets my imagination flowing. I always doubt that any player was in a perfect situation for him to realize his apex impact (apex impact meaning apex RAPM for this conversation). Because of that error — not error in a statistical sense, but error in that we only have one reality to work with per player, thus RAPM can never give us who the best player is, can never measure pure on-court "goodness" — I can contextualize what happens on the court and what could have happened given scenario X, scenario y, scenario z, etc. It's exciting.


RAPM is maybe 5% of my total analysis of a player. I don't think the stat itself is amazing. I don't think it's telling for a lot of players. But it is extremely useful to me because of what I talked about above.
Pay no mind to the battles you've won
It'll take a lot more than rage and muscle
Open your heart and hands, my son
Or you'll never make it over the river
Chicago76
Rookie
Posts: 1,134
And1: 228
Joined: Jan 08, 2006

Re: Stat guys Duncan vs Garnett (bear with me) 

Post#23 » by Chicago76 » Mon Apr 21, 2014 6:43 am

drza wrote:Not even getting into the math, but just philosophically, there is a very interesting interpretation to be made from your post. RAPM was never conceived to measure who the best basketball player is...it is intended to be a measure of how much a player contributes to their team's success.

So if your argument that you're making above turns out to hold water, you're essentially making a reasonably compelling argument that over the bulk of their careers Duncan didn't have to impact the games as much for his team to be successful. This wouldn't necessarily prove that Garnett or Duncan were better, but it would indicate that Duncan wasn't as vital to his team's fortunes through the years as Garnett.


Yup. I would even specify the true definition of RAPM a bit more. RAPM is designed to measure how much a player contributes to his team's success, with an important caveat: it assumes that the relative net efficiency differences (Ortg-drtg per 100 on and off) are the same if the player in question is off 1 possession or for an entire season. If a team plays the same way with or without a major player, with the exception of the fact they're replacing him with a vastly inferior player, there is little redundancy and a higher RAPM value, all else equal. If that player is supressing the production of others, then there is redundancy and a lower RAPM value, all else equal.

Then there's the ability to extend that "off" productivity based upon unique circumstances. If the other team goes small, you might give your star big a rest and allow your team to play small. Your lineup might do better than expected, but you couldn't play that way all game. Similarly, you might have a couple of guys who can change style to offset the difference. If they can play that way for their full minute allotment, you've got redundancy, but they might not be able to reasonably duplicate that style over an entire game. Using some elite player examples: Wade might be able to play more aggressively on the offensive end when James goes out, but he can't sustain that style over a game, much less a season anymore. You couldn't reasonably assume the Heat's "James off" production is as high as it is for 5 minute spurts, even though that's what the math might tell you. A system of equations can't understand that energy, effort, and style isn't always scalable. Using Duncan specifically, Robinson might have been able to do things for a few minutes with TD on the bench he no longer could for longer stretches. Same thing with the Spurs going small and telling Ginobili to go ahead and drive more and look for either the finish or the kick out to a shooting specialist. If you asked Ginobili to play just a little more aggressively than he already did for his full minute allocation, he'd break down even more frequently. In these types of scenarios the player's RAPM is capturing value over short term off, while in a perfect world, the value would probably be more like value over sustainable off. There is no reasonable way to test for these sorts of effects, however.

I don't have a dog in this one as I like both guys relatively equally, but I can see how this type of stuff might manifest itself to a greater extent in Duncan's #s than Garnett's. The only point I'm trying to raise here is that RAPM isn't measuring exactly what we'd like it to, so more context is needed than we might think is necessary when comparing RAPM. If player A consistently nets an RAPM of +3 while player B consistently nets +1, I'm generally inclined to favor player A. If we're talking about a +9 vs. a +6 guy, I'm not prepared to make the same statement. Guys who are playing at that level influence team strategy, player substitution patterns, opponent strategy, etc so much that context takes over.
drza
Analyst
Posts: 3,518
And1: 1,852
Joined: May 22, 2001

Re: Stat guys Duncan vs Garnett (bear with me) 

Post#24 » by drza » Mon Apr 21, 2014 9:54 pm

ronnymac2 wrote:
drza wrote:RAPM was never conceived to measure who the best basketball player is...it is intended to be a measure of how much a player contributes to their team's success.


Thank you.

In my personal experience with RAPM, the best effect it has on my analysis of players is that it removes doubt that a player can have a certain level of impact in reality.

The biggest example in my experience is in fact KG (Nash to a lesser extent). I always liked KG and thought he was an elite, top 3-5 player in the league based on who he was as a player, on what he had become. I've thought this since probably 2002, and even as my understanding of the game matured and improved, I felt that way.

I'm not a ring-counter, but some of the arguments against KG (and Nash), especially critiquing their unique style of impact, did give me worry that I was wrong. I doubted my analysis. Maybe KG was closer to Chris Webber. Maybe Nash didn't deserve those MVPs.

What RAPM does for me is measure a player's true impact in a real-life scenario. It erases doubt. It also opens my mind and makes me less prejudiced against players with a non-traditional style of impact like Kevin Garnett (or Jason Kidd for instance).

It also gets my imagination flowing. I always doubt that any player was in a perfect situation for him to realize his apex impact (apex impact meaning apex RAPM for this conversation). Because of that error — not error in a statistical sense, but error in that we only have one reality to work with per player, thus RAPM can never give us who the best player is, can never measure pure on-court "goodness" — I can contextualize what happens on the court and what could have happened given scenario X, scenario y, scenario z, etc. It's exciting.


RAPM is maybe 5% of my total analysis of a player. I don't think the stat itself is amazing. I don't think it's telling for a lot of players. But it is extremely useful to me because of what I talked about above.


This was an interesting post, and it gives good insight into your perspective. I underlined the last section because it's what I find myself wanting most to respond to.

I couldn't give any kind of percentage for how much I factor RAPM into my analysis, but if I did I'm sure it would be well over 5%. Interestingly, though, many of the reasons for that are very similar to the ones that you name.

RAPM is the current poster-stat for an approach that is very attractive to me. As Doc MJ has pointed out very well on his blog, the "impact" stats run almost orthogonal to the box score stats because one doesn't require the other. In addition, continuing the re-wording of Doc MJ's post, the box score approach may be precise but not valid while the +/- approach may not be so precise but is potentially much more valid. I think that's a game-changer, when it comes to evaluation. On both an individual and a global level. Said another way, I like that the impact stats can help to measure relative impact between individual players, and I ALSO like that finding trends in those stats can help to identify types of playing styles that produce high-impact (e.g. your defensive anchors, your spacing effects from great shooters, etc.) vs others that aren't as valuable as once believed (like the high-volume ball-dominant scorer).

And because the +/- stats are orthogonal to the box score stats, I don't favor the approach of using the boxes for a large chunk of the verdict and then using the +/- stats to modify that opinion slightly. No, if given enough +/- stats over a long enough period including lots of different circumstances, I'm generally likely to weigh the +/- results significantly more heavily than I do what the boxes tell me.

Now obviously, all of the above is filtered through my observations, experience and common sense. The fact that someone like Amir Johnson tends to finish extremely high in the +/- stats isn't going to make me argue him as one of the best players of all-time. Of course I look at the eye-test, the player's usage and role on the team, etc. But the fact that Johnson tends to do well in the +/- stats does make me more willing to look closer at his game, and to look for what it is about him and his play that tends to be of more help to his team than we'd expect.

I also want to reply to Chicago76 when I have time, and I'm sure I'll expand on my POV more in that response. But in general I tend to think that the +/- stats, perhaps because they are newer and less entrenched, tend to not be trusted as much as they perhaps should be. There are warts, it should never be used on an island as a be-all stat, and context/whole-mind analysis will always be better. But in my view +/- data is an extraordinarily valuable tool, one that dramatically changes the caliber of analysis that one can do, and one that really helps to put into perspective stories that were either blurry or in some cases completely unseen using other, more prevalent analysis methods.
Creator of the Hoops Lab: tinyurl.com/mpo2brj
Contributor to NylonCalculusDOTcom
Contributor to TYTSports: https://www.youtube.com/playlist?list=PLTbFEVCpx9shKEsZl7FcRHzpGO1dPoimk
Follow on Twitter: @ProfessorDrz
Doctor MJ
Senior Mod
Senior Mod
Posts: 50,791
And1: 19,485
Joined: Mar 10, 2005
Location: Cali
     

Re: Stat guys Duncan vs Garnett (bear with me) 

Post#25 » by Doctor MJ » Mon Apr 21, 2014 10:35 pm

sp6r=underrated wrote:
Doctor MJ wrote:
Re: GOAT candidate. And see that's the thing. It's not just about the debate with Duncan. As I'm starting to ponder my perspectives in remaking my GOAT list this summer, it's easy to see Garnett climbing and climbing. I wouldn't quite call him a GOAT candidate, but I won't be shocked if he ends up #4 on my list.


It really isn't just KG that should be in for some revisionism if you really accept a strong belief in the validity of RAPM.

To go really controversial, how about David Robinson and Hakeem Olajuwon . This is not in comparison to each other but rather their place in the hollowed realgm player comparisons board.

On the PC board Hakeem is regarded as a GOAT level player while Robinson is nothing more than a RS warrior/PS choker.

Here is how Robinson ranks in ascreamacrossthecourt's RAPM figures from 98-00:

Code: Select all

                          OFF  DEF TOT LG Rank
1998   David Robinson    0.73   3.64   4.37   23   
1999   David Robinson    1.83   5.18   7.00   3   
2000   David Robinson    1.96   4.53   6.49   4   
2001   David Robinson   -0.10   4.10   4.00   9   NPI
2002   David Robinson   -0.30   2.10   1.80   21   I believe year is incomplete
2003   David Robinson   -0.1    3.4    3.3     9   


Robinson as an old man who suffered a real injury is closer to KG than he is to all of the other older greats. Robinson is killed for his post-season performance yet his on/off numbers from the post-season look amazing. He is also associated with two of the biggest turnaround/collapses in NBA history. Is it really reasonable to doubt 90-96 Robinson had monster RAPM figures?

Hakeem, in neither 97 or 99, years in which he looked great from a box score perspective never shows much of anything. Indeed, Hakeem supporters tout 97 as his last great season and yet he only ranks 28th in the league (42nd (1998), 52nd (1999)). He ranks far and away worse than Robinson. TD 2010-2012 is solidly above Hakeem 97-99 in league rank. Why isn't Hakeem able to show any significant impact in comparison to other older bigs (save Shaq) if he truly is this GOAT level player?

Now it is possible to still conclude the negative view of Robinson is correct just as it is possible to hold the positive view of Hakeem is correct because relevant data is missing. Nonetheless, these are the types of questions that have to be pondered for people who have a very strong belief in RAPM.


So once again sp6r, I find your posts here to be very insightful and in some ways it's like you're reading my mind.

Re: Not just KG in for revision. Certainly, I'm in the process of re-evaluating guys from the '90s in light of the new data.

Re: Robinson & Olajuwon. Yup, I'm looking at that too. It's important to realize that we're seeing Robinson in a role where he's playing with less primacy thus allowing him to specialize in accordance to the minutes he can give whereas Olajuwon at this point is still his team's designated star. Still though, the advanced stats were never "with" Olajuwon before and it seems thus far like the +/- data isn't telling a totally different story.
Getting ready for the RealGM 100 on the PC Board

Come join the WNBA Board if you're a fan!
Doctor MJ
Senior Mod
Senior Mod
Posts: 50,791
And1: 19,485
Joined: Mar 10, 2005
Location: Cali
     

Re: Stat guys Duncan vs Garnett (bear with me) 

Post#26 » by Doctor MJ » Mon Apr 21, 2014 10:39 pm

RealRapsFan wrote:If I can add my 2 cents.

It feels as if your problem is more philosophical than scientific. As if you are looking for an absolute, or a guarantee, in a world where there is none. Until you feel that absolute is true, you've made your home on the proverbial fence, unwilling to set foot into 'new' territory.

Our stats, whether rankings or values or whatever, are probabilities. As such we can't, and shouldn't, ensure that they are 100% true..... there is room for error. In fact, that an error will occur should be the only guarantee. While I don't doubt you recognize this, we are also in a world that often doesn't want to. Its wants surety. It wants guarantees. More so if it goes against commonly held perceptions. I find that often weighs on people who put their faith in science - "I need to know, without a shadow of a doubt, this is true or people won't trust me. Won't trust the science" (take that quote liberally ofcourse)

I actually think this is a good thing (most of the time), as too many (particularily in the internet stats community) don't do this... they are too often over confident in their work. In what they've done, in what they want to be known or believed. Bias sets in, blinds them, and overwhelms their ability to practice good science. They become true economists at heart :lol:

Yet, as you pointed out, you can't sit on that fence forever. Science goes no where when it refuses to give us an answer to the question.

You can't do more than test your hypothesis, come to a conclusion and MOST IMPORTANTLY be open, willing and have a desire for criticism. In the end, its that criticism that opens up avenues we never would have found on our own. And this is really how we come to realize the truth, isn't it?

It sure sounds as if the only thing keeping your from claiming KG > Duncan is your own self doubt in the result, a bias in and of itself (even if a healthy one), rather than work you've done. Don't forget, its not like you can't retest with more/better information later and come to a new conclusion. If anything, an unwillingness to do so would be the biggest mistake you could possibly make.


A perceptive post. I would say it's not entirely the bias that's keeping me from "jumping" here, to some degree what I'm doing is saying to a group of people whose knowledge I respect "this is where I'm at right now with this stuff, where are you?".
Getting ready for the RealGM 100 on the PC Board

Come join the WNBA Board if you're a fan!
Doctor MJ
Senior Mod
Senior Mod
Posts: 50,791
And1: 19,485
Joined: Mar 10, 2005
Location: Cali
     

Re: Stat guys Duncan vs Garnett (bear with me) 

Post#27 » by Doctor MJ » Mon Apr 21, 2014 11:10 pm

Chicago76 wrote:Long post, so bear with me:

I've been thinking a bit about RAPM lately. Specifically, how RAPM is essentially a linear solution to a non-linear problem and how that can impact value estimates.


Yup, this is a pretty important point.

Chicago76 wrote:We know that lineup A vs. lineup B won't necessarily have a close outcome with respect to the RAPM values estimated. Players aren't robots. We also know lineups are non-randomized and limited as are player minutes. This means player rotations can often complicate the system's ability to identify which player is responsible for the relative outcome vs. another lineup. This is the mathematical error portion and people who are much better versed in the nuts and bolts of the mathematics can run circles around me (and the rest of us) on this part.

When I refer to a non-linear problem, the issues I'm trying to wrap my head around relate to redundancies, synergies, team construction philosophy, and team quality. These issues could suppress or exaggerate a player's RAPM outside of mathematical error/deviation computations.

Team quality is the most intuitive, with the two core issues here being diminishing returns and coasting. Adding a +5 RAPM player to a good lineup is not likely to produce incremental improvement equivalent to adding the same player to a bad team, all else equal. As the quality of teammates increases, a player's incremental impact should decrease. This is the direct RAPM player impact of a good team. Indirectly, good teams are also prone to coasting on leads more frequently, which would suggest that the Ortg-Drtg differential of a good team is to some extent suppressed. If you're up by 15 with 9 minutes left in the game, a team doesn't need to keep their foot down to destroy someone by 25. They just need to play a low-risk/low energy style that will maintain their probability of a W while conserving energy for the demands of the rest of the season. Intuitively, this makes sense to me, although to test it someone would need to look at NPI changes when high impact players face substantial teammate quality changes season over season. There are exceptions (Garnett being a good one w BOS). There is also the issue that high impact players frequently change teams when they are being underutilized and/or their attitude is negatively affecting their play, which would suggest an RAPM bounce the post-team change. Generally though, I would expect this principle to hold true.

What is interesting is comparing RAPM MIN Garnett vs. Duncan over the same period and grouping them according to how good their respective teams were when both were off (simple +/- per 100). 2002-07, MIN had 4 years of -10 per 100 or worse without Garnett. His average normalized RAPM (from Doc's spreadsheet) in those years was 9.8. For the other two years where MIN posted better off-Garnett numbers (-4.2 and +1), his RAPM was only +6.0. Duncan’s Spurs always had better off-Duncan numbers. He was +8 the two years the Spurs posted solid off-Duncan numbers (+2.5 or higher) and Duncan was +9.5 in the other 5 years, four of which were years the team was around 0 to -1 with Duncan on the bench. This still doesn’t explain BOS Garnett though.

The other component I'm thinking about is the more complicated issues of synergies/redundancies and team construction philosophy. This is on a team level. I'm not looking at this from a player characteristic or portability angle. If we suspend reality for a moment and assume that all teams are equal with respect to talent evaluation, drafting, wheeling/dealing, FA acquisition, every player is paid in accordance with their production, and every team spends the exact same amount of money, then every team in the league is mediocre and talent/ability is perfectly distributed across the league. There is a continuum of construction strategy ranging from high risk/high reward to low risk/low reward. The high risk and reward team would be assembled in a way that everyone had a very specific role they performed very well. Players are compartmentalized with respect to skill set and the team relies upon discrete skill sets feeding others to create a perfectly synergistic and additive RAPM output with no redundancies. This team would win a lot until one of those pieces either gets hurt or slumps. Then they would suck horribly. The low risk/low reward team would feature built in redundancies. This team would never hit the same level of play as the first team, but they'd be able to hum along with an insurance policy against injury or a player slump.

The low risk strategy is the Spurs in a nutshell, except they are obviously far above average from a talent evaluation and personnel management standpoint. They were remarkably consistent, regardless of who might have missed stretches of the season with injury. Duncan played at least 33mpg in his first 11 non-CBA shortened seasons. Apart from a 63-win season, they never won more than 60 games, but they always won at least 53. They hit 56-58 wins more than half the time, with the other seasons not too far off (53, 54, 59, 60). In Duncan’s first 10 years, they weren’t superlatively dominant in the way that many dynasties are where they can reel off consecutive titles or finals appearances. They never even went to the WCF in consecutive years. They were consistently good and over the long run they were able to win a title every 2-3 years with reasonably deep bench play and a variety of players who rose to the occasion in key moments. This is what redundant teams do. They maintain a consistent level of play, and quite likely individual player RAPMs among many of their most important players were suppressed a bit. BOS was a bit more compartmentalized w/ Allen, Rondo, and Garnett in particular. They didn’t have a way of playing around the issue of Garnett being on the bench quite as easily as the Spurs did with Duncan. Part of that may be that Garnett offers an extremely rare skill set that happens to be valuable. But another part might be construction or Popovich’s ability to do things with alternate lineups Rivers couldn’t.

Curious to hear what others think of my little theory. Re: Garnett v. Duncan, I think you can make a reasonable case for either. Their respective RAPMs are close enough, due to statistical error and the issues I mentioned, that the case isn’t made or lost for either on the basis of RAPM. Someone’s selection of one over the other will be determined more by what the selector places importance upon rather than a clear cut statistical case.


What happened with Garnett in Boston was a really, really big deal for me and a lot of others.

I do understand the thinking along the lines that a superstar on a great team only does what is needed and hence that there should be slack given, and I do that to a degree. But there's also an aspect where you have to ask what a player has proven he's capable of doing.

If the theory is that Duncan could have done more if it had been needed, one needs to say what exactly he'd have done "more" of. Breaking it down a bit using the scaled RAPM data I put in my spreadsheet:

Duncan in his "peak" (around 2003), was having about 6-7 points of impact per 100 possessions. That puts him right in line with just about every other of the very top defenders we see in the data. Garnett and Zo have a year in the '70s, but otherwise they, Big Ben, Robinson are right in line with Duncan, and meanwhile Dwight Howard is stuck in the 5-6 range. (Incidentally, Mutombo is the one guy a tier above everyone else living regularly north of +8.) To me this basically says everything that anyone would have ever said about Duncan.

The issue with Duncan comes in on the offensive side of the ball where he's regularly checking in in the 2-ish range of impact. And while one might say "So, he'd take on there as needed", one really needs to remember that the entire reason the Spurs have stayed so good as Duncan has faded is that the team got better on offense as they relied on others more than Duncan. When you put in a general context - that at least I believe - where having a middling efficiency big as your volume scorer isn't actually that fantastic of an idea, these things don't look like a coincidence.

In the end, I think the data nails Duncan pretty well. I actually think it's the Garnett side of things that's more questionable. Garnett is seen as a much more impactful offensive player than Duncan by these numbers - to the point that that is probably the thing that tips the scale for me - but Garnett also has a (fair or unfair) reputation as someone whose role as offensive focus is more vulnearable to playoff defense than your average offensive star. If that reputation holds true, then RAPM may indeed overrate Garnett's actual playoff value.
Getting ready for the RealGM 100 on the PC Board

Come join the WNBA Board if you're a fan!
Doctor MJ
Senior Mod
Senior Mod
Posts: 50,791
And1: 19,485
Joined: Mar 10, 2005
Location: Cali
     

Re: Stat guys Duncan vs Garnett (bear with me) 

Post#28 » by Doctor MJ » Mon Apr 21, 2014 11:26 pm

Purch wrote:It's actually amazing to me, that someone's whole perception of two players can be completely altered by one stat. I've always looked at stats alongside, what I observe a player doing on the court. But I've never had an internal struggle about picking one player over another, because of a single stat. It seems kind of weird to me.


It's not actually as dramatic as all that. I'm not looking at a stat and concluding that Darko Milicic was actually better than LeBron. I'm talking about two guys who were the top two MVP candidates around in the early-to-mind 2000s, during which the debate about them was fierce. After that point when Garnett's team went south, so did his reputation and people essentially retroactively considered the debate absurd. The question among the more rationally minded basketball analysts from that point is whether there really was a basis for being so dead sure that Duncan was better, and it's something that's never likely to be answered if we're honest.

So if we then re-phrase how you're speaking in terms of "Are you really going to let one stat be the tiebreaker between two players of comparable stature?", the answer to that is "Sure, it could be. If it paints a clear enough picture, then why would I use something else as that tiebreaker?".

Now additionally, clearly you don't get the fascination with this particular stat - or rather this particular family of stats. From my perspective, these are the only type of stats that can hope to give you a holistic understanding of what a guy's true impact is. The don't give enough detail, and aren't reliable enough, that I would use them as a straight ranking mechanism, but when I've got two guys who play the game very differently while both standing out spectacularly, I'll admit I'm quite reluctant to say which is clearly having more impact based on the granules of information that the box score and the eye provide.
Getting ready for the RealGM 100 on the PC Board

Come join the WNBA Board if you're a fan!
sp6r=underrated
RealGM
Posts: 17,215
And1: 8,553
Joined: Jan 20, 2007
 

Re: Stat guys Duncan vs Garnett (bear with me) 

Post#29 » by sp6r=underrated » Mon Apr 21, 2014 11:38 pm

I have another philosophical point for people who have a strong belief in the value of RAPM. RAPM is considered part of the plus/minus family. Plus/minus stats are really individual point differentials. RAPM, APM and other similar stats are attempt to adjust for external factors and arrive at true individual point differential.

If you really have a strong belief in the value of RAPM and APM I don't know how you cannot heavily rank teams by point differential. Say what you will about a stat such as SRS there is far less adjustments involved in calculating a team's true point differential than there is for an individual's true point differential.

In short, I think if you have a strong believe in individual point differential it is only logical to have an extremely strong belief in the validity of team point differential as the basis for ranking teams. This calls for heavy revisionism as much as RAPM.
Doctor MJ
Senior Mod
Senior Mod
Posts: 50,791
And1: 19,485
Joined: Mar 10, 2005
Location: Cali
     

Re: Stat guys Duncan vs Garnett (bear with me) 

Post#30 » by Doctor MJ » Mon Apr 21, 2014 11:41 pm

I'll speak a tad more on standard errors in stats here:

There is a difference between putting stock in a single many-year study, and putting stock in many single-year studies. (Realistically I'm using both plus everything in between, but I digress.) It's analogous to flipping a coin:

If I flip a coin X times, what are the odds that it will be heads more than X/2 times? Far more comfortable than anyone would be comfortable with in order to say "The coin is weighted!" no matter how big the sample size is.

If I flip a coin X times though, and I repeatedly gets heads each time, things look different, right? If I do it 10 times with an unweighted coin, the odds of doing that are less than 1 in 1000. It would hence be absurd to bet tails on the next toss until you had done some serious checking on the coin to make sure you're getting a fair toss.

Now, that's an extreme example. In reality with this data we're talking about some degree of edge in the multi-year study, and some fraction of the single-year studies going a certain way. I'm not going to claim that we've actually hit some threshold were we've achieved actual proof, but I'm starting to see stuff that adds up.

If we take away the final 3 years in Minnesota, Garnett has the edge in 10 of 11 years and has what looks to me like a major edge rather than just a slight one.

What about those 3 years? 2 things:

1) When things go bad, they go bad. Much of what people have been so reluctant to agree to relating to Garnett is the notion that THIS could happen to basically any star. If that's the thing people want to debate, we can, but once you agree to that, it makes very little sense to let these 3 years sway your opinion.

2) As blabla mentioned, there's an issue with RAPM especially in a one-year NPI study. It tends to round toward the mean. With Garnett in those years, we're actually STILL talking about a guy typically having huge impact based on pure APM, so the RAPM numbers for that people are probably unfair to him anyway.
Getting ready for the RealGM 100 on the PC Board

Come join the WNBA Board if you're a fan!
drza
Analyst
Posts: 3,518
And1: 1,852
Joined: May 22, 2001

Re: Stat guys Duncan vs Garnett (bear with me) 

Post#31 » by drza » Tue Apr 22, 2014 1:56 am

Doctor MJ wrote:In the end, I think the data nails Duncan pretty well. I actually think it's the Garnett side of things that's more questionable. Garnett is seen as a much more impactful offensive player than Duncan by these numbers - to the point that that is probably the thing that tips the scale for me - but Garnett also has a (fair or unfair) reputation as someone whose role as offensive focus is more vulnearable to playoff defense than your average offensive star. If that reputation holds true, then RAPM may indeed overrate Garnett's actual playoff value.


This relates to something I've been trying to wrap my mind around...what to do with the playoff on/off +/- stats? I know that playoff +/- is normally not given a lot of weight because with it being un-adjusted there's the obvious potential for the kind of team-based colinearity issue that gave rise to the need for APM and eventually RAPM in the first place. Plus, because playoff runs are so much shorter than a season (and really we want more than a season for clarity) there are small sample size issues. And peak level superstars don't spend much time on the bench, leaving potentially tiny "off" values in any given year. I get that.

But there is too much sniff test success for even single-year postseason results (given some minimum length...say at least a conference finals) for it to just be ignored even on a yearly basis. For Duncan to have max on/off results for his career in the 2003 playoffs...and to have the best score of any conference finalist in 2003. For wade to have the same story for 2006. And Dirk the same for 2011. And LeBron for 2012 and 2007. There's too much smoke not to have some fire. And Elgee had an informative post with a more in depth view a year or two ago that showed that the pattern of usefulness for postseason +/- over multiple years extends beyond the cursory examination.

All of the greats that I've looked at have positive career postseason on/off marks (since 2001)...Shaq at +8.6...LeBron at +7.7 (+12.3 over 5 Cavs runs)...Kobe at +8.3. Duncan is among the best career marks among the super greats at +10.0, which makes sense with his rep for stepping up in the postseason.

Then you've got Garnett on an absolute island at +18.6 on/off in 4 postseasons in Minny and +18.2 in 5 postseasons in Boston for a career mark of +18.3. It's another instance where the numbers absolutely back arguments that I was making well before these stats were ever conceived of, let alone calculated.

KG isn't considered among the great postseason performers of his time because his scoring efficiency dips in the postseason. But I've written a bunch about some of the potential causes for that, and how I think scoring efficiency might be becoming a bit overrated in blanket individual analysis. But even if the numbers didn't so thoroughly support my case, I would be hard-pressed to ignore the massive postseason +/- numbers KG has put up in the last 13 years.

But what do the numbers actually mean? How do I quantify or assign relative value based on them? So far I've only ever really used them as sanity checks for more in depth cases that I might be making. Is that the best use for them? As I said, I'm still wrapping my mind around it.

So in the vein of me talking to a group of people whose knowledge I respect, "this is where I'm at right now with this (postseason on/off +/-) stuff" right now
Creator of the Hoops Lab: tinyurl.com/mpo2brj
Contributor to NylonCalculusDOTcom
Contributor to TYTSports: https://www.youtube.com/playlist?list=PLTbFEVCpx9shKEsZl7FcRHzpGO1dPoimk
Follow on Twitter: @ProfessorDrz
ElGee
Assistant Coach
Posts: 4,041
And1: 1,202
Joined: Mar 08, 2010
Contact:

Re: Stat guys Duncan vs Garnett (bear with me) 

Post#32 » by ElGee » Tue Apr 22, 2014 4:01 am

This is the best discussion I've read in a while. Thanks to those involved for thoroughly roping me in. I tried to AND1 Chicago 76's post repeatedly but apparently it just toggles on and off. LAME.

I use RAPM, like all stats, to help answer questions. Those questions are part of a bigger context that has dynamic variables I'm weighing against it. Here's how I see the so-called +/- family:

I may want to know how the difference between KG's team without him and TD's without him. This is almost an impossible question to answer, however, because coaches don't run science experiments. This is, incidentally, why I like in/out or with/without data -- once the sample size becomes sufficient, it paints an offline nice picture of the big picture. The method is a black box -- it ignores context and intricacies, so you have to be careful to adjust for injuries or schedule weirdnesses -- but you can't hide a player over full game patterns. You can't cheat lineups. (No colinearity.) That's a valuable ballpark tool to drive at team-specific value. If we have good samples on multiple teams, out confidence goes up.

On/Off is nice when that's not available. On/Off answers "dumber" questions, like "when that dude's on the bench, how does his team do?" On/Off is the stat you pull to categorically answer questions about scoreboard difference, even in a single game, when a player's "winningness" is challenged. I like on/off, probably mores for the on and the off than the difference. I like lineup data even better than on/off, but that's because team context is so important when analyzing individual impact. That is to say, even if I know the perfect impact of a player (e.g. Nash lifts Phoenix offense by 7 pts/100, consistently, every game ever) it still only tells me their impact within that team setting. Again, that's why I'm more interested in how they fit with different players. The +/- stats are doing the counting there that my brain can't do.

So naturally, the next level is to adjust for the opponents and the teammates and the coaches and the away games and so on. But our brains can't do this, so we ask a machine to take a "best guess" (see: Chicago 76's note about a linear solution). This linear solution has some problems, but it's a nice best guess. I wouldn't call it a "great" best guess, but it answers the question "what's the most likely scenario based on what happened with the scoreboard?" using a relatively basic algorithm. (I won't get into machine learning, but I think Star Trek's Data could predict games more accurately than any current RAPM model.)

So there's a theme to these stats: They are probabilistic and they are attached to the team-context. Again, this is why I like lineups, because if it reveals a diversity of teammates and styles, I think that says from very good things about portability. If a player constantly pops up in high-performing offensive or defensive combinations, it says something good about their ability to fit into elite offenses or defenses.

So before I comment on KG and TD specifically, I think you'd need something screaming at you in a stat like RAPM or APM to warrant Doc MJ's conundrum. I'm not sure I immediately see that. I can make the case this family stats paints KG as the best player of his generation, sure. But isn't he in a group with Shaq and LeBron (perhaps others)? Doc, what specifically has your ears up? On your standard deviations spreadsheet, I see Shaq with a pretty strong lead over TD and KG until 2003, when KG takes the lead. KG's 2004 is epic. Duncan gets him back pretty good until the end of his prime (07). KG's prime didn't end until Utah, in 2009, and he falls behind LeBron in 2009.
Check out and discuss my book, now on Kindle! http://www.backpicks.com/thinking-basketball/
ElGee
Assistant Coach
Posts: 4,041
And1: 1,202
Joined: Mar 08, 2010
Contact:

Re: Stat guys Duncan vs Garnett (bear with me) 

Post#33 » by ElGee » Tue Apr 22, 2014 4:28 am

Now, if the question is whether it's possible that KG was the best player of the generation, I think the answer is yes. He and Hakeem are two players that really stand out to me historically as guys that I may have underrated because of their circumstance. Losing Bias is a real thing. Groupthink is real...ask yourself, if KG and Hakeem truly were GOAT-level players, would you notice given their situations? If Kareem played his whole career under 76-79 circumstances, would people consider him a GOAT candidate? Or just a sulking, lazy defender who was a malcontent and couldn't win the big one?
Check out and discuss my book, now on Kindle! http://www.backpicks.com/thinking-basketball/
colts18
Head Coach
Posts: 7,429
And1: 3,237
Joined: Jun 29, 2009

Re: Stat guys Duncan vs Garnett (bear with me) 

Post#34 » by colts18 » Tue Apr 22, 2014 2:44 pm

drza wrote:
But there is too much sniff test success for even single-year postseason results (given some minimum length...say at least a conference finals) for it to just be ignored even on a yearly basis. For Duncan to have max on/off results for his career in the 2003 playoffs...and to have the best score of any conference finalist in 2003. For wade to have the same story for 2006. And Dirk the same for 2011. And LeBron for 2012 and 2007. There's too much smoke not to have some fire. And Elgee had an informative post with a more in depth view a year or two ago that showed that the pattern of usefulness for postseason +/- over multiple years extends beyond the cursory examination.
Single season postseason on/off literally has very little meaning. Tell me if you think these on/off results make sense:

Shaq 2001: -0.3
LeBron 2011: -14.7
LeBron 2013: +0.2
Duncan 2005: -5.3
Duncan 2013: -4.9
Dwight 2009: -12.7

All of them were the star players of Finals teams. 1 year of postseason data is basically worthless
drza
Analyst
Posts: 3,518
And1: 1,852
Joined: May 22, 2001

Re: Stat guys Duncan vs Garnett (bear with me) 

Post#35 » by drza » Tue Apr 22, 2014 4:15 pm

colts18 wrote:
drza wrote:
But there is too much sniff test success for even single-year postseason results (given some minimum length...say at least a conference finals) for it to just be ignored even on a yearly basis. For Duncan to have max on/off results for his career in the 2003 playoffs...and to have the best score of any conference finalist in 2003. For wade to have the same story for 2006. And Dirk the same for 2011. And LeBron for 2012 and 2007. There's too much smoke not to have some fire. And Elgee had an informative post with a more in depth view a year or two ago that showed that the pattern of usefulness for postseason +/- over multiple years extends beyond the cursory examination.
Single season postseason on/off literally has very little meaning. Tell me if you think these on/off results make sense:

Shaq 2001: -0.3
LeBron 2011: -14.7
LeBron 2013: +0.2
Duncan 2005: -5.3
Duncan 2013: -4.9
Dwight 2009: -12.7

All of them were the star players of Finals teams. 1 year of postseason data is basically worthless


Potentially yes. That's some of what I referred to earlier about working out what it's telling me. Some of my observations so far...

1. Positive values seem to have more meaning than negative. For example, a big positive value might indicate that a given player is driving the scoring differential, while values from neutral to negative might indicate more that someone(s) else is driving the margin than an indication that the neutral/negative player is playing poorly

2. I look for positive peaks within a given team. For example, a few years ago the entire Pacers starting lineup had a huge positive value, suggesting more that the unit itself was effective than that any one player was driving things. But for Wade in 06, for example, his +/- was way higher than his teammates which suggests that he was the primary driver of the positive.

For the examples you listed, I would be interested in who showed up as the high values. For example, in 2001 postseason Shaq was +/- neutral while Kobe had one of the best marks of his career at +14.2. Every Kobe fan has been had the 2001 postseason on a pedestal for years, saying that he was the main force behind them demolishing the Spurs in the de facto championship series that year. Maybe this could be a bit of evidence that in that particular run, perhaps Kobe deserves some of that credit (while in 2002 and 2004 it was Shaq dominating the postseason +/- for the Lakers).

Similar example with Duncan of 2005, where Ginobili crushed the postseason +/- in a year that is routinely characterized as one where Ginobili was brilliant.

Then on some teams there aren't individual driving forces in the postseason. On the 2010 Celtics, for instance, pretty much all of the starters had postseason +/- scores either just above or just below zero. I think the 2013 Spurs (which Chicago76 has already done a good job showing that they are an ensemble and not star-driven) and the 2009 Magic (which may have been as much about the unique shooters and Van Gundy defense as Howard's individual contributions) might fit into that category as well.

Finally, there are the issues that I detailed in my previous post that indicate that this is potentially very noisy. 2013 LeBron had an on-court +/- of +7.3 and he played 42 minutes per game so his off-court time wasn't huge. I don't find it damning to LeBron that the team didn't fall off a cliff when he left the floor. Maybe the team was solid enough to survive without him for short stretches, and the small sample could even be skewed by runs. Maybe get some added perspective by looking at the surrounding years on the same team, and seeing what else might pop out at you...for example, the Heat with LeBron off were awful in 2012 when Bosh missed a large chunk but tended to be positive in the other 2 years...maybe that is worth exploring further.

The point is, under the noise, there is some potentially useful data. Perhaps that's why the outlier positive results like the examples I laid out seem to correlate more with the sniff test: that outlier positives are the only ones that can separate from that noise floor. If you're looking for counter-examples to test the rule, more interesting to me would be a list of big-minute outlier positives among players that weren't seen as the dominant force on a team. I think a list of those could generate interesting conversation, though my feeling is that there won't be terribly many of those examples to be found
Creator of the Hoops Lab: tinyurl.com/mpo2brj
Contributor to NylonCalculusDOTcom
Contributor to TYTSports: https://www.youtube.com/playlist?list=PLTbFEVCpx9shKEsZl7FcRHzpGO1dPoimk
Follow on Twitter: @ProfessorDrz
Doctor MJ
Senior Mod
Senior Mod
Posts: 50,791
And1: 19,485
Joined: Mar 10, 2005
Location: Cali
     

Re: Stat guys Duncan vs Garnett (bear with me) 

Post#36 » by Doctor MJ » Tue Apr 22, 2014 4:50 pm

sp6r=underrated wrote:I have another philosophical point for people who have a strong belief in the value of RAPM. RAPM is considered part of the plus/minus family. Plus/minus stats are really individual point differentials. RAPM, APM and other similar stats are attempt to adjust for external factors and arrive at true individual point differential.

If you really have a strong belief in the value of RAPM and APM I don't know how you cannot heavily rank teams by point differential. Say what you will about a stat such as SRS there is far less adjustments involved in calculating a team's true point differential than there is for an individual's true point differential.

In short, I think if you have a strong believe in individual point differential it is only logical to have an extremely strong belief in the validity of team point differential as the basis for ranking teams. This calls for heavy revisionism as much as RAPM.


I don't know if I really see this as something that will cause heavy revisionism for many people. I'd imagine most people using advanced +/- stats are already pretty well versed in SRS. You're right though it wouldn't make sense to believe in +/- stats and scoff at SRS though.

What I will say though in terms of relative validities is that I talk about +/- in terms of validity in the sense that I see no systematic biases based on player type the way I do with the box score or the eyeball. However I do understand that players may coast based on circumstances which makes their particular +/- data a less accurate estimation of their impact. To the extent then that one feels a particular team's rest for the playoffs gets in the way of SRS, W/L, etc, I understand people having preferences and skepticisms.
Getting ready for the RealGM 100 on the PC Board

Come join the WNBA Board if you're a fan!
Doctor MJ
Senior Mod
Senior Mod
Posts: 50,791
And1: 19,485
Joined: Mar 10, 2005
Location: Cali
     

Re: Stat guys Duncan vs Garnett (bear with me) 

Post#37 » by Doctor MJ » Tue Apr 22, 2014 5:17 pm

ElGee wrote:So before I comment on KG and TD specifically, I think you'd need something screaming at you in a stat like RAPM or APM to warrant Doc MJ's conundrum. I'm not sure I immediately see that. I can make the case this family stats paints KG as the best player of his generation, sure. But isn't he in a group with Shaq and LeBron (perhaps others)? Doc, what specifically has your ears up? On your standard deviations spreadsheet, I see Shaq with a pretty strong lead over TD and KG until 2003, when KG takes the lead. KG's 2004 is epic. Duncan gets him back pretty good until the end of his prime (07). KG's prime didn't end until Utah, in 2009, and he falls behind LeBron in 2009.


So if I take the average of the 5 best years for each player - and I'll be using the adjusted scaling here rather than the normalized one - this is what it looks like:

Code: Select all

Player              Points
1. Kevin Garnett    10.87
2. LeBron James     10.47
3. Shaquille O'Neal 10.35
4. Tim Duncan        9.25
5. Dirk Nowitzki     9.13
6. Manu Ginobili     9.04
7. Dwyane Wade       8.38
8. Steve Nash        7.91
9. Rasheed Wallace   7.57
10. Kobe Bryant      7.52


I look at that and I see a tier gap between the top 3 and the next group. (Also, Sheed, huh). Garnett's at the top of that first tier, and Duncan's in the second tier (albeit at the top of it). That to me seems substantial. Does it not to you?

Now, relating to LeBron & Shaq, that to me is not a big deal really. Garnett will probably rank ahead of either on my next list, but not because I have confidence in a superior peak for Garnett based on this or anything else, it's the longevity that gives him the edge over those guys.

Two last notes:
1. For those unclear. The "adjusted" scaling here uses the assumption that an APM study with big sample size (Ilardi's 6 year) has a standard deviation that represents actual scoreboard points as well as possible, and applies that scaling to the standard deviation normalized RAPM data I made from other years.

2. When I take the "adjusted" scaling and then multiply it by the fraction of minutes the players actually play (which is not what I did here), to me it looks like a pretty decent estimate of actual, practical impact.
Getting ready for the RealGM 100 on the PC Board

Come join the WNBA Board if you're a fan!
ElGee
Assistant Coach
Posts: 4,041
And1: 1,202
Joined: Mar 08, 2010
Contact:

Re: Stat guys Duncan vs Garnett (bear with me) 

Post#38 » by ElGee » Tue Apr 22, 2014 8:57 pm

Doctor MJ wrote:
ElGee wrote:So before I comment on KG and TD specifically, I think you'd need something screaming at you in a stat like RAPM or APM to warrant Doc MJ's conundrum. I'm not sure I immediately see that. I can make the case this family stats paints KG as the best player of his generation, sure. But isn't he in a group with Shaq and LeBron (perhaps others)? Doc, what specifically has your ears up? On your standard deviations spreadsheet, I see Shaq with a pretty strong lead over TD and KG until 2003, when KG takes the lead. KG's 2004 is epic. Duncan gets him back pretty good until the end of his prime (07). KG's prime didn't end until Utah, in 2009, and he falls behind LeBron in 2009.


So if I take the average of the 5 best years for each player - and I'll be using the adjusted scaling here rather than the normalized one - this is what it looks like:

Code: Select all

Player              Points
1. Kevin Garnett    10.87
2. LeBron James     10.47
3. Shaquille O'Neal 10.35
4. Tim Duncan        9.25
5. Dirk Nowitzki     9.13
6. Manu Ginobili     9.04
7. Dwyane Wade       8.38
8. Steve Nash        7.91
9. Rasheed Wallace   7.57
10. Kobe Bryant      7.52


I look at that and I see a tier gap between the top 3 and the next group. (Also, Sheed, huh). Garnett's at the top of that first tier, and Duncan's in the second tier (albeit at the top of it). That to me seems substantial. Does it not to you?

Now, relating to LeBron & Shaq, that to me is not a big deal really. Garnett will probably rank ahead of either on my next list, but not because I have confidence in a superior peak for Garnett based on this or anything else, it's the longevity that gives him the edge over those guys.


It does not look substantial to me. I think you are giving the metric too much precision.

I see different tiers -- I would put those 6 guys between 9-11 on the same tier bc of the (lack of) precision of the stat. When you dive into the error in the statistic, the variance in basketball...less than 2 points is pretty much looking like the same "tier" to me. The numbers are per 100 possessions, correct? If we incorporate the possessions per game of a player, the difference is even narrower: At 75 possessions played in a game, the difference between KG and TD is ~1.3 ppt according to the above. I don't believe the RAPM algorithm is precise enough to call those different tiers...

BTW, I'm not trying to talk you off the ledge. I think it's a viable thing to bump Garnett up -- my own work on portability and team strengths, along with the work of drza in particular makes me question Garnett's placement, among a few other guys (again, notably Hakeem). Allow me to rant on this for a second:

Defensive anchor bigs are the bees-knees. Especially ones that combine great man D with team D/rim protection. KG's the best PnR defender I've ever seen. Ever. He's basically a two and three-man game genius. Hakeem -- amazing rim protector. (We can throw Robinson in this group too.)

Now, Duncan and Shaq are the other all-time level bigs from this generation. Those two guys played in great situations. I think we gloss over this because we are so focused on the winning component, but look at how this changes what we see functionally, looking at KG and TD only from this group:

On defense, Duncan was paired with another rim protector (often). This was a strategy Pop liked so much, he played Duncan at SF to try three 7-footers his rookie season. (Forgot that one, didn't you?) He also snagged up Bruce Bowen, changing the roaming responsibilities TD had, especially shading PnR. This matters because I would argues TD's (only?) defensive weakness is his lateral quickness.

On offense, the Spurs were lacking for a bit. Even early on though, they had shooters, some slashing/self-creation (Elliot) and a high-low threat to complement Duncan with Robinson. How often did the Knicks play TD in single-coverage in the 99 Finals because of all this? So it's not a great offensive situation, but it kind of is in terms of our perception of Tim Duncan! If he's on a more balanced offense, he probably has fewer touches. He can't really play the mid-post or PnP game super well, and he's not a great PnR player. So he probably is a maximum value add in exactly the type of roster SAS had. (And yes, they built the roster around him, but that's a testament to their FO and late-draft selections.)

Garnett, OTOH, played in what I would argue is the worse situation for him functionally. For box score lovers, it was great -- he got to average 20-10-5 and over 55% TS twice, one of 6 players in NBA history to achieve the feat (Kareem, Bird, Wilt, Barkley, Oscar). But he was asked to use a tremendous amount of energy on offense. And often asked to just shoulder the old Jordan, iso-scoring game to carry his team. (He came along at a time when this style of player was very popular, although at list Flip Saunders alleviated that with some creative offensive sets.) Duncan was better than him at this game, and as a result often looked better. And that demand taxed out his defensive impact.

But an ideal situation for him, IMO, is one where he can max out defensively, and on offense play more like 77 Walton. Lots of high post action -- the guy was an incredible mid-range shooter -- lots of PnP, and this takes advantage of his ridiculous passing. Then he can work in the post on good mismatches presented off the picking action. This is a lot closer to his Boston setup, and the results were fantastic, bordering on astonishing. 04 Minny was like halfway to this, and the results were big-time there too. If he played from 2002-2009 in that kind of comparable setup to what Duncan had, reeled off 8 consecutive 7-10 SRS seasons as a team (even better?), won 3-4 titles (or more?), probably picked up 2-3 MVPs, drew a bunch of "Russell with scoring" narratives...I mean, you tell me what you'd think?
Check out and discuss my book, now on Kindle! http://www.backpicks.com/thinking-basketball/
Doctor MJ
Senior Mod
Senior Mod
Posts: 50,791
And1: 19,485
Joined: Mar 10, 2005
Location: Cali
     

Re: Stat guys Duncan vs Garnett (bear with me) 

Post#39 » by Doctor MJ » Tue Apr 22, 2014 10:02 pm

ElGee wrote:It does not look substantial to me. I think you are giving the metric too much precision.

I see different tiers -- I would put those 6 guys between 9-11 on the same tier bc of the (lack of) precision of the stat. When you dive into the error in the statistic, the variance in basketball...less than 2 points is pretty much looking like the same "tier" to me. The numbers are per 100 possessions, correct? If we incorporate the possessions per game of a player, the difference is even narrower: At 75 possessions played in a game, the difference between KG and TD is ~1.3 ppt according to the above. I don't believe the RAPM algorithm is precise enough to call those different tiers...


See, I don't think it makes sense to latch on to standard basketball levels of granularity to identify what a substantial difference is here. Forget about RAPM and thoughts on expectations of its precision for a second, if we're seeing results being replicated within a given range, the moment it stops seeming to be luck as the most likely reason for the difference is the moment it becomes substantial to me.

Here's what the comparison between Duncan & Garnett looks like if we break it down comparing best vs best years, 2nd vs 2nd, 3rd vs 3rd, etc:

1st Best: +1.26 Garnett
2nd Best: +2.38 Garnett
3rd Best: +1.59 Garnett
4th Best: +1.46 Garnett
5th Best: +1.38 Garnett
6th Best: +1.35 Garnett
7th Best: +1.59 Garnett

It's really hard for me to look at that as luck.

And of course some might literally think <2 points doesn't matter, but we know different because of analysis such your SRS based championship odds. The 1.5-ish gap we see here if it were the difference between a +6 and a +7.5 SRS would make the second team roughly 50% more likely to win a title.

ElGee wrote:BTW, I'm not trying to talk you off the ledge. I think it's a viable thing to bump Garnett up -- my own work on portability and team strengths, along with the work of drza in particular makes me question Garnett's placement, among a few other guys (again, notably Hakeem). Allow me to rant on this for a second:

Defensive anchor bigs are the bees-knees. Especially ones that combine great man D with team D/rim protection. KG's the best PnR defender I've ever seen. Ever. He's basically a two and three-man game genius. Hakeem -- amazing rim protector. (We can throw Robinson in this group too.)

Now, Duncan and Shaq are the other all-time level bigs from this generation. Those two guys played in great situations. I think we gloss over this because we are so focused on the winning component, but look at how this changes what we see functionally, looking at KG and TD only from this group:

On defense, Duncan was paired with another rim protector (often). This was a strategy Pop liked so much, he played Duncan at SF to try three 7-footers his rookie season. (Forgot that one, didn't you?) He also snagged up Bruce Bowen, changing the roaming responsibilities TD had, especially shading PnR. This matters because I would argues TD's (only?) defensive weakness is his lateral quickness.

On offense, the Spurs were lacking for a bit. Even early on though, they had shooters, some slashing/self-creation (Elliot) and a high-low threat to complement Duncan with Robinson. How often did the Knicks play TD in single-coverage in the 99 Finals because of all this? So it's not a great offensive situation, but it kind of is in terms of our perception of Tim Duncan! If he's on a more balanced offense, he probably has fewer touches. He can't really play the mid-post or PnP game super well, and he's not a great PnR player. So he probably is a maximum value add in exactly the type of roster SAS had. (And yes, they built the roster around him, but that's a testament to their FO and late-draft selections.)

Garnett, OTOH, played in what I would argue is the worse situation for him functionally. For box score lovers, it was great -- he got to average 20-10-5 and over 55% TS twice, one of 6 players in NBA history to achieve the feat (Kareem, Bird, Wilt, Barkley, Oscar). But he was asked to use a tremendous amount of energy on offense. And often asked to just shoulder the old Jordan, iso-scoring game to carry his team. (He came along at a time when this style of player was very popular, although at list Flip Saunders alleviated that with some creative offensive sets.) Duncan was better than him at this game, and as a result often looked better. And that demand taxed out his defensive impact.

But an ideal situation for him, IMO, is one where he can max out defensively, and on offense play more like 77 Walton. Lots of high post action -- the guy was an incredible mid-range shooter -- lots of PnP, and this takes advantage of his ridiculous passing. Then he can work in the post on good mismatches presented off the picking action. This is a lot closer to his Boston setup, and the results were fantastic, bordering on astonishing. 04 Minny was like halfway to this, and the results were big-time there too. If he played from 2002-2009 in that kind of comparable setup to what Duncan had, reeled off 8 consecutive 7-10 SRS seasons as a team (even better?), won 3-4 titles (or more?), probably picked up 2-3 MVPs, drew a bunch of "Russell with scoring" narratives...I mean, you tell me what you'd think?


Great analysis here just as I'd expect. Doesn't mean Garnett must be the more valuable piece, but it's vainglory to presume that a man and eyeballs can say definitively that he's the less valuable piece.
Getting ready for the RealGM 100 on the PC Board

Come join the WNBA Board if you're a fan!
colts18
Head Coach
Posts: 7,429
And1: 3,237
Joined: Jun 29, 2009

Re: Stat guys Duncan vs Garnett (bear with me) 

Post#40 » by colts18 » Tue Apr 22, 2014 10:25 pm

Doctor MJ wrote:
See, I don't think it makes sense to latch on to standard basketball levels of granularity to identify what a substantial difference is here. Forget about RAPM and thoughts on expectations of its precision for a second, if we're seeing results being replicated within a given range, the moment it stops seeming to be luck as the most likely reason for the difference is the moment it becomes substantial to me.

Here's what the comparison between Duncan & Garnett looks like if we break it down comparing best vs best years, 2nd vs 2nd, 3rd vs 3rd, etc:

1st Best: +1.26 Garnett
2nd Best: +2.38 Garnett
3rd Best: +1.59 Garnett
4th Best: +1.46 Garnett
5th Best: +1.38 Garnett
6th Best: +1.35 Garnett
7th Best: +1.59 Garnett

It's really hard for me to look at that as luck.

And of course some might literally think <2 points doesn't matter, but we know different because of analysis such your SRS based championship odds. The 1.5-ish gap we see here if it were the difference between a +6 and a +7.5 SRS would make the second team roughly 50% more likely to win a title.

Every year from 1998-2007, Tim Duncan beat Garnett in NPI RAPM. Not sure how KG can have a huge lead if thats the case.

Return to Statistical Analysis