colts18 wrote:Since when is APM, RAPM the end all be all for statistical analysis? The error levels and sample sizes problems are so huge that you have to take the data with a grain of salt or else you start believing crazy stuff like Nick Collison being more valuable than Durant, Kobe, LeBron, Wade, Howard. At least with stats like PER, you never got a discrepancy like that. Those guys will rise to the top. Sure you might get a guy like Ginobili who looks good by PER and might be ahead of a Kobe, but you never get the Nick Collison.
By RAPM, Garnett has been a top 5 in every season from 08-11 including 3 top 3 finishes. RAPM said that Garnett and Ginobili have had the most impact in the past 4 years. Do you really believe a stat that says that past his prime Garnett is a top 3 player in the NBA ahead of CP3, Kobe, Dwight, Durant, etc.?
I'm totally with about the "grain of salt", but the question then is exactly what that entails. For me it's about about figuring out how much noise you think is involved, and behaving with confidence accordingly. For other people it's clearly about throwing the stat out altogether when it gives them results they don't like. Obviously, I don't think those people are being reasonable.
This is a list of the top big minute defenders by 3 different many-year APM samples across different periods.
http://asubstituteforwar.com/2011/04/23 ... o-garnett/Look at how close the rest of the top 10 is, and far away Garnett is. My "grain of salt" is certainly big enough that I'm not going to use it to say the #5 guy did clearly better than the #6 guy, but it's not big enough to dismiss the lead Garnett has.
Understand also how I apply this knowledge: The situation is that Garnett has disappointing team success. We all know that that can happen due to a very weak supporting cast situation. Were that the case, what data would we expect to see? That the team actually did okay when Garnett played, but that the team fell apart without him. And of course this is exactly what happened.
So now we have a player that won the MVP, had his star fall due to weak team success that seems entirely explainable, and then spearheads the single greatest team turnaround in NBA history. What's the simplest explanation? That he really was the player people thought he was win he won the MVP, and that he then faced some remarkably bad luck.
Now, I realize the thread is technically talking about whether he's a defensive anchor, not whether he was a worthy MVP-level player, but to me the questioning of both largely revolves around the same issue.
Re: Collison. This is a good thing to talk about. Do I consider him a secret superstar? No I don't. +/- is not the be all end all. On what basis do seemingly accept +/- for other but not Collison? Well a few things:
1) Again, I don't rank guys strictly by +/-. I defend Garnett so fiercely because the +/- answers the one blot on his resume, but he's obviously got plenty of other stuff to go with it.
2) One issue with +/- is with using it to judge guys who are platooned. Understand, if I have a player who can really help the team in a certain situation, but is too limited to be used in others, then he ends up having his +/- distorted. Stars are out there in the best of times and the worst of times and thus are given a much more "honest" assessment by +/- in terms of their actual capabilities. So I look at someone like Collison and think he's a great role player, and question whether he should play more, but by no means would I try to build a team around him.
3) Note that with players like Ginobili and older Garnett you can ask similar questions. I'd be inclined to say they really are having huge impact when they play, but the fact that they play less limits their overall impact, and distorts things in the sense that if they were asked to play bigger minutes their lack of stamina would lower their quality of play.
4) I'm glad to have Engelmann's numbers here, but I'm also a little wary of them too when they show things I don't see elsewhere. Collison didn't appear super-high on the leader boards of previous multi-year samples (unlike Ginobili and Garnett), so I've an additional sense of caution with trusting Collison's placement than I do with other players.
5) And this also relates to the fact that we've never really seen role players consistently stay up on the +/- leaderboards unless you count Ginobili as a role player (which I don't). I look at someone like Shane Battier who probably exemplifies the modern role player and unlike Collison has typically been a big minute guy. Long term +/- studies tend to rank him as having an impact as a Top 40 player, which is quite good when you think about it. Good enough that it's easy to imagine him having a better career impact than the Randolphs and Arenases of the world but not good enough that you'd think that secret superstars really exist among role players. (Also worth noting that by career Win Shares, a box score based stat, Battier ranks 4th among his 2001 draftmates above such guys.)