Win Shares versus Wins Produced?
Posted: Sat Apr 10, 2010 12:08 am
Obviously, neither are perfect measures (or even adequate in some cases), but which correlates better with actual player ability?
Sports is our Business
https://forums.realgm.com/boards/
https://forums.realgm.com/boards/viewtopic.php?f=344&t=1001662
Dave Berri wrote:Dr. Berri's own suggestions for possible weaknesses
1. Wins Produced does not give credit to players for creating shots. This is generally perceived as the biggest weakness. This perception is based on two beliefs. a) it is difficult to get a shot off in the NBA and b) the more you shoot the lower your efficiency. I am not sure there is much empirical evidence behind either proposition. Plus, if you give credit for taking shots then inefficient shooters will look better. Nevertheless if you believe shooting is difficult, Wins Produced will disappoint. And connected to this point…if you believe scoring is the most difficult thing a player does in the NBA, and therefore scorers are the most valuable, Wins Produced will disappoint also.
2. How vs. Why: Wins Produced tells you how productive a player is, but it does not tell you why. Performance is impacted by age, injury, roster turnover, coaching (in a few cases), and the productivity of teammates. The latter issue is the idea of diminishing returns. The more productive your teammates, the less productive you will be. This is a real effect in the NBA, although in the aggregate it is rather small. Still, these effects are not part of Wins Produced and these issues can impact what we see in the future from a particular player.
rrravenred wrote:Rebounds are a tricky beast to quantify the value of (like assists). A missed shot will generally mean a rebound for SOMEONE, and positioning on the floor means that the likely rebounder will be a defensive player. To what extent do you value the individual ability to rebound and/or prevent the opposing team from rebounding?
Personally, I feel that dictating the terms of possession is quite important, which is what rebounding is all about. More rebounds equals more possessions (and/or more/few shooting opportunities per possession, depending on how you conceptualise it). More opportunities plus better efficiency will generally equal a win, all things being equal.
The other criticism of Wins Produced is that it overly privileges low-use, high efficiency offensive players as compared to high-volume, somewhat less efficient shooters like Kobe and AI.
Unlike PER, it doens't value shot creation per-se, which it's possibly a weakness (although I don't think gunners necessarily SHOULD get a free pass).
Don't quite know how well winshares track to actual wins, but as far as I'm aware wins produced generally follow quite closely.
rrravenred wrote:EDIT: Berri's own views of its weakness are:Dave Berri wrote:Dr. Berri's own suggestions for possible weaknesses
1. Wins Produced does not give credit to players for creating shots. This is generally perceived as the biggest weakness. This perception is based on two beliefs. a) it is difficult to get a shot off in the NBA and b) the more you shoot the lower your efficiency. I am not sure there is much empirical evidence behind either proposition. Plus, if you give credit for taking shots then inefficient shooters will look better. Nevertheless if you believe shooting is difficult, Wins Produced will disappoint. And connected to this point…if you believe scoring is the most difficult thing a player does in the NBA, and therefore scorers are the most valuable, Wins Produced will disappoint also.
2. How vs. Why: Wins Produced tells you how productive a player is, but it does not tell you why. Performance is impacted by age, injury, roster turnover, coaching (in a few cases), and the productivity of teammates. The latter issue is the idea of diminishing returns. The more productive your teammates, the less productive you will be. This is a real effect in the NBA, although in the aggregate it is rather small. Still, these effects are not part of Wins Produced and these issues can impact what we see in the future from a particular player.
mysticbb wrote:@Doctor MJ
It is not that easy to give credits for assists correctly. I choosed a way to do it on a player-by-player basis on each team. That means every assists gets 1/2 of the value a team usually scores with a field goal. On the other side I subtract those points from the scorer via team ast%.
To show the effect:
PER has Amare Stoudemire with 22.6 ranked 12th right now and Steve Nash with 21.7 is 16th. My PRA (just simple player rating, nothing fancy at all) has Steve Nash at 7th with 16.7 (league average is 10) and Stoudemire with 14.8 at 17th. Comparing those things with the +/- numbers my boxscore rating seems to make a better job. Of course the rating has the same flaws, underrate individual defenders who are not producing blocked shots, steals or rebounds.
Btw: Good example with Marcus Camby. When a boxscore rating is so way off in comparison to +/- numbers, it should definitely be reviewed.
Doctor MJ wrote:Those really looking to understand the cons of Wins Produced, should check out this conversation:
http://sonicscentral.com/apbrmetrics/vi ... sc&start=0
To give the gist:
1) The heavy hitters in the community don't understand why WP is calculated like it is, and when they ask the questions they used to asking in the statistics field, Berri responds with a brush off. This isn't something where Berri's a genius and the other guys are morons. The guys he's talking with are statisticians with as much education as he has, and considerably more credibility in basketball, and they feel like they're asking basic questions and not getting reasonable answers.
Doctor MJ wrote:2) Berri indicates that WP was designed to correlate with actual wins, but others point on that you can do that with basically any stat. They are alarmed that that when you use WP to actually predict future wins, it actually does a worse job than if you go simply take a basic stat like points scored, which itself is much worse (as you'd expect) than pretty much any of the major formulas.
Doctor MJ wrote:Let's take a look at the case of Marcus Camby.
Here's how WP shows the Nuggets in Camby's last 3 years:
'06 - Camby leads the team in WP despite playing only 1800 minutes, whereas other players play more than 2900.
'07 - Camby leads the team 17.6 WP. 2nd best on the team is 5.6.
'08 - Camby leads the team 21 WP, 2nd best is 9.5.
So he's way, way, way better than everyone else right? What happens when he leaves the next year? Not only does the team get better, but it starts outrebounding opponents which it was not doing before.
Doctor MJ wrote:I understand thinking that maybe Berri's on to something with his emphasis on rebounding, but I honestly don't know how anyone can look at that and think Berri is valuing individual rebounding accurately. In the stat community there's something called "the laugh test" - if you get a result that's so obviously wrong any objective observer will laugh, then you need take gain some humility and either correct the algorithm, or explain the limitations of the algorithm. This result is frankly as embarassing as anything I've ever seen from a major stats name, and Berri is the least willing of any of the major stat guys (except Winston if you include him) to embrace humility. Yes, he shows some as in what you quoted, but on the whole he's very cocky, and even in his humility, he doesn't address the obvious problem explicitly.
Doctor MJ wrote:Re: PER favoring chuckers, that idea needs to be tempered. Here's the issue that Berri's refering to: PER (and similar stats), penalize a guy blowing a possession. A missed shot, doesn't always blow a possession, so PER penalizes it based on an estimate for how often a missed shot blows a possession. Berri points out correctly that a player's PER will keep increasing with volume even at pretty low FG% which seems like a weird way to do a stat because you could theoretically inflate your PER while doing stuff that hurts your team. Practically though this isn't much of an issue. Fans of players who score at high volume but not great efficiency are constantly trashing PER because such players don't come off as well in the stat as the fans think. The typical basketball viewer thinks more highly of Kobe than PER does for example, and up until recently, thought WAY higher of Iverson than PER did.
Doctor MJ wrote:Getting back to the estimate for how often a missed shot leads to a blown possession, I want to make sure it's clear what that means, because other than the problems with defense, the use of estimates are what I consider to be the biggest weakness in PER. If the box score actually listed what shots led blown possession, we'd have a really great idea how much a player's chucking was hurting his team. Undoubtedly, if a player started chucking worse, and defenses saw it coming, the offense would be less able to get offensive rebounds, and it would all get factored in to PER. PER doesn't use such fine grained information, it estimates. This is a weakness, but it's not something caused by weak logic. It's not something that in practice rewards chuckers, it's something that simply adds margin of error to algorithm.
Doctor MJ wrote:One last note: It's funny that Berri says it may be a flaw of his formula that it doesn't reward shot creation - because this is actually a problem with PER. PER seeks to give some of the credit for scoring to the assister - but it doesn't know whether any particular bucket was assisted, so it docks all scoring equally. This really hurts the players that are basically always creating for themselves and others (distributors - who also are the guys who are most likely to be acting as coach on the floor which is another skill PER can't evaluate). As a result, volume scorers are actually inflated by PER relative to distributors, but again, it's simply due to lack of precision. There's one clear way to solve it, and WP isn't doing it either.
Doctor MJ wrote:In terms of how to value assists, I don't really advocate anything. It's pretty clear to me that different offenses generate assists in different ways and frequencies, and they don't correlate that well with actual team effectiveness - so the answer is not to inflate assist weighting until you get something that looks good.
mysticbb wrote:.. assists seems to be a not given out in the same fashion by each scorekeeper in the league. For me assists are a somewhat subjective stat.
.
Code: Select all
Atl .875 Chi .947 Dal 1.009
Den .890 Bos .953 Okl 1.011
LAL .897 NJN .955 Mem 1.020
Det .922 Por .956 Orl 1.022
GSW .924 Min .965 Uta 1.024
LAC .926 Phl .970 Ind 1.026
Cle .932 Cha .978 Mia 1.033
NOH .935 Tor .995 NYK 1.037
Was .943 Hou .999 Phx 1.038
SAS .944 Mil 1.001 Sac 1.042
rrravenred wrote:And the additions are: Chris Andersen (post-suspension?) 6.2rpg, .242 WP48 (7.3 wins), Nene (post testicular cancer?), 7.8 rpg, .146 WP48 (7.6 wins), Chauncey Billups .171 (9.7 wins).
JR Smith that year also increased from .097 (1.9 wins) in 2007 to .165 (7.7 wins). Now there's a reasonable amount of improvement in that from the previous year independent of Marcus Camby, I would think.
Would those additions conform with the increased success and increased rebounding shown after Camby left?
rrravenred wrote:
Well, he's made attempts. Here he claims that even if you significantly devalue rebounds in Winscore (WP's little brother) the metric doesn't change markedly.
I somewhat disagree with your characterisation of the laugh test. What people laugh at is socially constructed, and the decisions we make are strongly influenced by non-rational factors ((i.e. the behvioural economics school that Berri adheres to). Are the results wrong or counter-intuitive? If they're wrong, point at some evidence that says they're wrong. Otherwise, stop laughing.
If someone were to say that an MVP 30ppg scorer was not an especially valuable player in a their MVP year (yes, we both know the player), then would people initially laugh? I don't think people laugh at that statement now (although many people disagree, passionately).
Am I saying that Berri should sail ahead, ignoring all critique? Certainly not! If he's been arrogant in asserting the predictive power of his model then he should be knocked back on his ass quick-smart.
rrravenred wrote:I'd note that WP thinks Kobe is an excellent player despite the offensive inefficiency. And any fan will bash a metric that doesn't confirm their own biases about players or teams.
rrravenred wrote:I understand that's one of the major criticisms of PER, that its values are all estimated by Hollinger. Now individually none of those estimations fail the laugh test, but if the cumulative effect raises a giggle in terms of compounding the MoE, then there's a problem.
... because Berri sets the threshold efficiency for scoring at league average, the sum of Wins Produced by scoring in the league is zero. Thats right, Berri's metric says that throughout the entire league scoring did not contribute to any wins, that all 1230 wins in the league were created acquiring possession of the ball.
Doctor MJ wrote:The way Wins Produced gives such huge weight to rebounds, I'm inclined to side with Win Shares.
Doctor MJ wrote:Let's take a look at the case of Marcus Camby.
Here's how WP shows the Nuggets in Camby's last 3 years:
'06 - Camby leads the team in WP despite playing only 1800 minutes, whereas other players play more than 2900.
'07 - Camby leads the team 17.6 WP. 2nd best on the team is 5.6.
'08 - Camby leads the team 21 WP, 2nd best is 9.5.
So he's way, way, way better than everyone else right? What happens when he leaves the next year? Not only does the team get better, but it starts outrebounding opponents which it was not doing before.
mysticbb wrote: I can actually apply such an factor to my rating and get a nearly 100% correlation towards winning.