PER or RAPM?

Moderator: Doctor MJ

dice
RealGM
Posts: 43,006
And1: 12,544
Joined: Jun 30, 2003
Location: chicago

PER or RAPM? 

Post#1 » by dice » Mon Jul 1, 2013 11:22 pm

the donald, always unpopular, did worse in EVERY state in 2020. and by a greater margin in red states! 50 independently-run elections, none of them rigged
islamovic
Banned User
Posts: 99
And1: 6
Joined: May 07, 2013

Re: PER or RAPM? 

Post#2 » by islamovic » Tue Jul 2, 2013 8:18 am

neither

espn rating or efficency on nba.com is much better
dice
RealGM
Posts: 43,006
And1: 12,544
Joined: Jun 30, 2003
Location: chicago

Re: PER or RAPM? 

Post#3 » by dice » Tue Jul 2, 2013 2:44 pm

islamovic wrote:neither

espn rating or efficency on nba.com is much better

do either account for defense?
the donald, always unpopular, did worse in EVERY state in 2020. and by a greater margin in red states! 50 independently-run elections, none of them rigged
islamovic
Banned User
Posts: 99
And1: 6
Joined: May 07, 2013

Re: PER or RAPM? 

Post#4 » by islamovic » Wed Jul 3, 2013 6:50 am

well outside of blocks n steals there arent many d stats.

there are d rating n +/- but those are not individual stats.
tsherkin
Retired Mod
Retired Mod
Posts: 78,762
And1: 20,188
Joined: Oct 14, 2003
 

Re: PER or RAPM? 

Post#5 » by tsherkin » Sun Jul 14, 2013 3:04 pm

NBA efficiency is a more simplistic and less effective stat similar to PER, a basic Tendex type stat. PER is a bad tool for specific comparisons and only good for a loose filter, and that only when you add context. Multi-year RAPM is a little better, but still not sufficient on its own as a rankig stat.
lorak
Head Coach
Posts: 6,317
And1: 2,231
Joined: Nov 23, 2009

Re: PER or RAPM? 

Post#6 » by lorak » Mon Jul 15, 2013 9:37 am




RAPM is by far the best publicly available single metric to rank players.
Reservoirdawgs
Starter
Posts: 2,013
And1: 965
Joined: Dec 21, 2004
Location: Stuck in the middle with you.
     

Re: PER or RAPM? 

Post#7 » by Reservoirdawgs » Thu Jul 25, 2013 4:22 pm

tsherkin wrote:PER is a bad tool for specific comparisons and only good for a loose filter, and that only when you add context. Multi-year RAPM is a little better, but still not sufficient on its own as a rankig stat.


Can you explain the quote above? Why is PER a bad tool for specific comparisons, and why is RAPM not a sufficient ranking stat? If these two are insuficient, what are the best ranking stats?
So when is this plane going down? I'll ride it til' it hits the ground!
tsherkin
Retired Mod
Retired Mod
Posts: 78,762
And1: 20,188
Joined: Oct 14, 2003
 

Re: PER or RAPM? 

Post#8 » by tsherkin » Thu Jul 25, 2013 4:34 pm

PER is a terrible stat because it doesn't really include defense and it's weighting is arbitrary, leaning heavily towards volume scoring. It's also using per-minute stats, so you need to filter it on the basis of actual minutes played before you even THINK about using it, and then it still doesn't do a great job of differentiating players unless they're wildly different and one player is already clearly superior.

It doesn't offer any meaningful analysis.

There ARE no really good individual ranking stats, that was my point. You cannot reduce a player to a single number and expect that to be a sane way to approach things. It is entirely too minimalist and simplistic.
Reservoirdawgs
Starter
Posts: 2,013
And1: 965
Joined: Dec 21, 2004
Location: Stuck in the middle with you.
     

Re: PER or RAPM? 

Post#9 » by Reservoirdawgs » Thu Jul 25, 2013 6:05 pm

EDIT: Double post.
So when is this plane going down? I'll ride it til' it hits the ground!
Reservoirdawgs
Starter
Posts: 2,013
And1: 965
Joined: Dec 21, 2004
Location: Stuck in the middle with you.
     

Re: PER or RAPM? 

Post#10 » by Reservoirdawgs » Thu Jul 25, 2013 6:06 pm

tsherkin wrote:PER is a terrible stat because it doesn't really include defense and it's weighting is arbitrary, leaning heavily towards volume scoring. It's also using per-minute stats, so you need to filter it on the basis of actual minutes played before you even THINK about using it, and then it still doesn't do a great job of differentiating players unless they're wildly different and one player is already clearly superior.

It doesn't offer any meaningful analysis.

There ARE no really good individual ranking stats, that was my point. You cannot reduce a player to a single number and expect that to be a sane way to approach things. It is entirely too minimalist and simplistic.


I don't think it's that bad when comparing superstars - aka, the people who are going to be dominating the ball and playing fairly comparable minutes. I use PER along with TS%, eFG%, and ORTG and DRTG as my main measures whenever I'm comparing people. I have never found a defensive metric (other than DRTG, which has some flaws of its own) to my liking, but if you take PER and combine them with the ones I mentioned, I think it can be a meaningful tool.
So when is this plane going down? I'll ride it til' it hits the ground!
tsherkin
Retired Mod
Retired Mod
Posts: 78,762
And1: 20,188
Joined: Oct 14, 2003
 

Re: PER or RAPM? 

Post#11 » by tsherkin » Thu Jul 25, 2013 7:07 pm

Reservoirdawgs wrote:I don't think it's that bad when comparing superstars - aka, the people who are going to be dominating the ball and playing fairly comparable minutes.


Again, right off of the bat, because it senselessly deflates assists and doesn't account for defense, it's a bad comparative tool. It's a good summary of box score production, nothing else.

DRTG is a largely useless tool for specific comparison because it directly includes team DRTG, something over which a single player can exert only so much info. It's useful broadly in that lower is way better, but not so much for a direct comparison of players. PER is like that: you can determine that a player is productive, but it's too limited to be of great value unless there's already a really huge gap between players. It's not so bad for looking at younger guys and determining who is being productive in limited minutes, sure, but that's also limited in its utility.

Again, PER is functionally useless. I can look at your raw averages and tell you all of the same information PER tells you... and some that it doesn't. It's not a valuable tool.
Chicago76
Rookie
Posts: 1,134
And1: 228
Joined: Jan 08, 2006

Re: PER or RAPM? 

Post#12 » by Chicago76 » Fri Jul 26, 2013 7:58 am

tsherkin wrote:PER is a terrible stat because it doesn't really include defense and it's weighting is arbitrary, leaning heavily towards volume scoring. It's also using per-minute stats, so you need to filter it on the basis of actual minutes played before you even THINK about using it, and then it still doesn't do a great job of differentiating players unless they're wildly different and one player is already clearly superior.

It doesn't offer any meaningful analysis.

There ARE no really good individual ranking stats, that was my point. You cannot reduce a player to a single number and expect that to be a sane way to approach things. It is entirely too minimalist and simplistic.


I'm not as harsh on PER as you are, but I agree. As someone spends more and more time with advanced stats, this is a conclusion that I think most people reach. Where I do think it is somewhat useful is that it at least utilizes weighting that are intuitive with respect to the concept of production per possession. For someone who is fairly new in the use of advanced stats, it does provide a framework to understand the rough impact TOVs, TS%, rebounding rates, assist rates, etc have on efficiency and pts scored. When ued as a learning tool to promote someone's ability to mentally aggregate and place importance on more discrete forms of production, it is useful. But again, once someone's ability to understand the subcomponents of production improves, the limitations become fairly apparent.

Kind of a side issue, but somewhat relevant to the topic. The underlying advanced stats that "feed" PER are limited in their own ways too. TOV rates are a decent example. It's not really enough to say that player X has a TOV rate of 15, while player Y has a TOV rate of 11, and to conclude that player X is more TOV prone. There is a lot of variance in TOV rates across the league due to role. I've found it useful to regress other things to arrive at an expected TOV rate to compare to actual TOV rate to assess players within their roles. In order of significance:

-AST: players who are responsible for distribution have higher TOV rates.
-ORB: players who play closer to the basket on O tend to get more ORBs. They also tend to play in tighter space, so they end up turning the ball over more frequently.
-FTA: players who get to the line more often tend to have more TOVs
-two least important factors: 2FGA and 3FGA.

I find it more useful to say something like, "For a guy who gets to the line and distributes as much as he does, his TOV rate is actually pretty low" rather than, "He turns the ball 10% more than league avg."
mysticbb
Banned User
Posts: 8,205
And1: 713
Joined: May 28, 2007
Contact:
   

Re: PER or RAPM? 

Post#13 » by mysticbb » Fri Jul 26, 2013 9:30 am

tsherkin wrote:PER is a terrible stat because it doesn't really include defense and it's weighting is arbitrary, leaning heavily towards volume scoring.


The weights are not arbitrary. Hollinger explained why he picked those weights in his books, and it makes a lot of sense. You may want to look into it further, because once you try to understand what Hollinger is doing, you may actually agree that this "leaning towards volume scoring" isn't such a bad idea. For that, you may want to check how good players in average are in late shotclock situation when they have to rush a shot, compare that to the expected breakeven points in Hollinger's PER and you will be surprised how close that is. ;)
tsherkin
Retired Mod
Retired Mod
Posts: 78,762
And1: 20,188
Joined: Oct 14, 2003
 

Re: PER or RAPM? 

Post#14 » by tsherkin » Fri Jul 26, 2013 11:00 am

I read what he wrote, mystic, and I still disagree with his reasoning because it's not contextually accurate. Meantime, I also don't agree with him overvaluing volume scoring, since it's one of the least understood and least useful things in the league for the most part.
RealRapsFan
Sixth Man
Posts: 1,680
And1: 893
Joined: Nov 18, 2012

Re: PER or RAPM? 

Post#15 » by RealRapsFan » Sun Jul 28, 2013 2:20 am

PER is both the least predictive and least explanitory of the commonly available stats.

Unfortunately 'picking weightings' is not good science no matter how rational it may seem when you do it.
Optimism Bias is the tendency of individuals to underestimate the likelihood they will experience adverse events. Optimistic bias cannot be reduced, and by trying to reduce the optimistic bias the end result was generally even more optimistically biased
LobCityClips
Banned User
Posts: 1,014
And1: 104
Joined: Mar 03, 2013

Re: PER or RAPM? 

Post#16 » by LobCityClips » Sun Jul 28, 2013 11:41 pm

Is RAPM saying Blake was the 4th best impact player in the league?
User avatar
bondom34
Retired Mod
Retired Mod
Posts: 66,590
And1: 50,209
Joined: Mar 01, 2013

Re: PER or RAPM? 

Post#17 » by bondom34 » Sun Jul 28, 2013 11:53 pm

LobCityClips wrote:Is RAPM saying Blake was the 4th best impact player in the league?


Huh? Don't know where that question came from, but no, it has him 18th:
http://stats-for-the-nba.appspot.com/ratings/2013.html
MyUniBroDavis wrote: he was like YALL PEOPLE WHO DOUBT ME WILL SEE YALLS STATS ARE WRONG I HAVE THE BIG BRAIN PLAYS MUCHO NASTY BIG BRAIN BIG CHUNGUS BRAIN YOU BOYS ON UR BBALL REFERENCE NO UNDERSTANDO
User avatar
Dr Positivity
RealGM
Posts: 59,840
And1: 15,533
Joined: Apr 29, 2009
       

Re: PER or RAPM? 

Post#18 » by Dr Positivity » Thu Aug 1, 2013 3:42 pm

tsherkin wrote:
Reservoirdawgs wrote:I don't think it's that bad when comparing superstars - aka, the people who are going to be dominating the ball and playing fairly comparable minutes.


Again, right off of the bat, because it senselessly deflates assists and doesn't account for defense, it's a bad comparative tool. It's a good summary of box score production, nothing else.

DRTG is a largely useless tool for specific comparison because it directly includes team DRTG, something over which a single player can exert only so much info. It's useful broadly in that lower is way better, but not so much for a direct comparison of players. PER is like that: you can determine that a player is productive, but it's too limited to be of great value unless there's already a really huge gap between players. It's not so bad for looking at younger guys and determining who is being productive in limited minutes, sure, but that's also limited in its utility.

Again, PER is functionally useless. I can look at your raw averages and tell you all of the same information PER tells you... and some that it doesn't. It's not a valuable tool.


Is this not true of an individual's defensive impact anyways? :wink: I am not a fan of Oliver's DRTG because it includes the boxscore weighting stuff, I actually think the best version of a WS-y stat, would be to compare Oliver's ORTG with the player's on-court DRTG.

Return to Statistical Analysis