What Are Your Personal Opinions On RAPM?

Moderators: Doctor MJ, trex_8063, penbeast0, PaulieWal, Clyde Frazier

User avatar
Joao Saraiva
RealGM
Posts: 13,452
And1: 6,218
Joined: Feb 09, 2011
   

Re: What Are Your Personal Opinions On RAPM? 

Post#21 » by Joao Saraiva » Fri Apr 24, 2015 2:54 am

mischievous wrote:
Dr Spaceman wrote:It's the best stat currently in existence.

Some people will scoff at this, but just think on this: what are we actually trying to evaluate when we look at a basketball player? Answer: How well does he help his team win? (Can be restated as: what effect does he have on the scoring margin?) The reason I hold RAPM in such high regard is because it is literally the only stat that actually attempts to answer this question. Any box score stat you can think of doesn't even try. Quite literally, RAPM is the only stat that has any validity for what people are actually looking for in a stat, even if they don't quite realize it.

There's nothing inherently wrong with using the box score, as long as you realize that it is, at best, a proxy for what you actually want to know. There can be great players who score 20+ ppg, and terrible ones who do the same. But there will never ever, by definition, be a terrible player who makes a hugely positive impact on his team.

Once I came to realize this, I became a big RAPM convert, and I live with the flaws because it's the only thing that can actually tell me what I want to know. It might miss the mark by more than the box score will, but at least the mark in this case is clear, and it's exactly what I want it to be.

So really this is the whole reliability vs. validity issue. People dislike RAPM generally because it challenges what they thought they knew. The fallacy is in thinking that you ever knew anything by looking at the box score anyway. So yeah, in small samples we have some results that are absolutely nuts. Granted. But with big samples, and enough noise correction, we zero in on exactly what we really want to know. That's beautiful, and it's something no other stat in existence can accomplish in the slightest.

Now I'll add the caveat that RAPM never thinks for me. I would never use it to rank players, or the crux of an argument, or anything of the sort. But as you guys know, I watch a ton of film, and generally find that what I see lines up with what plus/minus data shows. Obviously Manu Ginobili isn't the best player in the league, but when he comes in the Spurs play really well, and that's what RAPM tells us. Now Kevin Durant has a lower RAPM, but a much huger role and more minutes, so quite obviously he's the better player. I think sometimes people who use RAPM get pisgeonholed into using it as the be-all-end-all, and that's not what I do at all.

Final thing: RAPM is at a crossroads right now, and it's either going to head into RPM (wrong direction) or PTPM (right direction). This has everything to do with how I feel about the box score.

Basically what you're saying in all of this is, "RAPM is better than all other measures because i said so, and anyone who doesn't use RAPM is wrong or ignorant."


Dr. Spaceman never said anything like it. He told us why he likes the stat and how he uses it. That's his opinion.

If you dislike the stat, then tell us why but don't reply like that. It adds nothing to the discussion and it's desrespectful.

I personally don't use it, but that doesn't mean I can't understand someone who does.
“These guys have been criticized the last few years for not getting to where we’re going, but I’ve always said that the most important thing in sports is to keep trying. Let this be an example of what it means to say it’s never over.” - Jerry Sloan
mischievous
General Manager
Posts: 7,675
And1: 3,485
Joined: Apr 18, 2015

Re: What Are Your Personal Opinions On RAPM? 

Post#22 » by mischievous » Fri Apr 24, 2015 3:04 am

Dr Spaceman wrote:

mischievous wrote:Basically what you're saying in all of this is, "RAPM is better than all other measures because i said so, and anyone who doesn't use RAPM is wrong or ignorant."


No, that's not at all what I'm saying. I'm saying that if you're going to use statistics, RAPM is the one that has the most validity.

Well that is your opinion, it isn't a fact which was my point. It's fine if you like to use it but that doesn't give you the license to criticize those who choose not to.
User avatar
yoyoboy
RealGM
Posts: 15,866
And1: 19,077
Joined: Jan 29, 2015
     

Re: What Are Your Personal Opinions On RAPM? 

Post#23 » by yoyoboy » Fri Apr 24, 2015 3:15 am

Personally I like RPM better.
mischievous
General Manager
Posts: 7,675
And1: 3,485
Joined: Apr 18, 2015

Re: What Are Your Personal Opinions On RAPM? 

Post#24 » by mischievous » Fri Apr 24, 2015 3:19 am

Joao Saraiva wrote:
Dr. Spaceman never said anything like it. He told us why he likes the stat and how he uses it. That's his opinion.


He said it's the only stat with validity and that box scores are pretty much useless.

Joao Saraiva wrote:If you dislike the stat, then tell us why but don't reply like that.


I can't really say that i like it or dislike it, i don't mind if somebody uses it or not.

Joao Saraiva wrote: It adds nothing to the discussion and it's desrespectful.

The only thing disrespectful is his dismisal of Box scores and anything that isn't "valid" in his eyes. It's diserespect to those who use things other than RAPM.
User avatar
bondom34
Retired Mod
Retired Mod
Posts: 66,716
And1: 50,290
Joined: Mar 01, 2013

Re: What Are Your Personal Opinions On RAPM? 

Post#25 » by bondom34 » Fri Apr 24, 2015 3:26 am

Honestly I used to use it more as well (to add to my earlier post). I've more recently noticed a ton of the flaws in it that some supporters will either dismiss as noise, not address, or excuse in a way that just clouds the facts in my mind. I can look at last season's numbers and quickly see issues. To go from the top of JE's version:
I can quickly tell at a glance that the Spurs, despite their greatness, are benefiting from each other's presence. Again, I like them, but I have a hard time saying Manu, Parker, Mills, and Duncan are all in the top 25.

I'm intrigued because despite watching an entire season of Durant tearing apart people, he's viewed as effective as Blake Griffin.

Andre Iguodala is a very good defender, but not as high as he's consistently rated in RAPM.

As a whole, I struggle again with Amir Johnson being so highly rated.

These are a really quick few, but when you get into player comparisons they come up frequently enough that I really have a tough time using this stuff and feeling confident in it.
MyUniBroDavis wrote: he was like YALL PEOPLE WHO DOUBT ME WILL SEE YALLS STATS ARE WRONG I HAVE THE BIG BRAIN PLAYS MUCHO NASTY BIG BRAIN BIG CHUNGUS BRAIN YOU BOYS ON UR BBALL REFERENCE NO UNDERSTANDO
Knosh
Starter
Posts: 2,225
And1: 921
Joined: Nov 17, 2013
   

Re: What Are Your Personal Opinions On RAPM? 

Post#26 » by Knosh » Fri Apr 24, 2015 3:52 am

Dr Spaceman wrote:It's the best stat currently in existence.

Some people will scoff at this, but just think on this: what are we actually trying to evaluate when we look at a basketball player? Answer: How well does he help his team win? (Can be restated as: what effect does he have on the scoring margin?) The reason I hold RAPM in such high regard is because it is literally the only stat that actually attempts to answer this question. Any box score stat you can think of doesn't even try. Quite literally, RAPM is the only stat that has any validity for what people are actually looking for in a stat, even if they don't quite realize it.


I guess I'm one of those guys that doesn't quite realize it? Why is "helping a team win" equivalent to "effect on scoring margin"? Sure there is a strong correlation between scoring margin and win percentage, but it's not the same thing. Imo scoring margin is a crutch just like boxscore stats. The RAPM approach might very well be qualitatively better, but I don't see the fundamental difference.
User avatar
theonlyclutch
Veteran
Posts: 2,793
And1: 3,728
Joined: Mar 03, 2015
 

Re: What Are Your Personal Opinions On RAPM? 

Post#27 » by theonlyclutch » Fri Apr 24, 2015 4:34 am

It represents an important step in shifting priorities from judging players by the end result attributed to them (boxscores), rather than the process of how a player gets those end results (boxscores), which is arguably more important. Previous plus-minus statistics have hinted at this, but RAPM patches up many of the flaws of plus-minus data, and allows a more valid comparison between different players in different situations.

If we think about it, the boxscore, and the metrics based off of the boxscore, are an incredibly narrow set of criteria by which to judge a player's "goodness". A major flaw of the boxscore is that it fails to take into account the context with which the boxscore stats are accumulated, just looking through the boxscore, there really isn't much difference between Jason Kidd's best years and Rajon Rondo's best years, both have similar ORTGs, both have similar shooting efficiency, Kidd scores more and rebounds more, while Rondo has noticeably more assists, both are the main facilitators in mediocre offenses. From the boxscore alone, it would be reasonable to guage Kidd's offensive impact as similar to Rondo's, but with RAPM (and some other lineup data), we can see that Kidd was consistently a net positive on offense, while Rondo was a net neutral/negative offensive player during that time period.

An analogy for predominantly judging players by boxscore stats would be an investor judging potential investments opportunities solely by their valuation multiples, sure, many companies with low valuation multiples (good boxscore stats) may be good investments, but any investor worth their salt would look at the reasons and context behind these multiples, and similarly, it's imperative to understand the reason and context behind how a player accumulates their boxscore stats, which RAPM, as flawed as it may be, helps to do by measuring the players in terms of their contribution to scoring margin, i.e winning basketball.
theonlyclutch's AT FGA-limited team - The Malevolent Eight

PG: 2008 Chauncey Billups/ 2013 Kyle Lowry
SG: 2005 Manu Ginobili/2012 James Harden
SF: 1982 Julius Erving
PF: 2013 Matt Bonner/ 2010 Amir Johnson
C: 1977 Kareem Abdul Jabaar
magicmerl
Analyst
Posts: 3,226
And1: 831
Joined: Jul 11, 2013

Re: What Are Your Personal Opinions On RAPM? 

Post#28 » by magicmerl » Fri Apr 24, 2015 5:03 am

Is this the 'Kevin Garnett' stat?
giberish
RealGM
Posts: 17,511
And1: 7,229
Joined: Mar 30, 2006
Location: Whereever you go - there you are

Re: What Are Your Personal Opinions On RAPM? 

Post#29 » by giberish » Fri Apr 24, 2015 9:04 am

It's really difficult (if not impossible) to justify not using some kind of +/- based stat as a big part of rating players. The point of the game isn't individual counting stats, it's team success. Box-score stats are driven largely by playing time and role - so they're better at showing what role a player has then at showing how much they help their teams win.

Now, largely due to noise issues, you have to pick and choose somewhat based on the player and the length of time in question. If a player stayed relatively constant in performance and role for several years, than a long-term RAPM is the best way to go. For players who've had their roles or performance levels change significantly over a season or less, then one of the combo stats (IPV/RPM/RAPM+) make more sense as a baseline.

You also have to consider the on-court roles played. In general, effective, high usage players will be more difficult to come by (in terms of salary, trade or draft assets) and thus are more valuable in comparison with effective, low-usage players. Also, role player effectiveness can vary significantly based on the role that they're asked to play. If they're used only in just the right matchups they can look better then they really are - while if they're used poorly then can look much worse. So you still have to think a bit.
Dr Spaceman
General Manager
Posts: 8,575
And1: 11,211
Joined: Jan 16, 2013
   

Re: What Are Your Personal Opinions On RAPM? 

Post#30 » by Dr Spaceman » Fri Apr 24, 2015 11:45 am

mischievous wrote:The only thing disrespectful is his dismisal of Box scores and anything that isn't "valid" in his eyes. It's diserespect to those who use things other than RAPM.


You are reading way too far into what I said. I don't imply any value judgements when I say "valid", I'm using the dictionary definition, which literally just says that it measures what you want it to measure. The box score is "valid" if you want to know who got the most points, or who shot the best percentage. The box score is not "valid" if you want to know who is helping their team the most. This is where RAPM comes in.

I'm not criticizing anyone in the slightest, I look at the box scores myself. I just think it's important to understand the limitations of every stat- box score stats paint a very narrow picture, while RAPM covers the whole canvas but also misses way outside the lines at times. It's important to accept the flaws of any metric you're going to use in your analysis.

Incidentally, NBA.com's player tracking stats I'm really warming up to. We've got something good here.
“I’m not the fastest guy on the court, but I can dictate when the race begins.”
Dr Spaceman
General Manager
Posts: 8,575
And1: 11,211
Joined: Jan 16, 2013
   

Re: What Are Your Personal Opinions On RAPM? 

Post#31 » by Dr Spaceman » Fri Apr 24, 2015 11:52 am

bondom34 wrote:Honestly I used to use it more as well (to add to my earlier post). I've more recently noticed a ton of the flaws in it that some supporters will either dismiss as noise, not address, or excuse in a way that just clouds the facts in my mind. I can look at last season's numbers and quickly see issues. To go from the top of JE's version:
I can quickly tell at a glance that the Spurs, despite their greatness, are benefiting from each other's presence. Again, I like them, but I have a hard time saying Manu, Parker, Mills, and Duncan are all in the top 25.

I'm intrigued because despite watching an entire season of Durant tearing apart people, he's viewed as effective as Blake Griffin.

Andre Iguodala is a very good defender, but not as high as he's consistently rated in RAPM.

As a whole, I struggle again with Amir Johnson being so highly rated.

These are a really quick few, but when you get into player comparisons they come up frequently enough that I really have a tough time using this stuff and feeling confident in it.


This is an awesome post, and I'm glad you shared this perspective.

You have taken the time to understand the stat, what it measures and how it's obtained, and decided that it isn't necessarily your thing. That's cool, and you bring up some legitimate criticisms which is always good. The Amir thing is mostly just saying that he performs his role really damn well (this used to be the Nick Collison thing, both smart, heady players who defend the PNR very well and set awesome screens and box out effectively).

But anyway, the important thing here is that you've taken the time to familiarize yourself with it, rather than just looking at a list, seeing Manu Ginobili at the top, and saying "lol, nope!" which some of the most vocal critics in the past have done.
“I’m not the fastest guy on the court, but I can dictate when the race begins.”
Dr Spaceman
General Manager
Posts: 8,575
And1: 11,211
Joined: Jan 16, 2013
   

Re: What Are Your Personal Opinions On RAPM? 

Post#32 » by Dr Spaceman » Fri Apr 24, 2015 11:53 am

yoyoboy wrote:Personally I like RPM better.


You know that they're essentially the same thing, created by the same statistician, with the only difference being that RPM is informed by the box score, yes? RPM is a biased version of RAPM.
“I’m not the fastest guy on the court, but I can dictate when the race begins.”
fuzzy_dunlop
Junior
Posts: 345
And1: 109
Joined: Jan 09, 2014

Re: What Are Your Personal Opinions On RAPM? 

Post#33 » by fuzzy_dunlop » Fri Apr 24, 2015 12:08 pm

^
That's a biased way of putting it (you're welcome, I'll be here all night): RPM is built to be more stable than earlier iterations of APM stats.
User avatar
NO-KG-AI
Retired Mod
Retired Mod
Posts: 44,160
And1: 20,209
Joined: Jul 19, 2005
Location: The city of witch doctors, and good ol' pickpockets

Re: What Are Your Personal Opinions On RAPM? 

Post#34 » by NO-KG-AI » Fri Apr 24, 2015 12:13 pm

I think it's a good stat, but only really after the fact. When you have a full career worth of games, especially with tons of different lineups, tons of new teammates, new coaches, etc etc, and you are still seeing a pretty consistent pattern, it's hard to discount it.

Like we see all the Spurs having high numbers, but we've only really seen Duncan keep producing at a superstar level despite his role shifting, despite teammates coming and going, and after all these years.
Doctor MJ wrote:I don't understand why people jump in a thread and say basically, "This thing you're all talking about. I'm too ignorant to know anything about it. Lollerskates!"
Purch
Veteran
Posts: 2,820
And1: 2,144
Joined: May 25, 2009

Re: What Are Your Personal Opinions On RAPM? 

Post#35 » by Purch » Fri Apr 24, 2015 12:20 pm

Ramp was the stat that Completly killed the flow of the top 100 project
Image
fuzzy_dunlop
Junior
Posts: 345
And1: 109
Joined: Jan 09, 2014

Re: What Are Your Personal Opinions On RAPM? 

Post#36 » by fuzzy_dunlop » Fri Apr 24, 2015 12:24 pm

^
yeah I read some of those threads, it's always a drag when ramp gets in the way of a good killer instinct debate.
JeepCSC
Starter
Posts: 2,026
And1: 1,496
Joined: Jul 01, 2014

Re: What Are Your Personal Opinions On RAPM? 

Post#37 » by JeepCSC » Fri Apr 24, 2015 12:26 pm

In the future, perhaps there should be an on-ramp list and an off-ramp list so we know who is coming or going.
Reservoirdawgs
Starter
Posts: 2,013
And1: 966
Joined: Dec 21, 2004
Location: Stuck in the middle with you.
     

Re: What Are Your Personal Opinions On RAPM? 

Post#38 » by Reservoirdawgs » Fri Apr 24, 2015 12:32 pm

Purch wrote:Ramp was the stat that Completly killed the flow of the top 100 project


In what way? Bringing up RAPM opened up the discussion of basketball and led to some absolutely incredible analysis from some very smart and knowledgeable posters. They backed up their statements and made very compelling cases. The only issue was some of the anti-RAPM people turning into children by whining and complaining because they didn't understand it and openly admitted that they were more interested in their favorite players ranking then the actual discussion. I would challenge anyone to go back through the Top 15 threads and read the arguments put forward by people who know and understand RAPM and those who didn't - the quality of analysis (using quantitative and qualitative data) is like night and day.

While he got overly romantic with his description of it, I would agree with Spaceman that it is currently the best metric that we have. I am not going to pretend to completely understand every aspect of it, especially since we are still looking for the best way to capture the data, but the data is great for better understanding the game that the box score stats simply aren't able to do.
So when is this plane going down? I'll ride it til' it hits the ground!
User avatar
Jaivl
Head Coach
Posts: 7,116
And1: 6,766
Joined: Jan 28, 2014
Location: A Coruña, Spain
Contact:
   

Re: What Are Your Personal Opinions On RAPM? 

Post#39 » by Jaivl » Fri Apr 24, 2015 12:49 pm

Yeah, I use it. I know how it's calculed. I've calculed some versions myself. I like it. I understand what it can and can't do. I don't use it as an isolated stat.

I don't understand why some posters act like RAPM stole their girlfriends and raped their children.

fuzzy_dunlop wrote:^
yeah I read some of those threads, it's always a drag when ramp gets in the way of a good killer instinct debate.

Where can I and-3 this post?
This place is a cesspool of mindless ineptitude, mental decrepitude, and intellectual lassitude. I refuse to be sucked any deeper into this whirlpool of groupthink sewage. My opinions have been expressed. I'm going to go take a shower.
JeepCSC
Starter
Posts: 2,026
And1: 1,496
Joined: Jul 01, 2014

Re: What Are Your Personal Opinions On RAPM? 

Post#40 » by JeepCSC » Fri Apr 24, 2015 1:04 pm

I didn't participate in the top 100, but I could see how it could be frustrating when comparing players across decades. It led to some awkward intragenerational comparisons with one criteria base being turned into intergenerational comparisons with a different criteria base. Granted it might have been the best of a bad situation, but it was guaranteed to make some people mad, and not completely without reason.

Return to Player Comparisons