People were interested in these podcasts

Those aren't stats. That's counting.

Moderator: Doctor MJ

Doctor MJ
Senior Mod
Senior Mod
Posts: 52,805
And1: 21,735
Joined: Mar 10, 2005
Location: Cali
     

Those aren't stats. That's counting. 

Post#1 » by Doctor MJ » Fri Mar 2, 2012 2:18 am

So I"m making this thread, even though it's preaching to the choir, because I want the people on this board to be aware of it. Henry Abbott at TrueHoop had a great post today where he talked about how weird it was that people call him a stat guy because he really doesn't know math at all. He doesn't make stats, he just uses them, but even there he doesn't really see it that way:

http://espn.go.com/blog/truehoop/post/_ ... s-is-video

Henry Abbott wrote:Right now the reason a lot of teams don't make smarter decisions is, I'd argue, because they have key decision-makers who simply don't get statistics. They are so incredibly incurious that it matters not at all what any stat person might say.

These people say things like "I watch the game," and "I believe my eyes."

Kobe's response to data that he hurts the Lakers in crunch time was, essentially, you're going to believe stats?

To me, the fact that the Laker offense loses all punch in crunch time, that they're outscored, and that Bryant is setting all-time records for misses ... those aren't stats. That's counting.


This is dead on. People think that stats people are doing super crazy stuff. In reality, they basically don't go above high school level math, and when it comes to data like this, we're talking about grade school stuff that non-stats people are ALREADY DOING, they're just not doing it thoroughly and thus screw up their count.
Getting ready for the RealGM 100 on the PC Board

Come join the WNBA Board if you're a fan!
User avatar
SideshowBob
General Manager
Posts: 9,061
And1: 6,263
Joined: Jul 16, 2010
Location: Washington DC
 

Re: Those aren't stats. That's counting. 

Post#2 » by SideshowBob » Fri Mar 2, 2012 2:50 am

What's sad is that reading through the comments on that post, you get the idea that 90% of the people didn't even bother to read it.
But in his home dwelling...the hi-top faded warrior is revered. *Smack!* The sound of his palm blocking the basketball... the sound of thousands rising, roaring... the sound of "get that sugar honey iced tea outta here!"
User avatar
Rapcity_11
RealGM
Posts: 24,771
And1: 9,685
Joined: Jul 26, 2006
     

Re: Those aren't stats. That's counting. 

Post#3 » by Rapcity_11 » Fri Mar 2, 2012 4:40 am

Abbott really nails it here.

(Although, he should really stopping harping on Kobe so much.)
User avatar
Rerisen
Retired Mod
Retired Mod
Posts: 105,369
And1: 25,052
Joined: Nov 23, 2003

Re: Those aren't stats. That's counting. 

Post#4 » by Rerisen » Fri Mar 2, 2012 6:24 am

The 'Moneyball' moment hasn't arrived with regard to basketeball yet, it's a harder game to model with numbers, so many more interactions, but it is approaching. Probably a couple years off yet.

The interesting thing is the change being driven from the outside in (though the outsiders are becoming insiders as teams hire them up).
User avatar
EvanZ
RealGM
Posts: 14,305
And1: 3,912
Joined: Apr 06, 2011

Re: Those aren't stats. That's counting. 

Post#5 » by EvanZ » Sat Mar 3, 2012 3:03 am

It's knowing what to count that...counts.
Subscribe to my 100% FREE email newsletter summarizing top college performances:

https://toplines.mailchimpsites.com/
ElGee
Assistant Coach
Posts: 4,041
And1: 1,206
Joined: Mar 08, 2010
Contact:

Re: Those aren't stats. That's counting. 

Post#6 » by ElGee » Sat Mar 3, 2012 6:41 am

I'm having a discussion with someone on my blog who seems to not understand the concept of measurements -- counting, as Abbott so appropriately calls it. It's as ass backwards as anything analytical can get, and the thinking (common to a huge huge number of basketball fans) goes like this:

-ppg and wins (and maybe a few other raw stats, such as FG%) tell me a truth (they basically measure goodness).

-"advanced stats" that aren't ppg and wins are from "nerds" or "spreadsheets" and are "made up" and are a totally different way to look at the sport that I reject. "Stat heads" don't get the game...

The great irony, of course, is that ppg and wins ARE STATS. The people who are denigrating anything more detailed than those two stats are often themselves banking a huge amount of their analysis ON STATS. (And 2 horribly confounded ones, at that.) They are measurements we've had since the beginning of the sport, only no one bothered to think of the game ITO of efficiency, which, as a possession-based sport, it simply is.

So, sticking with the ppg/efficiency issue...if we count up all the possessions in a game, and count up all the points, we can figure out how efficient a team is. The more efficient team wins 99.99% of the time. Similarly, we can count up all the points a player scores when he shoots (TS%) and this tells us more, as a game of possessions, than raw ppg and FG% about the value of WHAT WE'VE COUNTED. Literally, there is NO NEW COUNTING occurring, just a better way to understand what we've counted.
That's it -- we are measuring "when he shoots the sphere at the cylinder, how often does it go in?"

That people reject this and view O/DRtg and TS% (or other concepts, even the +/- family) as "made up" is missing a concept about as badly as anyone could possibly miss a concept. It's like declaring 2+2 = apple and that math is imaginary. (I don't think I'm being too extreme with that analogy - thoughts?)

Finally, the common criticism of almost every one of these people is "your new stats doesn't tell you everything." But somehow, they don't hold ppg and wins to the same standard.

Horrified, I will now end this rant.
Check out and discuss my book, now on Kindle! http://www.backpicks.com/thinking-basketball/
User avatar
EvanZ
RealGM
Posts: 14,305
And1: 3,912
Joined: Apr 06, 2011

Re: Those aren't stats. That's counting. 

Post#7 » by EvanZ » Sat Mar 3, 2012 12:33 pm

I suspect in a society where more people appreciated math and science, "advanced" stats would be an easier sell. Sigh.
Subscribe to my 100% FREE email newsletter summarizing top college performances:

https://toplines.mailchimpsites.com/
User avatar
rrravenred
Retired Mod
Retired Mod
Posts: 6,104
And1: 577
Joined: Feb 24, 2006
Location: Pulling at the loose threads of arguments since 2006

Re: Those aren't stats. That's counting. 

Post#8 » by rrravenred » Sun Mar 4, 2012 1:10 am

I'm effectively innumerate in comparison to most on this board (and a lot on the PC board as well), but Abbott's article is a good jumping off point for the problems that statisticians have in effectively communicating the impact of stats x, y and z.

Part of it's anti-intellectualism (an interesting question is what the take-up rate of advanced statistics is in terms of ex-player team personnel who basically abandoned formal education after their mandatory college year), and a lot of it is privileging their own subjective inside knowledge because of the bubble existence that a lot of professional athletes experience.

It's interesting that a lot of the anti-stat posters on the PC board quote inside knowledge as a counter to objective statistical evidence. "Yes, Isiah may not have led the Pistons in winshares or have a positive effect on MOV, but Bill Laimbeer says that without him the Pistons wouldn't have won anything, and who would know more about the Pistons, you or him?"

Those on the inside are the ones who really must know things, right? You outsiders who create stories with numbers mustn't watch how those numbers are produced, right? Context and the limitations of statistical models and derivations are important, but it's really difficult to get someone to read the footnotes when they're outraged at the headline slaughter of their sacred cows.

More important than educating basketball decision-makers is educating popular analysts and presenters. When you start getting regular usage of Lineup +/-analysis and TS% in a way that popularizes and familiarizes their use to the general public then you might get wider acceptance of the more complex ways of looking at basketball in conjunction with "highlights analysis"...
ElGee wrote:You, my friend, have shoved those words into my mouth, which is OK because I'm hungry.


Got fallacy?
User avatar
Dr Positivity
RealGM
Posts: 62,354
And1: 16,271
Joined: Apr 29, 2009
       

Re: Those aren't stats. That's counting. 

Post#9 » by Dr Positivity » Sun Mar 4, 2012 9:11 pm

I see it split into 4 groups

A. People who understand stats and use them
B. People who understand stats and choose not to use them (w/ the complexities of basketball)
C. People who don't understand stats and don't use them
D. People who don't understand stats and use them

I agree with some of Abbott's points but I believe he's isolating the separation to just groups A and C. I believe it's possible to be "anti-stat" while not being less capable of understanding them, and I think that statistical communities can sometimes have a black mark by stats being used the wrong way by groups
Liberate The Zoomers
mysticbb
Banned User
Posts: 8,205
And1: 713
Joined: May 28, 2007
Contact:
   

Re: Those aren't stats. That's counting. 

Post#10 » by mysticbb » Mon Mar 5, 2012 8:39 am

Sorry, Mufasa, but group B does not exist. Those are people who are thinking they understand stats, but in reality they don't. If someone really understands stats, he will use it, if the context fits. The unfortunate thing is: Most people don't understand stats, they are using them in the wrong way. I also think that group C is rather small, really small. Most people still arguing with points, rebounds, etc.
User avatar
EvanZ
RealGM
Posts: 14,305
And1: 3,912
Joined: Apr 06, 2011

Re: Those aren't stats. That's counting. 

Post#11 » by EvanZ » Mon Mar 5, 2012 11:53 am

mysticbb wrote:Sorry, Mufasa, but group B does not exist. Those are people who are thinking they understand stats, but in reality they don't. If someone really understands stats, he will use it, if the context fits. The unfortunate thing is: Most people don't understand stats, they are using them in the wrong way. I also think that group C is rather small, really small. Most people still arguing with points, rebounds, etc.


I agree with this. Invariably, when I hear someone say, "And believe me, I know statistics, but I don't think you can use them for basketball"...it translates to "I took one statistics course 20 years ago...and didn't do very well in it." :lol:
Subscribe to my 100% FREE email newsletter summarizing top college performances:

https://toplines.mailchimpsites.com/
ElGee
Assistant Coach
Posts: 4,041
And1: 1,206
Joined: Mar 08, 2010
Contact:

Re: Those aren't stats. That's counting. 

Post#12 » by ElGee » Mon Mar 5, 2012 8:29 pm

mysticbb wrote:Sorry, Mufasa, but group B does not exist. Those are people who are thinking they understand stats, but in reality they don't. If someone really understands stats, he will use it, if the context fits. The unfortunate thing is: Most people don't understand stats, they are using them in the wrong way. I also think that group C is rather small, really small. Most people still arguing with points, rebounds, etc.


Took the words out of my mouth. It makes absolutely no sense to understand statistics and them not use - it would be like closing your eyes while you drive a car.
Check out and discuss my book, now on Kindle! http://www.backpicks.com/thinking-basketball/
User avatar
mopper8
Retired Mod
Retired Mod
Posts: 42,618
And1: 4,870
Joined: Jul 18, 2004
Location: Petting elephants with the coolest dude alive

Re: Those aren't stats. That's counting. 

Post#13 » by mopper8 » Mon Mar 5, 2012 8:48 pm

I think its perfectly defensible to say that there are people out there who understand stats and choose not to use certain particular stats (*cough* PER *cough*), but that's more understanding the underlying flaws in that one particular statistical model.

I don't ever recall meeting someone who understands statistical analysis writ large, and consistently eschews it for the eye test.

I took one statistics course 20 years ago...and didn't do very well in it.


It was 9 years...and I did well!!!
DragicTime85 wrote:[Ric Bucher] has a tiny wiener and I can prove it.
Doctor MJ
Senior Mod
Senior Mod
Posts: 52,805
And1: 21,735
Joined: Mar 10, 2005
Location: Cali
     

Re: Those aren't stats. That's counting. 

Post#14 » by Doctor MJ » Tue Mar 6, 2012 1:30 am

ElGee wrote:Took the words out of my mouth. It makes absolutely no sense to understand statistics and them not use - it would be like closing your eyes while you drive a car.


Well though, in my experience at APBRmetrics, there are a good number of people who would see me that way (presuming they believed that I understood their stats). I wouldn't say I don't use stats obviously, but I tend to be cautious about the conclusions I draw from them, and I think that's what Mufasa was getting at.

There are people who believe that they have the stats to say exactly what's going on (a la Berri), and then there are those of us using the stats as part of a broader analysis.
Getting ready for the RealGM 100 on the PC Board

Come join the WNBA Board if you're a fan!
User avatar
EvanZ
RealGM
Posts: 14,305
And1: 3,912
Joined: Apr 06, 2011

Re: Those aren't stats. That's counting. 

Post#15 » by EvanZ » Tue Mar 6, 2012 2:22 am

A lot of people don't like the word "stats". Maybe we should use "data mining" instead. That sounds cooler.
Subscribe to my 100% FREE email newsletter summarizing top college performances:

https://toplines.mailchimpsites.com/
mysticbb
Banned User
Posts: 8,205
And1: 713
Joined: May 28, 2007
Contact:
   

Re: Those aren't stats. That's counting. 

Post#16 » by mysticbb » Tue Mar 6, 2012 7:58 am

Doctor MJ wrote:I wouldn't say I don't use stats obviously, but I tend to be cautious about the conclusions I draw from them, and I think that's what Mufasa was getting at.


Ok, let us call it "numbers" instead of "stats", but both mean the same in the end. Stats are numbers, something which was a result of counting or calculating. Counting is just more simple than using some more sophisticated equations. And you draw constantly conclusions from those numbers. Heck, I would say EVERYBODY is at least biased by numbers in some sort of way.
And the group B Musafa described does not exist. We have seen multiple times discussions in which people claimed they understand "stats", but showed the inability to use them correctly. People don't like it, if facts are speaking against them. So, it seems natural to attack the stats instead of their own preconception.

Doctor MJ wrote:There are people who believe that they have the stats to say exactly what's going on (a la Berri), and then there are those of us using the stats as part of a broader analysis.


Berri is just one example, we can use Winston as an example from the +/- based stats. Neither of those are helpful in order to educate the broader fanbase in terms of advanced metrics. That might be a bigger issue, but most times the reluctance to use stats in not based on some objective measurements (we can show that WP48 isn't a good predictor or APM has big issues with overfitting and multicollinearity, which can only be solved with a huge sample size), but is based on the own preconceptions. People tend to use outliers as evidence that the stats are "wrong". But in a lot of cases the people just disagree with about 5 or 10% of the rankings. So, instead of using those stats as enlightment and finding an explanation for the difference between the "eye test" and those "stats", they just throw out that the "stats" are bogus, believing they own "eye test" more even though the bias is pretty clear.

Just recently my discussion with a pretty smart user went like this:
User: The stats is stupid, because I disagree with the results.
Me: Well, that is how it works.
User: Ok, looks solid, but I still disagree.

People are afraid to contradict their own preconceptions and they try to defend their existing position on players rather instead of re-evaluating the player and their own evaluation process. It is ignorance in the first place, it is overconfidence in their own abilties in the second place and it is the fear of being exposed as being not as smart as they want to look like.

mopper, I agree that there are people who understand the flaws of some metrics and are choosing not to use those specific metrics. But well, even PER can be used, if we put that into a certain context. Do I look for a scoring player with the high volume, I can certainly look at PER and choose the better scorer based on that. Well, if I look for a role player with great rebounding who is not taking shots away from better scoring options, I can use WP48 in order to pick one. Those stats have obviously flaws, but within a certain range they are still somewhat useful. Obviously, basketball is more than just scoring and more than just rebounding, that makes those two particular stats not good and that can be shown in predictions. But for all stats it is true, that they have to be looked at in a context. The stats are not intrinsic values of a player, they are results of an interaction of players within a 5 on 5 game.
User avatar
Dr Positivity
RealGM
Posts: 62,354
And1: 16,271
Joined: Apr 29, 2009
       

Re: Those aren't stats. That's counting. 

Post#17 » by Dr Positivity » Tue Mar 6, 2012 4:10 pm

mysticbb wrote:Sorry, Mufasa, but group B does not exist. Those are people who are thinking they understand stats, but in reality they don't. If someone really understands stats, he will use it, if the context fits. The unfortunate thing is: Most people don't understand stats, they are using them in the wrong way. I also think that group C is rather small, really small. Most people still arguing with points, rebounds, etc.


Well, then maybe substitute "advanced stats" into my post. Not that the stats are that advanced, but just to separate them in name from boxscore ones. The separation I would say is that whenever stats from a game are put into a calculation or mixed together, it becomes a 2nd degree stat and "advanced". So maybe the sentence should read "People who understand calculated stats and choose not to use them"
Liberate The Zoomers
User avatar
Dr Positivity
RealGM
Posts: 62,354
And1: 16,271
Joined: Apr 29, 2009
       

Re: Those aren't stats. That's counting. 

Post#18 » by Dr Positivity » Tue Mar 6, 2012 6:52 pm

I would break it down like this. I think anyone interested in analyzing basketball uses numbers to a degree, and they start with what I'll call 1st degree stats:

Boxscore stats: Ppg/rpg/apg/bpg/etc. + FG%/FT%/TS%
Unadjusted +/-, 5 man lineup +/-
Specific shooting area stats. Stuff like Hoopdata and Synergy for us, Cuban and Morey apparantely have mwahahha machines pinpointing %s for players on every specific play and area

The reason I call these 1st degree is that they come straight from the games and players, and they stand on their own. They are essentially undisputable "facts" about what happened.

Then I will call the next part 2nd degree stats. This is when through people power or machines these stats are put together and calculated to attempt to mean something more accurate:

PER/WS/WP combines the boxscore stats
RAPM, APM, etc. combines the Unadjusted +/- numbers
Not as much 2nd degree stats go into the specific shooting % ones. If was an up and coming stat guy I would be trying in this area, for example. to combine things like how many scores a player has at the rim + from 3 + assists to those areas, to get a "good shot index" and %s of how many of their shots fall under this. This would be 2nd degree stats with the Hoopdata charts

3rd degree stats I assume would be eg. Taking PER and RAPM and 2nd degree Hoopdata stats if they existed, and mixing it together to get one big stat. This is also something that's undeveloped and that I would experiment with if I had the resources

Now in the context of sabermetricians vs traditional groups, I think the big difference is that the former attempts to find a purely mathematical and objective way to interpret the 1st degree stats into 2nd degree conclusions. Whereas those who would rely on the raw stats as the extent of it, would try to draw conclusions not with numbers but just analytic thought process and logic about what those raw stats mean about the players skillset and how it fits into succesfully building a team. I would personally put myself in the group who overwhelmingly favors using the 1st degree stats + interpreting them from there in a non statistical way, mainly from the perspective of skillsets
Liberate The Zoomers
User avatar
EvanZ
RealGM
Posts: 14,305
And1: 3,912
Joined: Apr 06, 2011

Re: Those aren't stats. That's counting. 

Post#19 » by EvanZ » Tue Mar 6, 2012 6:59 pm

Have you seen my adjusted mid-range and adjusted inside shooting metrics?

http://thecity2.com/2012/02/08/3-year-a ... -shooting/

http://thecity2.com/2012/02/11/inside-g ... a-warrior/
Subscribe to my 100% FREE email newsletter summarizing top college performances:

https://toplines.mailchimpsites.com/
BoutPractice
Senior
Posts: 666
And1: 540
Joined: Oct 31, 2011

Re: Those aren't stats. That's counting. 

Post#20 » by BoutPractice » Tue Mar 27, 2012 9:33 pm

To use stats (any data, really) properly, you need to be a good thinker, one might say a philosopher.
Giving stats to someone who doesn't practice thinking, someone who believes the answers are simple and clear-cut, is counter-productive.

A lot about stats is subject to legitimate debates (and stat enthusiasts who reject that debate don't deserve to use stats), but I think we can agree on the following:
- stats tell us something significant
- they're our own creations, they don't hold any magical truth
- they only make sense in context
- they have to be interpreted

Return to Statistical Analysis