On-Off Comparison for Offense and Defense

Moderators: Clyde Frazier, Doctor MJ, trex_8063, penbeast0, PaulieWal

User avatar
Smoothbutta
Freshman
Posts: 80
And1: 29
Joined: Jan 31, 2011
Location: California

On-Off Comparison for Offense and Defense 

Post#1 » by Smoothbutta » Mon Jul 8, 2024 9:36 pm

Chart here
Spoiler:
Image


I broke the On-Off down to offensive vs defensive impact.

This is data from regular seasons all from BBR. Only retired and "past their prime" current players are included. Seasons are from the player being between ages of 20-36 at most, but any seasons without meaningful minutes or clearly tail of career seasons are excluded (only seasons between '06 and '18 are included for Dwight, but the other superstars were still going fairly strong through age 36).

As one more point of reference, since he wouldn't be on the chart.. using my methodology Big Ben's offensive On-Off is at 0.8 while defensive is -4.6

Question I have to the community is, are there any other charts or list like this comparing offense and defensive On-Off?
DraymondGold
Senior
Posts: 603
And1: 785
Joined: May 19, 2022

Re: On-Off Comparison for Offense and Defense 

Post#2 » by DraymondGold » Mon Jul 8, 2024 10:48 pm

Smoothbutta wrote:Chart here
Spoiler:
Image


I broke the On-Off down to offensive vs defensive impact.

This is data from regular seasons all from BBR. Only retired and "past their prime" current players are included. Seasons are from the player being between ages of 20-36 at most, but any seasons without meaningful minutes or clearly tail of career seasons are excluded (only seasons between '06 and '18 are included for Dwight, but the other superstars were still going fairly strong through age 36).

As one more point of reference, since he wouldn't be on the chart.. using my methodology Big Ben's offensive On-Off is at 0.8 while defensive is -4.6

Question I have to the community is, are there any other charts or list like this comparing offense and defensive On-Off?

Hi Smoothbutta, cool chart! It's definitely interesting to look at offensive and defensive on-off splits.

I'm a little confused on the methodology details. You say this is Basketball Reference data, with the following filters:
-regular season
-ages 20-36
-low-minute seasons filtered out
-clearly non-prime seasons are filtered out (which you say affects Dwight, but not the other superstars' late years).

This doesn't seem to match the data I see from BBR. For example, take Curry. In your chart, he's clearly below the +10.0 On-off per 100 line. By eye, his on-off on the chart is like ~ +9 to +9.5.

But when I go to his page on BBR (https://www.basketball-reference.com/players/c/curryst01.html), his career average is +10.4. Why is his data on the chart lower than his data on BBR?
-He's had a career from age 21-35, so it's not age that's causing the discrepancy.
-You say the low-minute seasons are filtered out, which filters out 2020 (-6.4 on/off in an unusable 5-game sample)... but filtering out 2020 would only *increases* his on off above +10.4, meaning his non-2020 career on-off would be even higher than what your chart shows.
-If we filtered out the early-career pre-prime years as being 'clearly the tail of their careers' (e.g. start at age 23 instead of 21 for Curry)... that would also only increase his true on-off, making the chart more wrong. Likewise for the most recent years.

The chart shows CP3 having better overall on-off than Curry... but the BBR data on Chris Paul's page actually suggests the opposite (https://www.basketball-reference.com/players/p/paulch01.html). Chris Paul has a worse Age 20-36 on-off than Curry.

So what exactly goes into these numbers on the chart?
jalengreen
Starter
Posts: 2,168
And1: 1,918
Joined: Aug 09, 2021
   

Re: On-Off Comparison for Offense and Defense 

Post#3 » by jalengreen » Mon Jul 8, 2024 10:51 pm

Not sure I understand these numbers, why is Steph below the +10 line? basketball reference has him as a +10.4 on/off

e: oops didn't see DG's post
User avatar
Smoothbutta
Freshman
Posts: 80
And1: 29
Joined: Jan 31, 2011
Location: California

Re: On-Off Comparison for Offense and Defense 

Post#4 » by Smoothbutta » Mon Jul 8, 2024 11:44 pm

DraymondGold wrote:Hi Smoothbutta, cool chart! It's definitely interesting to look at offensive and defensive on-off splits.

I'm a little confused on the methodology details. You say this is Basketball Reference data, with the following filters:
-regular season
-ages 20-36
-low-minute seasons filtered out
-clearly non-prime seasons are filtered out (which you say affects Dwight, but not the other superstars' late years).

This doesn't seem to match the data I see from BBR. For example, take Curry. In your chart, he's clearly below the +10.0 On-off per 100 line. By eye, his on-off on the chart is like ~ +9 to +9.5.

But when I go to his page on BBR (https://www.basketball-reference.com/players/c/curryst01.html), his career average is +10.4. Why is his data on the chart lower than his data on BBR?
-He's had a career from age 21-35, so it's not age that's causing the discrepancy.
-You say the low-minute seasons are filtered out, which filters out 2020 (-6.4 on/off in an unusable 5-game sample)... but filtering out 2020 would only *increases* his on off above +10.4, meaning his non-2020 career on-off would be even higher than what your chart shows.
-If we filtered out the early-career pre-prime years as being 'clearly the tail of their careers' (e.g. start at age 23 instead of 21 for Curry)... that would also only increase his true on-off, making the chart more wrong. Likewise for the most recent years.

The chart shows CP3 having better overall on-off than Curry... but the BBR data on Chris Paul's page actually suggests the opposite (https://www.basketball-reference.com/players/p/paulch01.html). Chris Paul has a worse Age 20-36 on-off than Curry.

So what exactly goes into these numbers on the chart?


Thanks for finding and succinctly communicating this mistake!
Looks like three of Steph's seasons had typos, and one of CP3's did although this one barely changes results.
Reviewed all the other players and there were no other typos that I have missed.

I'm even a Warriors fan so this is pretty embarrassing. It is pretty manual to type out the data from BBR so I sometimes accidentally read the Pace column or something like that.

New graph here
Spoiler:
Image
lessthanjake
Analyst
Posts: 3,050
And1: 2,798
Joined: Apr 13, 2013

Re: On-Off Comparison for Offense and Defense 

Post#5 » by lessthanjake » Mon Jul 8, 2024 11:55 pm

How are you computing this? Are you just taking the differences between the on and off each season and averaging them? Or are you weighting the seasons by something, such as minutes played or some way of calculating possessions?

Regardless of exactly what you’re doing, I think there’s probably an easier and more precise way of doing it using the PBPstats website. In particular, you could use either the “WOWY combinations” function or the “WOWY” function. The “WOWY combinations” one would be more straightforward for someone like Steph Curry or Tim Duncan, who have been on one team their whole career. You can just put in all the years of their career and run it for that player. For instance, see here for Steph: https://www.pbpstats.com/wowy-combos/nba?TeamId=1610612744&Season=2023-24,2022-23,2021-22,2020-21,2019-20,2018-19,2017-18,2016-17,2015-16,2014-15,2013-14,2012-13,2011-12,2010-11,2009-10&SeasonType=Regular%2BSeason&PlayerIds=201939. It’s not a function well suited to measuring this if someone changed teams, though, since it doesn’t give number of possessions, which makes it hard to combine values for stints on different teams. In that case, the “WOWY” function is probably the best bet. That would allow you to put together points scored with a player on and off the court, as well as the number of possessions on and off the court, and then you could do that for each team they’ve been on to get overall offensive and defensive ratings both on and off.
OhayoKD wrote:Lebron contributes more to all the phases of play than Messi does. And he is of course a defensive anchor unlike messi.
User avatar
Smoothbutta
Freshman
Posts: 80
And1: 29
Joined: Jan 31, 2011
Location: California

Re: On-Off Comparison for Offense and Defense 

Post#6 » by Smoothbutta » Tue Jul 9, 2024 12:06 am

lessthanjake wrote:How are you computing this? Are you just taking the differences between the on and off each season and averaging them? Or are you weighting the seasons by something, such as minutes played or some way of calculating possessions?

Regardless of exactly what you’re doing, I think there’s probably an easier and more precise way of doing it using the PBPstats website. In particular, you could use either the “WOWY combinations” function or the “WOWY” function. The “WOWY combinations” one would be more straightforward for someone like Steph Curry or Tim Duncan, who have been on one team their whole career. You can just put in all the years of their career and run it for that player. For instance, see here for Steph: https://www.pbpstats.com/wowy-combos/nba?TeamId=1610612744&Season=2023-24,2022-23,2021-22,2020-21,2019-20,2018-19,2017-18,2016-17,2015-16,2014-15,2013-14,2012-13,2011-12,2010-11,2009-10&SeasonType=Regular%2BSeason&PlayerIds=201939. It’s not a function well suited to measuring this if someone changed teams, though, since it doesn’t give number of possessions, which makes it hard to combine values for stints on different teams. In that case, the “WOWY” function is probably the best bet. That would allow you to put together points scored with a player on and off the court, as well as the number of possessions on and off the court, and then you could do that for each team they’ve been on to get overall offensive and defensive ratings both on and off.


Yes I get the offense and defense On-Off for each season and then for the graph I averaged the seasons. Compared to BBR it's only inaccurate by like 2% this way since I am excluding seasons without many minutes played. It's essentially identical. For example Steph's career On-Off from BBR is 10.4, and from my averaging the seasons it is 10.6. If I included 2020 season of 5 games as BBR included where his On-Off was -6.4 and weighted it for only being 5 games, the result might be 10.5 so compared to the margin for error that this data has when it comes to significance, this methodology is just fine IMO.

I need to get used to pbp more thank you, I do like having the breakdowns by year though.
User avatar
Smoothbutta
Freshman
Posts: 80
And1: 29
Joined: Jan 31, 2011
Location: California

Re: On-Off Comparison for Offense and Defense 

Post#7 » by Smoothbutta » Tue Jul 9, 2024 2:18 am

By the way, do we know why pbpstats and BBR on-off data differ so much? Or which is more accurate?

Seems pbp only has data from 2001 onwards also
Colbinii
RealGM
Posts: 34,243
And1: 21,851
Joined: Feb 13, 2013

Re: On-Off Comparison for Offense and Defense 

Post#8 » by Colbinii » Tue Jul 9, 2024 2:30 am

Smoothbutta wrote:By the way, do we know why pbpstats and BBR on-off data differ so much? Or which is more accurate?

Seems pbp only has data from 2001 onwards also


BBR uses estimates of possessions.

Another thing is how different sites count possessions [Offensive Rebounds, Timeouts in the middle of a possession, ect] can all have a factor in how things are calculated.
User avatar
Smoothbutta
Freshman
Posts: 80
And1: 29
Joined: Jan 31, 2011
Location: California

Re: On-Off Comparison for Offense and Defense 

Post#9 » by Smoothbutta » Wed Jul 10, 2024 4:45 am

Thanks I then presume that as long as you are consistent then using at either one is just as reputable
DraymondGold
Senior
Posts: 603
And1: 785
Joined: May 19, 2022

Re: On-Off Comparison for Offense and Defense 

Post#10 » by DraymondGold » Wed Jul 10, 2024 4:30 pm

Smoothbutta wrote:Thanks I then presume that as long as you are consistent then using at either one is just as reputable
Hey Smoothbutta! Both are reasonably reputable, and indeed consistency is probably the most important choice. That said, pbpstats is certainly slightly more reputable. Along with nba.com (which has terrible user interface and isn't very searchable for things like on/off etc.), pbpstats is probably the most reputable source for plus minus data.

BR:
Like Colbinii said, basketball reference uses an estimate of possessions (rather than true possessions) for certain stats, whereas pbpstats uses true possessions. BR's possession estimates (calculated using box stats) are reasonably accurate (they're fine if you keep the larger error bars in mind), but you do get occasional sticklers here who reject it if it's not 100% accurate like pbpstats.
One area I'm not sure of that might change things: I know when calculating Basketball Reference's VORP, for example, it assumes the team pace does not change when a player is on the court vs when they're off the court. It assumes the team plays at a constant pace. This is reasonably accurate, but does introduce some error in something like VORP. I'm not sure if BR does the same thing for on-off, but it wouldn't shock me. This might make a difference for someone like Curry; the Warriors frequently slowed the pace when Curry wasn't on, so his 'off' numbers would actually look worse if you used true possessions instead of assuming a constant pace.

pbpstats:
Like Colbinii said, there are some edge cases that make it hard to 100% tell what a possession is. Different websites have different definitions. You can find the article on pbpstats talking about its possession definition here: https://darrylblackport.com/posts/2019-04-03-why-pbpstats-possession-counts-lower/

One thing to be aware of: you might get slight differences between true 'on-off' and 'On - Off Net RTG'. They're very close, but a slight difference in units while you do the calculation can change the numbers slightly.

True on-off: Plus-Minus (ON) - OFF = (point differential when player is on)*(100 possessions)/(total possessions when on) - (point differential when player is off)*(100 possessions)/(total possessions when off).
-To find this on pbpstats, you can go to pbpstats.com -> On/off in the header -> 'Wowy' (with or without you; note Wowy is also used to refer to a different stat.) -> search for your players' Plus minus ('P/M) when they're ON and when they're OFF.
-Then use the formula above:(ON P/M)*100/(total ON possessions) - (OFF P/M)*100(total OFF possessions). This will give you a player's On-off exactly.

On - Off Net RTG: (ORTG - DRTG when ON) - (ORTG - DRTG when OFF). The difference here from above is that when calculating ORTG and DRTG, we normalize the pace on both sides of the court first, so we assume the offense and defense has the same pace. This is close to reality, but there are times when one team gets a few more offensive possessions than the other, so the true pace of the offense and the defense isn't always exactly the same. Consider if one team gets lots of offensive rebounds that are considered different possessions, or if one team gets lots of steals before the other team's possession starts, or if a player gets substituted on the court more frequently during offensive or defensive possessions, etc. True on-off doesn't make this assumption. So True on-off and on-off NetRTG are similar -- they just make measure slightly different quantities in how they deal with team pace.
-To find this on pbpstats, you can go to pbpstats.com -> On/off in the header -> 'Wowy Combinations' -> look up your player.
Then use the formula (NetRTG when ON) - (NetRTG when OFF). If you'd 'like to look at a player across multiple years, you can also:
go to pbpstats.com -> search your player in the search bar (top right) -> go to on-off in the Table Data dropdown menu -> look at the 'On-Off NetRTG'

...

On the topic of your thread, thanks for the clarification! It looks like the other players are reasonably close to true, although the chart value still does differ slightly. Take Dirk for instance: his Basketball Reference on-off during the timespan should be +10.0 for Ages 20-36, whereas the new chart shows him around +9.5. They're reasonably close like you say, enough to get a sense for how the players are, but the value on the chart may differ slightly from BR's value, or pbpstats' true value.

Anyways, cool chart! It's interesting to see everyone plotted all together.

Return to Player Comparisons