Norton Analysis.

August 3rd, 2008 by Gerald Norton

After years working as a process control statistician, I’ve learned that opportunity is the greatest predictor of an event. If it is impossible for an event to occur, it will not occur, and therefore not be recorded. If it is highly likely for an event to occur, it will occur, and be frequently recorded. This may seem absolutely obvious, but it is all but completely over-looked when analyzing NHL player performance. How so? Ice time. Not all ice time is created equally. Not in terms of effort required, offensive opportunity, or defensive opportunity. This is why some players graduate from “specialists” to “core” players, but then fail to earn their salaries. Consider it the Peter Principal on ice. Let’s use Andrei Meszaros as an example. In his rookie season, which was widely heralded as proof positive of his impending elite status, he played a whopping 15% of his total ice time on the PP, and generated 24 of his impressive 39 rookie season points while on the PP. 14 of the remaining 15 pts came while playing ES, but 50% of those came immediately after the end of the PP time, effectively making them PP points. This means he produced almost 80% of his points, all within a period representing less then 17% of his total ice time. Does this really make him an elite defenseman? Or a specialist? Because honestly, while playing a 3rd pairing role ES, he was hardly facing the highest calibre offensive talent. But, he did play a great deal of second unit PK time, and in that role, he was competent. So in the following season, with the loss of Chara, he was promoted to the second pairing. How did he fair? He continued to produce points, but his defensive game was exposed by the higher calibre opponents he faced. Over-all, in that role, he was far from elite. But, in that same year emerged Volchenkov as a durable, physical, shot blocking defensive beast. Start the elite defenseman chatter right? Wrong. Why not? Simply, because the NHL, the media, and it’s fans, are points driven. Mesz scored a lot of points while playing a lot of premium scoring time (PP), and was given a lot of attention. Volchenkov played an amazing defensive game, while playing difficult defensive time (PK), but was basically given a pat on the back, but little else. In this same year, although Volchy was outstanding defensively, he was basically non productive offensively, and had little or no offensive opportunities, as they went to Mesz. Mesz was criticized for his defensive play, but still heralded for his offensive play. Volchy signed a new contract worth 2.5M. After another season struggling defensively, Mesz is setting up to sign a contract of over 3M, and could likely land over 5M if he were a UFA. Sound reasonable to you? It’s not. Especially when you consider Volchy was never given a chance to produce on the PP, and Mesz was never asked to assume a shut down role on the first unit PK. Opportunity is simply not taken into consideration when evaluating players. Without opportunity, there can be no event. This same challenge is often faced by those of us who enjoy reading statistical analysis by other fans of the game. All too often the conclusions are based on non opportunity adjusted data, and this often leads to skewed results, which enhance the offensive capabilities of a player, while masking the defensive capabilities of this same player. Simply put, a truly elite defenseman plays above average in all situations, PP, PK, and ES. All other similar ice time players are specialists, if they excel in any one area, or just plain above average, if they don’t. That brings me to another point, total average time on ice (TATOI). This is another great data set that must be used when comparing players. It is simply unforgivable, from an integrity of conclusions view, to compare players of wildly differing ice times. This is not just a matter of opportunity adjustment, but situational adjustment. Low ice time players face lower calibre opponents. To compare their results to those of a player facing higher calibre opponents is irrational, no matter the mix of that ice time. The only time this can be done is if the two players TATOI is different, but one or two of their sub indexes are similar, i.e., similar PPATOI times can be compared, even if their TATOI is different. Taking another look at Volchy versus Mesz. The problem that quickly arises os the one of the chicken or the egg. Is Mesz more productive because of his ice time on the PP, or does he get more ice time on the PP because he is productive? I do not claim to know this, and anybody outside of the coach, isn’t either. But I can say this. If I am a coach, and one player is great defensively (a much harder skill to acquire I might add), and another is bad defensively, the better one get’s the PK ice time, and shut down role. Knowing that this ice time is particularly difficult, I am probably not going to ask this same player to play on the PP as well. This time then goes to the player with lesser defensive skill. Resulting in that player actually be “rewarded” for their defensive deficits. Strange indeed! How to then compare players? Well basically its a series of data points being rationally categorized. First is League, then season, then comes conference, position, ice time, lastly, sub sets of ice time. Using these date sets, I can then produce two key matrices, PRODuction, as a ratio of specific points over specific ice time and PREVention, as a ratio of specific goals against over specific ice time. My data will be able to highlight each players ability to produce points, and prevents points, on an even playing field. There are a number of key factors I will not include in the data, which I will leave to individuals to rationalize for. This is because there is no acceptable way to account for them, without inferring undue bias, on my part. Frankly, I have no means of developing a defend able data set to account for the impact of these variables, so I won’t. These include; 1. Goaltending - So many factors are involved in the scoring of a goal, that I have a hard time attributing goaltending as a factor. Some do, namely Alan Ryder, but I have issues with his rational (I’m not saying he’s wrong, just that his means are not robust enough, IMO, to say he’s right). 2. Shot quality -So many factors are involved in the taking of a shot, that I have a hard time attributing individual shot analysis as a factor. Some do, namely Alan Ryder, but I have issues with his rational (I’m not saying he’s wrong, just that his means are not robust enough, IMO, to say he’s right). 3. Team style of play - So incredibly subjected, especially when it goes from intended style of play, to actual style of play. 4. Teammate effect. - Again, this is the classic who was better, Hull or Oates, Gretzky or Kurry, Brodeur or Stevens etc. I’ll leave that up to the readers to debate. I will begin this analysis at the beginning of the 2008/09 season, for select players (high ice time) through-out the league (all Senators) and post 20 game updates, ideally showing trends, interim leaders, and over-all team attributes. I have taken some time to develop the rationales, and in testing them have developed some data from last season. I will post it here to allow the readers to gain some familiarity with the data, to answer any questions, and more importantly, allow the methodology, and conclusions to be challenged, thus allowing for adjustments I missed. There will be some further adjstments, especially around the calculation for OATPREV, which on this chart is far too simplistic, and not at all rational. I will produce an OATPREV similar to that of the OATPROD. As you’ll see below, I’m having some issues inserting a table, sorry about the mess. As soon as this is worked out I’ll try to work it out by the start of posting the 2008/09 season.

For the Prod numbers, the lower the number (time) the better, as this represents how many minutes the player plays before recording a point.

For the Prev numbers, the higher the number (time) the better, as this represents how many minutes the player can play before having a point recorded against him

Name AdjTotal
Pnts
Adj
PP
Pnts
SHPnts ESPnts Opp.Adj.

Tot

Prod.

Phillips 17.83 00.83 3 14 81:17
Kaberle 47.90 24.90 0 23 40:14
Meszaros 33.28 13.28 1 19 46:31
Volchenkov 15 00.00 3 12 72:36
Redden 35.28 13.28 1 21 46:24
Smith 10 00.00 0 10 115:57
Lidstrom 64.25 28.25 1 35 26:56
Kubina 36.87 14.87 1   39:43
Finger 18.66 01.66 1 16 74:25
McCabe 20.22 13.22 0 7 59:38
Chara 46.75 20.75 2 24 38.38
Bouwmeester 34.62 11.62 0 23 55:19
Campbell 56.39 27.39 0 29 33:03
                 
                 
                 
                 
                 
                 
                 
                 
                 
                 
                 
                 
                 
                 
                 
                 
                 
Name Opp.Adj.Tot.

Prev.

Opp.Adj.Prev.

PP

Prev.ES +SH
Phillips 37:14 10:08 27:07
Kaberle 28:31 07:51 20:40
Meszaros 31:33 08:43 22:50
Volchenkov 39:43 09:40 30:03
Redden 29:26 07:56 21:30
Smith 36:56 13:11 23:45
Lidstrom 41:25 10:58 30:27
Kubina 29:01 08:27 20:34
Finger 34:21 10:34 23:47
McCabe 33:02 09:14 23:48
Chara 37:20 12:17 25:03
Bouwmeester 32:49 10:16 22:33
Campbell 36:48 16:19 20:29
Posted in Uncategorized
  1. 11 Responses to “Norton Analysis.”

  2. By thewordbird on Aug 3, 2008

    That is very extensive and a level-headed approach. I love it and Volchenkov!

  3. By thewordbird on Aug 3, 2008

    oh yeah, lookin’ forward to reading those a great deal.

  4. By Gerald Norton on Aug 3, 2008

    Sorry about the mess, I’ll figure it out, lol. Please ask, and criticize away, it will only make it better to get other views.

  5. By David Johnson on Aug 3, 2008

    We can combine the two stats by creating a +/- type state by calculating Prev - Prod.

    3:31 Lidstrom
    -12:34 Campbell
    -13:35 Chara
    -19:09 Kubina
    -19:34 Kaberle
    -23:41 Meszaros
    -24:54 Redden
    -32:49 Bouwmeester
    -35:50 McCabe
    -42:33 Volchenkov
    -50:38 Finger
    -54:10 Phillips
    -92:12 Smith

    The problem with this stat is it isn’t considering comparable offensive and defensive stats as it considers points a player scores vs goals the other team scores. To be comparable it should use goals the players team scores vs goals opposing team scores. Making that modification is probably advisable, partly because being responsible defensively can allow the rest of ones team mates take more chances, and thus likely get more goals, in the offensive end. A player may not get credited with a point but may have directly or indirectly helped his team score. In the player rankings I developed I looked at goals scored while a player was on the ice and not just the players point totals.

  6. By Gerald Norton on Aug 4, 2008

    David,
    Those are some great observations.
    As for the goals for, I spent a lot of time thinking about that too. My rationale is that there are already (usually) 3 points assigned on every goal, making this a pretty robust record of influence on goal scoring, whereas there is no record for influence on goal allowing, another indicator of how stats are production oriented. As I only used Dmen, I “assumed” they played a role in any goal against, as it is their primary role to prevent this occurance. Providing attribution for all goals scored for seems a bit too prone to over attribution (as is attrtibution for all goals against, but there exists no alternative). I wish there was direct attribution for goals against. As it stands, the PROD side of the table is more robust, I’d rather maintain that, then water it down, to match the less robust PREV side of the ledger.
    BUT, you do raise a very valid point that how you play can encourage offense, or discourage offense. This can be evidenced by the number of SH goals for Ottawa has scored. You say you already do this (goals for on ice, goals against on ice)? I will post a caveat explaining how the PREV side is based upon unattributed goals against.
    I will also seriously consider an equally unattributed PROD chart, with the same caveat, then do the plus minus, as this would be a very interesting stat (do you do this already?) I’d be interested to see how much it changes the appearance of productivity for forwards, I suspect it won’t. But, it would have a huge impact on defensive players like Kelly and Phillips who would instantly benefit from un-attributed offence.
    Thanks for the observations, the more the better.

  7. By David Johnson on Aug 4, 2008

    I have already created a rating system (see http://stats.hockeyanalysis.com/) that I feel is as good as any in evaluating the true benefit a player offers his team. What I do is look at how many goals are scored for and against when the player is on the ice vs when he is not on the ice. But I don’t do it in a traditional +/- way. What I look at is pairs of players and see how well they do with each other and without each other.

    Let’s take Phillips as an example. See http://stats.hockeyanalysis.com/200708players/player0102.php. That webpage shows his even strength ice time with his team mates and against opposition players as well as the goals for and against when the players are on the ice together and when they are apart. In Phillip’s case, he played most with Volchenkov (894:53) and in that time the opposition scored at a rate of 0.603 goals per 20 minutes (GA/20). When Phillips wasn’t playing with Volchenkov opponents scored at a much higher 1.006 GA/20 pace and when Volchenkov didn’t play with Phillips opponents scored at a rate of 0.878/20. So clearly they were much better defensively together than apart.

    When I take into account all teammates and all opponents for goals for and goals against I can get a clearer picture of who are the better players. The better players are the ones who help their team mates score more goals and give up fewer goals than they do when they aren’t playing on the ice at the same time and who hold opponents to fewer goals than normal and score more goals on an opponent than normal.

    Make sense?

    Now, the numbers on those links are just even strength numbers but I also use power play and short handed numbers and then aggregate them all to form an offensive, defensive and overall player ratings as well as an overall contribution (i.e. http://stats.hockeyanalysis.com/200708/northeast_playerrankings.php for the northeast division). The ratings are time on ice independent while the contribution rating includes a players time on ice (it’s not a straight rating*TOI calcuation but it is not far off).

  8. By Steve on Aug 4, 2008

    I understand the desire to eliminate goaltending and shot type/distance from your analysis of defensemen, but I disagree with you in considering them a non-factor in goal scoring.

    You say that you don’t consider there to be a robust assessment of their relevance, yet at the same time you are damaging the robustness of your own assessment by excluding their impacts.

    Obviously team-mates have a huge impact on these stats as well. If they had no impact on a player’s defensive stats, then a players performance should be independent of the team he is playing for. I would think analyzing performance for a player on different squads within the same season would confirm whether or not this is the case. Have you considered comparing the numbers for Brian Campbell both before and after his trade from Buffalo to San Jose last season? Or perhaps the play of Brad Stuart with Detroit and with Los Angeles? I know the sample size varies drastically, but I would think some trends would be indicated.

    Interesting work though Gerald, and no worries about the chart issues. Keep up the solid work.

  9. By Gerald Norton on Aug 4, 2008

    Goaltending and shot quality have HUGE impacts on scoring, I would never discount that. What I do discount is the ability to accont for it without injected a variable that will actually confuse the data more then clarify it. This is where it’s up to the reader to put the stats into context, and why stats alone may be interesting, but can never tell the whole story. I do find that the more you try to tell with stats, the murkier the results become, not the other way around. By no means do these rational groupings tell the whole story, but they do tell a story, and I’d rather that, even when imperfect, the have a situation where it is too difficult to translate the results. Maybe what I’ll do is also provide some shot data, and SV% data, to lend some context.
    As for the teammate effect, for sure. But again, so much can come into play, from health, to system style. The variables are unending, so I try NOT to account for them, as odd as that sounds. I dislike “all in one” solutions, or I should say, I yet to like one, if one could exist, and be robust, I’d absolutely love it!
    Out of curiosity I’ll try to find some time to look at Gill, Corvo, Campbell and Stuart, and see what apparent impact team has to play.

  10. By Gerald Norton on Aug 4, 2008

    David, I like your look, it’s another great tool in focusing the picture. I personally like to keep things simple, as I find this does a better job of presenting a specific occurance. It would be a good idea to look at combining a few snapshots, then blowing them up to show more detailed takes. It wold be awesome if each blogger took responsibility for certain stats, because it is an onerous job compiling, sorting and rationalizing all the data!

  11. By David Johnson on Aug 4, 2008

    In my opinion, any tool to evaluate players that doesn’t take into account who the player plays with and against is a flawed tool. The most common argument I hear when someone mentions an offensive or defensive stat is ‘but he plays against the opponents best players’ or something of that sort. The problem is, no one is really any good at instinctively knowing how much that is true and what effect it has on a players stats. It is really difficult to accurately ‘put stats into context’ with hockey.

  12. By Gerald Norton on Aug 5, 2008

    I agree completely, that is why the context (teammates, opposition, ice time, etc) needs to be added, but not, I argue, in the form of “incorporated” variables, but rather identified modifiers, that can then be used when looking at a particular statistic, or even added, one at a time. There is tremendous value in examining the situations you present.
    It is my intention to develop a stat that is based upon very few variables, thus producing a more attributable result. Even something as simple as points represents a stat with hidden variables that can be easily accounted for, but are not, and end up hiding some significant facts. No stat tells the whole story, and the more stories it tries to tell, the more variable interference it incorporates. Using a direct stat, then adding in variables, allows the evaluator to mix and match variables and more clearly see the impact of each, and more readily identify anomalous variables, or irrational groupings that have significant impact in altering the “impression” of that player. Basically, it’s a show your work mentality. The more stripped down it is, the more clearly you see what it is saying, then the evaluator doesn’t have to attempt to deconstruct the result in order to determine if a specific variable had an overwhelming impact on the result. It’s just a different way of looking at it. Nobody is right or wrong. I’m loving this discussion thou, it is making me re-think a lot of my rationale.

Post a Comment

Site Newsfeed

Panthers get physical…in practice!
After watching his team give up 52 shots Tuesday night against the Tampa Bay Lightning and blowing a 3 goal lead, head...Thu, 20 Nov 2008

 

Backwards Day
Here are four words I never thought I’d put into the same sentence: Thank You Chris Pronger.  There are so many...Thu, 20 Nov 2008

 

The Useless +/- Stat
James Mirtle from From the Rink and the Edmonton Journal’s David Staples are questioning the usefulness of the...Thu, 20 Nov 2008

 

Fantasy stat Thursday
on certain Thursdays i take a look at a particular stat in the NHL that has some impact on fantasy teams.  i...Thu, 20 Nov 2008

 

Opportunity to Take a Breath
We are in the first four-day break the Sharks have had this season, and only the third of three days or more.  I know...Thu, 20 Nov 2008

 

Are Kaberle and Kubina Playing That Poorly?
Just a quick posting on the play of the Leafs leaders on D. I’ve been noticing more and more that reference is...Thu, 20 Nov 2008

 

Stars Gameday:CHI @ DAL
To answer your first question, no they won’t be there tonight. It’s been 5 days since you’ve last...Thu, 20 Nov 2008

 

Game 18 vs Boston - Disgusting
I am disgusted with this team right now. To play as sloppy as they are right now…I am throwing the whole team...Thu, 20 Nov 2008

 

Manchester Bound Clune Returns From IR
According the Rich Hammond of Inside The Kings, Kings forward Richard Clune who impressed many with his scrappy play...Wed, 19 Nov 2008

 

The worst is definately over.
Finally management knows it can only get better from here.  This is the advantage of being worst in the east...Wed, 19 Nov 2008

 

Thoughts…
- No surprise from anyone that Dustin Penner got benched by Craig MacTavish. The $4.25m man never lived up to...Wed, 19 Nov 2008

 

Stages of a Keeper League Team
For those of us in Keeper Leagues it is about this time of year that we begin to get a general feel for what direction...Wed, 19 Nov 2008

 

Player News - Some Bad, Some Good
Not a ton of exciting news out of El Segundo today but some noteworthy items, for better or worse. I guess I’ll...Wed, 19 Nov 2008

 

How Is The Finger Holding Up?
So far so good… sorta… kinda… The Leafs have a 5-7-0 record with Jeff Finger in the line up so far...Wed, 19 Nov 2008

 

Crombeen claimed by Blues
Ouch. That will help the Blues for years to come if they do it right. Crombeen is a good young player and I hate to see...Tue, 18 Nov 2008

 


Forum Posts

It's for any panthers.hockeyanalysis.com members... Damn!It's seems a spam. But! Did you ever been here...

If You want to delete your site from my base to: Admin - If You want to delete your site from my spam list, please sent url of your domain to...

It good site. I like cialis for orderbuy cialis genericbuy generic viagra[url=http://break.com/CheapCi...

world sex sex toy porn sex game sex indian sex    ...

Re: What players do you expect to see on the opening day roster? Quote from: Steve on September 01, 2008, 07:42:29 PMKulemin was a top line player for Metallurg...

Visit the Forums

Team Blogs

**Active Blogs


Other Blogs