Michigan State, Texas, and that Dumb Old Simple Rating System
In what universe was Texas a better team than Michigan State last year? Obviously not the one where people watched games with their eyeballs. Everyone, particularly those with an area code in the Eastern Michigan area, know that can’t be right. The Simple Rating System– a system that just uses point differentials and strength of schedule and doesn’t give any bonuses for wins and losses beyond point difference–though, had Texas higher than Michigan State last year.
The thing about the simple rating system is that it is a predictive measure. Nothing’s perfect, by the way, in that regard, and if you find it, shoot me an email and we’ll split the profits. In college, there are fewer games, less interconnectivity between conferences, and the rosters churn quite a bit each season. As a result, one blowout, and some skewed non-conference results that may not represent the average performance, can make it very approximate.
Still, what of the teams like Texas and Michigan State, where we have the underachiever and the team that just knows how to win. They are ranked very similarly in the AP Poll this year, Michigan State at #13 just ahead of Texas #15. What if we looked at teams that fit each profile?
I looked at all teams since 1998 where the ranking in the final AP Poll and in the final SRS rankings were disparate. Most, as it turns out, are pretty close and the two rankings match up. I found all teams that were ranked at least 5 spots higher in one of the two systems, and had at least 3 points difference between where they ranked in SRS and where the team with the same AP ranking finished in SRS. (I did this to measure magnitude, the difference between being #16 and #25 may not be as large as #2 and #8).
Then, I looked at the next year for all teams in those groups who were ranked in the next year’s preseason Top 25 poll, to compare how they finished a year later. Here are the SRS Stars (like Texas) versus the Ranking Stars (like Michigan State).
By way of explanation, “similar” means the team finished within 3 spots of their preseason rank in the AP poll, slightly better/worse means within 4 to 8 spots, way better or worse were those teams finishing 9 to 15 spots different from their ranking, and Booms/Bombs were the ones who were at least 16 spots different. For example, a team that was preseason #4 but finished #22 would be a Bomb.
The SRS stars prevailed. More likely to have a way better ranking, with 3 versus 0. Far less likely to bomb, with 3 vs 8. It’s not perfect by any means, but it does mean something. Michigan State last year was one of the “slightly betters”, so maybe they can do it again. I’m skeptical, of course, that the 8-1 record in close games over the last two years will continue.
[photo via US Presswire]

- LeBron James and Michael Jordan Have Now Been Compared to God by NBA Players
- Champions League Final: Manuel Neuer’s Save is Your First-Half Highlight [Video]
- Adam Scott and Other Golfers are Retaining Counsel in Response to the USGA Anchor Putter Ban
- The Combination of Two Teams From Same Country Hasn’t Produced the Best Champions League Finals [Video Rewind]
- Will Smith & DJ Jazzy Jeff Sang the Fresh Prince Song and Alfonso Ribeiro Danced on the Graham Norton Show

- Nebomatic on Champions League Final: Manuel Neuer's Save is Your First-Half Highlight [Video]
- Monster is Meth on Champions League Final: Manuel Neuer's Save is Your First-Half Highlight [Video]
- BR1407 on Champions League Final: Manuel Neuer's Save is Your First-Half Highlight [Video]
- Monster is Meth on Adam Scott and Other Golfers are Retaining Counsel in Response to the USGA Anchor Putter Ban
- Nada on Adam Scott and Other Golfers are Retaining Counsel in Response to the USGA Anchor Putter Ban
7 Responses to “Michigan State, Texas, and that Dumb Old Simple Rating System”
Leave a Reply
You must be logged in to post a comment.







September 1st, 2012 at 4:37 PM
was SRS that poll ranking thing Duffy swore by?
September 1st, 2012 at 4:42 PM
I’m hoping by Week 5, MSU’s receivers will still suck.
September 1st, 2012 at 4:51 PM
Can you explain exactly what this means? The way I understand it, SRS is predictive only within a given season. So, having Texas ranked ahead of Michigan State at the end of last year means that the system thinks the 2011 Texas team was slightly better than the 2011 Michigan State team. And if they were to play 100 times Texas would win 52 (or whatever).
Which, fine. It is sure difficult to believe that based on my eyeball test from last season, but generally I like the idea of using different metrics to determine quality even if, as you say, nothing is or will ever be perfect.
The problem I’m having is I just don’t understand what the likelihood that Michigan State will drop off THIS year, and Texas might be better than them this year, has to do with justifying last year’s end of season rankings. But maybe I’m just misunderstanding what it means to be a predictive system.
September 1st, 2012 at 4:57 PM
William and Mary is beating Maryland 6-0 in the 3rd. Here’s a place where you can jump to conclusions and say that Randy Edsall is fucked.
September 1st, 2012 at 4:58 PM
SRS is of no help when comparing between seasons.
September 1st, 2012 at 6:57 PM
I’m weighing both sides on this one. The Duffster made me aware of this at THE END of last season. I was/am against it.
We’ll see how the season plays out. If nothing else, it is yet another meaningless ranking system. But how meaningless? Time will tell.
September 23rd, 2012 at 11:19 AM
SRS is of no help when comparing between seasons.
This is of course false. The year to year SRS correlation is higher than W/L record year to year, and certainly more than random guessing.