Combining RPI Philosophy With Efficiency Rankings, With a Bracket Projection
I have industriously criticized the RPI in the last week, and since then, there has been plenty of good discussion on the topic. Matt Norlander had this post on how to rank teams, combining several rankings systems. Seth Davis joined Norlander on the CBS podcast to discuss the RPI among other things, after writing about the RPI earlier in the week. Oh, and of course, there was John Gasaway’s tremendous piece on the history of the RPI and the man who developed it.
I thought Gasaway had a great observation.
The paradox of Van Valkenburg’s handiwork is that by formulating a metric that eschews any knowledge whatsoever of points scored, he in fact created the perfect conditions under which scoring margin, adjusted for strength of schedule, could and has become a surpassingly powerful evaluative tool. But those of us who use that tool should acknowledge the analytic free ride we’ve been given, courtesy of Van Valkenburg. The stats we’re able to deploy in 2012 are great at evaluating teams — but the only teams we’ve ever been able to evaluate have been ones striving to look good to Jim Van Valkenburg, and not to us.
One of the criticisms offered by RPI proponents is that accounting for margin of victory encourages running up the score. While I think this is largely overstated as a sportsmanship concern, and the true opportunities to “run up the score” are few and far between once we get past the largely disparate matchups early in the non-conference, it is true that teams are not incentivized to maintain the level of their leads late. Teams optimize winning, whereas if they knew margin matters, they may work harder to maintain that 18 point lead late, rather than put in the walk-on with 90 seconds left.
I’ve got a proposal, though, that would maintain that “striving to look good to Van Valkenburg” motive, while still accounting for scoring margin. I personally don’t believe that we should just select teams based on efficiency stats or scoring margin. Teams that win key games should be rewarded, even if our efficiency numbers say they should be a few slots below the team they beat.
My issue with the RPI is that it is a bad system for measuring which wins were actually quality. As I said previously, it’s like the whisper game, and you’re looking several iterations down to determine what is a good win. And despite what the committee says, wins over Top 20, Top 50, etc. RPI teams matter.
So my proposal is this. Use the efficiency stats, and much like Norlander’s post above, use as many quality ones as possible to minimize outliers. Then use those rankings, and not the RPI, to determine which wins are good, which losses are bad, and everywhere in between. The result is that the teams that are seeded higher than their efficiency rankings will have earned those spots by proving they can beat the best teams, and not through some three-level shell game.
Because my industriousness is overrated, I only looked at the Pomeroy ratings for this project, but I went through and assigned points for wins, and negative points for losses. Points were assigned in an exponential fashion, so that Kentucky was worth more than a win over Missouri, while teams ranked 60th and 75th would be worth basically the same for a win, and any win against a team ranked below #230 was lumped together for tournament teams, and largely worthless. Similarly, bad losses were way more costly.
The specific weights I used could certainly be adjusted to reflect whatever value (Elite Wins, Avoiding Bad Losses, etc) you wanted to emphasis, and it would probably move teams a seed line or two. However, I think these reflect a pretty good bracket, and it combines efficiency and actual wins and avoiding bad losses. The teams don’t have an incentive to run up scores despite the use of efficiency stats. Running up the score would only benefit your future opponents, not you.
So what does this week’s bracket look like, with our RPI-like emphasis on key wins and avoiding bad losses, laid over Pomeroy’s efficiency numbers? Here it is. This is a straight bracket using the results this year, and from their you could make adjustments, like Illinois’ recent poor form dropping them out, New Mexico’s early bad loss counting for less and bumping them up, or moving numerous teams slightly with personnel changes or injuries. The CAA should like this method, by the way, because it says that both VCU and Drexel should be in the running for at-large spots despite the conference’s low RPI standing.
#1 seeds: Kentucky*, Syracuse*, Michigan State*, Duke*
#2 seeds: Kansas*, Missouri, North Carolina, Ohio State
#3 seeds: Michigan, Baylor, Indiana, Marquette
#4 seeds: Murray State*, Temple*, Wichita State*, Louisville
#5 seeds: Wisconsin, Georgetown, Florida, UNLV*
#6 seeds: Kansas State, Creighton, Florida State, San Diego State
#7 seeds: Middle Tennessee State*, New Mexico, Harvard*, Virginia
#8 seeds: Gonzaga*, Notre Dame, St. Louis, California*
#9 seeds: Iowa State, St. Mary’s, Southern Miss, Vanderbilt
#10 seeds: Memphis*, Oral Roberts*, Purdue, Drexel*
#11 seeds: BYU, Virginia Commonwealth, Seton Hall, Washington
#12 seeds: Alabama, Illinois, Oregon, Cincinnati
#13 seeds: Iona*, Mississippi State, Connecticut versus Northwestern, Texas versus NC State
#14 seeds: Belmont*, Davidson*, Long Beach State*, Nevada*
#15 seeds: Akron*, Cleveland State*, Bucknell*, Wagner*
#16 seeds: Norfolk State*, Weber State*, Vermont*+, UNC-Asheville*+, UT-Arlington*+, Miss. Valley State*+
LAST 6 AT-LARGES OUT: Minnesota, West Virginia, Arizona, Colorado State, Xavier, Miami-FL
[photo via Getty]

- Riddick Bowe Promoted His Unsuccessful Muay Thai Debut By Allowing Monkeys to Climb All Over Him in Thailand
- New Zealand High School Rugby Player With the Most Vicious Hit of the Decade [Painful Video and Gif]
- Mario Balotelli Scores Goal, Kicks Own Shoes, Shouts Out Drake; All in a Day’s Work
- The 2013 MLB All-Star Game Batting Practice Jerseys Can be Yours for the Low, Low Price of $99.99
- Manu Ginobili’s Bald Spot Disappears After One Magical Swipe From Tim Duncan [GIF]

- Shining Base Path on MLB At-Bat Music: Ballplayers Love Drake, Pitbull, Metallica and 90s Hip Hop Jams
- scripty on New Zealand High School Rugby Player With the Most Vicious Hit of the Decade [Painful Video and Gif]
- scripty on Riddick Bowe Promoted His Unsuccessful Muay Thai Debut By Allowing Monkeys to Climb All Over Him in Thailand
- TonyToniTone Has Done It Again on MLB At-Bat Music: Ballplayers Love Drake, Pitbull, Metallica and 90s Hip Hop Jams
- TheRealAC on New Zealand High School Rugby Player With the Most Vicious Hit of the Decade [Painful Video and Gif]
51 Responses to “Combining RPI Philosophy With Efficiency Rankings, With a Bracket Projection”
Leave a Reply
You must be logged in to post a comment.






February 24th, 2012 at 3:35 PM
+1 shots fired
February 24th, 2012 at 3:37 PM
Can we change one of the letters and remove the asterisk? I don’t think Illinois is making the tournament, either.
Go Heels.
+1 franchised Dwayne Bowe and re-signed Brandon Carr
February 24th, 2012 at 3:39 PM
SHOTS FIRED!!
/ducks
//not really
February 24th, 2012 at 3:40 PM
Because my industriousness is overrated
Jason, your family is calling. I think the meatloaf got cold again.
BTW, #4 Murray State vs #13 Mississippi State reeks of upset.
February 24th, 2012 at 3:40 PM
The last 2 posts are like your iPod going from Justin Beiber to Puccini.
February 24th, 2012 at 3:41 PM
kinda how the committee tryies extra hard to underseed someone at 12 each year.
February 24th, 2012 at 3:43 PM
If OSU’s a 2 seed, it would be great to be in Duke’s region.
February 24th, 2012 at 3:46 PM
tryies?
February 24th, 2012 at 3:47 PM
Feel bad for whoever gets UW in the first round.
February 24th, 2012 at 3:47 PM
Great post, by the way.
February 24th, 2012 at 3:47 PM
How happy would you be in you were the 6 seed paired with Indiana as the 3? What a gift.
February 24th, 2012 at 3:47 PM
They fucking blew it against Maryland. Never should have lost that game, even with Reggie JOhnson hurt.
/small gripe but I hate people adding the (FL) to Miami. If the other MIami ever manages to do something athletic of note outside of ice hockey, then add the state abbrev.
February 24th, 2012 at 3:48 PM
tryies?
No tryies, no takebacks
February 24th, 2012 at 3:49 PM
Grey peen.
February 24th, 2012 at 3:49 PM
If the other MIami ever manages to do something athletic of note outside of ice hockey, then add the state abbrev.
I take it you are not DTF?
February 24th, 2012 at 3:50 PM
/small gripe but I hate people adding the (FL) to Miami. If the other MIami ever manages to do something athletic of note outside of ice hockey, then add the state abbrev.
Until QB’s from Miami-FL have more RINGSSS than QB’s from Miami-OH, your point is not conceded.
February 24th, 2012 at 3:52 PM
BTW, #4 Murray State vs #13 Mississippi State reeks of upset.
kinda how the committee tryies extra hard to underseed someone at 12 each year.
Iowa State or St. Mary’s are the clubhouse leaders
February 24th, 2012 at 3:52 PM
Stop with the Big East projections! Connecticut??? below .500 in the conference and a shell, A SHELL, of itself from last year. If your gonna put UConn in, you might as well add SoFla, which has a better conf. record.
February 24th, 2012 at 3:52 PM
As in Murray winning? Because I am 100% certain that Miss.State would be favored in that game. In fact, I am 100% certain that Murray is likely to be an underdog in their 1st game as a 4 or 5 seed.
February 24th, 2012 at 3:52 PM
I don’t think Illinois is making the tournament, either.
I don’t either because they have imploded. If you line up their results, though, and disregard order, they are in. Almost all teams seeded below 9 above lack great wins. Illinois, meanwhile, has wins against Ohio State and Michigan State
February 24th, 2012 at 3:53 PM
Cap Rooney signal(!): http://moms.today.msnbc.msn.com/_news/2012/02/24/10498893-teen-girls-ask-the-internet-am-i-ugly
February 24th, 2012 at 3:54 PM
What about SB appearances?
/pours one out for Machine Gun Kelly
February 24th, 2012 at 3:54 PM
Good point, Lisk. I think Iowa will beat them this weekend though. In fact, if the Hawkeyes win out and capture a B1G tournament game, they’ve got just as good a chance as Illinois. Wins over UM and twice over UW.
February 24th, 2012 at 3:54 PM
As in Murray winning? Because I am 100% certain that Miss.State would be favored in that game. In fact, I am 100% certain that Murray is likely to be an underdog in their 1st game as a 4 or 5 seed.
Mississippi State has lost to some bad teams this year. I suspect it would be a pick em. I would favor Murray State slightly. I think State is one of the few that are ranked below Murray in kenpom.
February 24th, 2012 at 3:54 PM
Miami(OH) Rapists vs. Miami(FL) Cokeheads. My money’s on the boys from the South.
February 24th, 2012 at 3:56 PM
BTW, #4 Murray State vs #13 Mississippi State reeks of upset.
As in Murray winning? Because I am 100% certain that Miss.State would be favored in that game. In fact, I am 100% certain that Murray is likely to be an underdog in their 1st game as a 4 or 5 seed.
That was my point. #4 should be favored over #13 but if you put those teams together, Miss State winning shouldn’t be called an upset (though it will be).
February 24th, 2012 at 3:57 PM
Craig James and more Craig James.
February 24th, 2012 at 3:59 PM
I should have also pointed out that because I was using a points system laid over efficiency rankings, the Big Conference Teams that add quality wins in the conference tourney will get a boost, moving around teams like Murray State.
Personally, I think Murray State will get about a #6 seed if they don’t lose again, after the St. Mary’s win offset the loss. If they get upset again, I could see them dropping to an 8 or 9.
February 24th, 2012 at 4:00 PM
Craig James and more Craig James.
I bet it doesn’t get to 3,000 comments
February 24th, 2012 at 4:01 PM
What if Murray State didn’t lose that game? Then what kind of pickle is the committee in? #2 seed?
February 24th, 2012 at 4:01 PM
That was my point. #4 should be favored over #13 but if you put those teams together, Miss State winning shouldn’t be called an upset (though it will be).
a couple of things:
1) the final at-larges will be #12 seeds once the conference tourney results roll in and “shrink the bubble”
2) having a 12/5 matchup where the game is close to a pick em isn’t all that uncommon. It happens a lot. I’m not sure the last one where a 12 has been favored, but it happens, or at least having a line with 1 or 2 happens.
February 24th, 2012 at 4:02 PM
Those comments are embarrassing — most of them would have been laughed out of the post
February 24th, 2012 at 4:04 PM
1) the final at-larges will be #12 seeds once the conference tourney results roll in and “shrink the bubble”
2) having a 12/5 matchup where the game is close to a pick em isn’t all that uncommon. It happens a lot. I’m not sure the last one where a 12 has been favored, but it happens, or at least having a line with 1 or 2 happens.
And isn’t that the ultimate work of the Committee – to set the most even field of 64/68 possible?
February 24th, 2012 at 4:05 PM
I think an undefeated Murray was headed for a #3. My guess if they don’t lose again is a #5, but Lisk’s prediction of a #6 wouldn’t surprise me.
February 24th, 2012 at 4:08 PM
lisk…does it ever occur to you that you’re wasting your time with this nonsense? all this research, all this work…all for setting a bracket that’s just as controversial as the BCS only for it to mean nothing when a team that didn’t live up to its potential all year can get on a hot streak and render all this effort meaningless.
February 24th, 2012 at 4:09 PM
Spencer is SO HIGH right now.
February 24th, 2012 at 4:09 PM
I saw a bracket post and thought we’d be talking Accenture Match Play!!!
February 24th, 2012 at 4:11 PM
How would you go about taking weed to Hawaii? Just assume you can score some out there?
February 24th, 2012 at 4:12 PM
Nick Watney’s RPI is drastically affected by his choice of putter.
February 24th, 2012 at 4:16 PM
My buddy went to Hungary for work and found a bag of weed in his jacket pocket when he got home. Which means he took it through security/customs. Twice.
February 24th, 2012 at 4:16 PM
seriously, you’re in fucking hawaii!
February 24th, 2012 at 4:16 PM
*GASP*
February 24th, 2012 at 4:18 PM
miz, what do you think we need to do to “fix” this and everything else in sports?
February 24th, 2012 at 4:20 PM
lisk…does it ever occur to you that you’re wasting your time with this nonsense? all this research, all this work…all for setting a bracket that’s just as controversial as the BCS only for it to mean nothing when a team that didn’t live up to its potential all year can get on a hot streak and render all this effort meaningless.
I used to waste my time doing this in the margins during Physiology class. Now, I get paid to do it. In retrospect, it was my Biology degree that was the waste of time.
February 24th, 2012 at 4:22 PM
Thanks for the link love, Lisk. Continually great work done by you over here; would love to get you on the pod to discuss this and other things in March.
I like the look of this. The key to remember in all this RPI banter is that it’s not the final few teams that are the issue. The NCAA continually botches seeding, and that can have profound effects on the bracket. Many float toward talking about teams 66 through 68, 69 and 70. But making sure that four seed is labeled as such, and not a miscalculated to a six seed, is paramount to bracket integrity. It’ll never be perfect, but we can keep tweaking and stop relying on a system that would be laughed out of the room if it was introduced in 2012. Instead, the RPI’s been around more than 30 years, and so the NCAA values it like a kid’s first baseball mitt.
As an aside, I can’t believe I remembered the password TBL assigned me to this joint more than four years ago.
February 24th, 2012 at 4:23 PM
fair enough…and didn’t mean to call your work “nonsense.” i just hate the patronizing celebration of the underdog that the tournament represents.
February 24th, 2012 at 4:23 PM
leave it the fuck alone.
February 24th, 2012 at 4:24 PM
well, it also celebrates chokers.
February 24th, 2012 at 4:26 PM
In retrospect, it was my Biology degree that was the waste of time.
/high fives
Did you get the Minor in Chemistry as well?
February 24th, 2012 at 4:56 PM
Good to see Norlander in the house!
February 24th, 2012 at 5:59 PM
Ohio sucks.