Re: 2010-2011 Rutter DI Computer Rankings Thread
Having followed these rankings over the years, it's pretty clear to me that RPI tends to suggests more parity between conferences than other statistical methods would suggest. To the extent that ARM observes they tend converge, it's only true because there has been more conference parity in the past recent years than this year.
For example, I can recall in the middle of last decade, some years where the men's WCHA was strong enough in the KRACH to get almost of its teams in the top 20, above the top ECAC team (I may be slightly exaggerating). But you wouldn't have known it from the RPI.
A good example from Women's hockey is that 2005 Wisconsin team that was 3rd in all the polls and KRACH but 5th in the Pairwise (and I believe also RPI).
That said, as Lakersfan suggests, we don't always have enough data points to make a strong conclusion about the relative strength of conferences. The RPI then tends to give teams with good records from weaker conferences more of a benefit of the doubt. I suspect this is one reason why you'll never see a superior statistical system adopted.
Usually, we see these two tighten up as the season progresses. As some WCHA teams are running out of non-conference games, I'm not sure if they will line up or not. The key differences at this point are Minnesota, BSU, BU, and BC, because those are the rankings where one has a team in an 8-team field, the other has them on the outside. With 20 games to go, it is likely that there will be at most a couple of teams that would receive a different in/out fate with a different NCAA ranking system.
Having followed these rankings over the years, it's pretty clear to me that RPI tends to suggests more parity between conferences than other statistical methods would suggest. To the extent that ARM observes they tend converge, it's only true because there has been more conference parity in the past recent years than this year.
For example, I can recall in the middle of last decade, some years where the men's WCHA was strong enough in the KRACH to get almost of its teams in the top 20, above the top ECAC team (I may be slightly exaggerating). But you wouldn't have known it from the RPI.
A good example from Women's hockey is that 2005 Wisconsin team that was 3rd in all the polls and KRACH but 5th in the Pairwise (and I believe also RPI).
That said, as Lakersfan suggests, we don't always have enough data points to make a strong conclusion about the relative strength of conferences. The RPI then tends to give teams with good records from weaker conferences more of a benefit of the doubt. I suspect this is one reason why you'll never see a superior statistical system adopted.