If your ranking doesn't show Harvard and MIT near the top, it is wrong. If your corruption index doesn't show Scandinavia and Western Europe above Africa and South America, it is wrong.
If it's wrong, people will not want to read it. If you do an "objective" ranking and it doesn't quite say what you expected, you need to weight things differently, so that your ranking has credibility.
At best you can do a bit of massage to show that you are actually doing something when compiling these rankings, and you might be able to highlight a few trends. But in the end, if you are not showing the usual suspects in the usual places, people will not believe you.
Reputation, at the end of the day, moves slowly.
Our city has a school choice program that includes a portal where you can look up these kinds of quantitative measures, and I think I agree with him. Tiger parents slosh from school to school as they chase after rankings, and, much like ill-contained liquid cargo in ships, all that motion tends to destabilize and capsize schools.
Sadly, I don't think smaller higher education institutions can afford to take such a relaxed attitude about it. They don't get to have an enrollment backstop in the form of a semi-captive audience of parents who live nearby and aren't hyperactive enough to commit to spending upwards of an hour every weekday trucking their kids back and forth across town.
>Measure the proportion of graduates who pursue and are accepted into advanced degree programs. (adjusted for field of study so acceptance into medical school > masters in art history)
The only reason, however, that medical school is more competitive than an art history masters (to be fair, most paid masters programs aren't super competitive) is because the medical board has set up the system of accreditation to limit the number of practising doctors in the US in order to artificially inflate the salaries of doctors. The UK, for instance, has the opposite problem, where becoming a doctor is much easier, but for that very reason their pay is relatively low and the job is increasingly undesirable (not to mention cuts to the NHS).
This is all to say that, in just this instance, the author falls prey to precisely the same mystification that he is criticizing, by seeing something as "better" just because its more exclusive.
I do think it's a bit difficult to separate reputation from educational quality. Educational quality is affected by professors, facilities, research opportunities, etc, but these factors are saturated at a lot of research universities. Another factor of educational quality is the peer group, and in this sense reputation matters a lot. There's an "if you build it, they will come" circularity here, where if you have a good reputation, you will attract students who will burnish your reputation. Conversely institutions can get stuck in a loop of low reputation and marginal students.
If however, you are armed with the knowledge that the non-circular components of education quality are saturated at, say, the top 50 universities in the US, well that opens some doors. You can rest easy that your flagship land grant university honors program is giving you the same education you'd receive at an Ivy League school.
Personally I think student debt load and chosen major matter way more than which school you go to.
As someone who just played the college admissions game last year, these (US News) rankings pretty accurately reflect the *perceptions* of the general, college applying, public (or maybe they are the source of those perceptions). They aren't really even good at that outside the T10.
All of the above applies tenfold for foreign students coming to prestigious US universities, as they pay exorbitant sums to get the name recognition, creating all sorts of weird incentives.
As someone who went to a somewhat prestigious university (Vanderbilt), fingers crossed we nationalize the whole system sometime soon... I think we can all agree that focusing on football, campus amenities, and marketing aren't where these billions should be going. Vanderbilt, to their credit, gamed the rankings a ~decade ago by offering to meet 100% of student's government-determined financial need with grants, which is probably the best outcome possible of this weird system.
But too many families have been convinced that rankings like this are useful so now the institutions have little choice but to become complicit in the ridiculous system or have their enrollment decimated and be unable to pay its bills.