Yves Gingras, in his recent opinion article, argues against the general validity of academic rankings. He writes that they do not tell the whole story and should not be taken seriously by “well-educated academics.” This begs at least one question: What exactly should be taken seriously as we assess or scrutinize universities and colleges for their relative quality?
Yes, there’s no doubt that universities that get decent rankings often parade their high placement and may try to use it to their advantage. Why not? And, there’s also no doubt that universities with low rankings find ways to at least look good – a snazzy but friendly website is generally the way, along with a sloganized discourse (a.k.a. branding) that promotes great experience, great ambiance, a place that really cares, blah, blah, blah.
Sometimes gross hyperbole spills over from the communications consultants. For example, at my own institute – the University of Victoria, which is a pretty good place – the singular up-front claim on its home page promotes UVic as “Canada’s most extraordinary academic environment” that will “provide an Edge that can’t be found anywhere else.” Double sigh. The very best institutions, though, generally don’t need to promote too much beyond the obvious, though uncertain economic conditions over the last decade or so have sometimes brought out the worst of the best.
The undiscoverable or misleading truth about the quality of universities is actually not that hard to figure out, with or without those apparently anxiety-inducing rankings. Yes, there are all kinds of factors that can be statistically stirred into those formal assessments, like citations (or citation impact), peer review publications, student/faculty ratios, diversity, international research collaboration, research income, financial stability, patent filing and (the dreaded) reputation.
But let us boil it down to the obvious without these variously and at times arbitrarily weighed measures: better universities have better facilities (libraries, labs, classrooms, computing facilities, etc.), better faculty (check their credentials, the importance of their research, their Nobel Prizes), better students (acceptance rates are a very obvious indicator), better student support and even, yes, better administrators. Most of this should be fairly recognizable for “well-educated academics,” and even for prospective students, their parents and the public.
Maybe something else is lurking behind these apparent fears of rankings. In the academy, we don’t like to speak about the very obvious qualitative distance between the top and bottom academic institutes. We are, on the surface, basically polite and well-meaning sods. But, when speaking of other institutes, we can also be exceedingly defensive and, at moments, a little passive-aggressive. We don’t want to face the certain truths: that, for example, the vast majority of academically oriented PhDs are not good enough and will never be good enough to get a job at, say, Princeton; and the vast majority of students are not smart enough to get into Yale.
Would it really be a terrible thing to note that the University of Toronto, for example, is much better than any number of medium-sized, regional universities when it seems to be perfectly obvious, ranking system or not? Hard work is not the same as excellent work; participation is not the same as performance; and limitations are often limitations, no matter what dream you follow.
Let’s be honest here: not everyone is good enough to play for the Montreal Canadiens, no matter how hard they try; not everyone can hit a 90-m.p.h. curve ball; not everyone can write a discipline-changing book or think of and carry out a ground-breaking study; and not everyone is a brilliant communicator or teacher.
The ranking systems are not perfect, but neither are they, as Professor Gingras writes, fully “illusory.” It is not hard to figure which are the superior schools, and these places almost always appear toward the top of most ranking systems, despite their diverse and at times quirky methodologies.
I confess I have not read Professor Gingas’ new book about research evaluation, published by the press of MIT, which is clearly one of the top universities in the world, and the rankings say so. Presumably he knew something about its quality as an elite university and the advantages of being associated with it.
Kim Blank is a professor of English at the University of Victoria.