The building of weak expertise: the work of global university rankers

Abstract

University rankers are the subject of much criticism, and yet they remain influential in the field of higher education. Drawing from a two-year field study of university ranking organizations, interviews with key correspondents in the sector, and an analysis of related documents, I introduce the concept of weak expertise. This kind of expertise is the result of a constantly negotiated balance between the relevance, reliability, and robustness of rankers' data and their relationships with their key readers and audiences. Building this expertise entails collecting robust data, presenting it in ways that are relevant to audiences, and engaging with critics. I show how one ranking organization, the Times Higher Education (THE), sought to maintain its legitimacy in the face of opposition from important stakeholders and how it sought to introduce a new "Innovation and Impact" ranking. The paper analyzes the strategies, methods, and particular practices that university rankers undertake to legitimate their knowledge-and is the first work to do so using insights gathered alongside the operations of one of the ranking agencies as well as from the rankings' conference circuit. Rather than assuming that all of these trust-building mechanisms have solidified the hold of the THE over its audience, they can be seen as signs of a constant struggle for influence over a skeptical audience.

Life below excellence: exploring the links between top-ranked universities and regional competitiveness

“…What makes a university 'excellent' is debatable (Lim, 2017). Assuming that excellence should be based on the university's presence in research rankings would probably lead to a discussion that lies beyond the scope of this study.…”

The Russian University Excellence Initiative: Is It Really Excellence that Is Promoted?

“…Having limited resources, many governments choose to support a very limited number of institutions in their efforts to improve performance and to enter the league of world-class universities. This method of preferential funding has some risks, including the inefficient use of resources and their suboptimal distribution between universities, and pursuing league table positions provided by non-reliable rankers (Lim et al 2017;Lim 2018) instead of building a high-quality research and educational environment (Salmi 2015). Despite the possible risks, the implementation of excellence programs is an acceptable way for developing countries to increase global competitiveness in creating, applying and spreading new ideas and technologies (Altbach and Salmi 2011).…”

Universities Under Pressure: the Impact of International University Rankings

“…Secondly, the lack of sampling procedure description used for the survey implies a high risk of bias. Finally, there are serious doubts about the expertise of the 'rankers' (Lim, 2017).…”