Lee Hwok-Aun proposes a sober and balanced consideration of all the available rankings instruments.
Malaysia’s universities have been told not to obsess over international university rankings.
But every time QS, the popular and highly commercialised rankings operator, releases new listings, we embrace and applaud the result as though the esteem and purpose of our universities depend on it.
The Malaysian Academic Movement (Gerak) firmly believes that our universities must not be obsessed with rankings. Our institutions of higher learning serve higher purposes than our performance according to QS.
We strongly urge the government and all university administrations to define for ourselves the meaning and measurement of excellence in research, teaching and contribution to public knowledge and national development.
- Sign up for Aliran's free daily email updates or weekly newsletters or both
- Make a one-off donation to Persatuan Aliran Kesedaran Negara, CIMB a/c 8004240948
- Make a pledge or schedule an auto donation to Aliran every month or every quarter
- Become an Aliran member
We acknowledge the dilemmas the government and university administrations face now that the system is neck-deep in the rankings system. Moving up in the rankings provides a simple and tangible validation.
No leader wants to see their institution’s international position drop on their watch, and many in the academic community are inclined to celebrate upward movements.
Even Education Minister Maszlee Malik, who issued the directive to not obsess over the rankings, cannot resist. QS just announced that Malaysian universities have moved up the Asia list – especially the University of Malaya, which is now regarded as 13th best in the continent. Maszlee had to applaud this news.
Earlier this year, the University of Malaya’s arrival at 70th in the world and other institutions’ best showings triggered widespread self-congratulation.
Have we stopped the obsession? Emphatically no! But playing the rankings game comes at a cost.
Under the Pakatan Harapan government, the key performance indicators (KPIs) of academic work remain substantially dictated by the metrics of university rankings.
It is a numbers game because only quantifiable outputs matter in the points system, which determines whether one institution is greater than the next. To rank well, score high. With “soaring up” – the mantra of Idris Jusoh of the former regime – evidently echoing in the background.
Many “best researcher” rewards nowadays robotically defer to computer-generated scores of the number of publications and citations – key criteria of the rankings, of course – instead of recognising work that is original, path-breaking and nationally important.
Research outputs overwhelmingly trump excellence in teaching and contribution to public knowledge and national development, which may not translate into high citations and other points that boost rankings.
The heavy weighting of volume publication and citation leads to the pursuit of quantity over quality, popularity over originality and a proclivity for easy research subjects over more challenging ones.
Worst of all, academic dishonesty has become entrenched with rampant practices of free-riding co-authorship, plagiarism and cosmetic citation (you cite me, I cite you, we both inflate our citation stats). Participating in international rankings is not the only cause, but obsessing over the rankings is clearly a major contributing factor.
So, how do we stop obsessing?
First, we must show resolve and autonomy and exercise discipline in setting policies and reward schemes that are not dictated by the rankings scheme. Of course, universities must promote research and publication, but emphasise, recognise and reward originality, honesty and significant contribution to public knowledge and nation-building priorities.
Malaysia must critically revisit academic work conditions, addressing concerns that we widely observe concerning bureaucratic overload (because of various factors, not just the rankings), KPI pressure that prizes quantity over quality, and demoralisation at the reality that those who game the system reap the rewards.
We can set the agenda independently and make steady gains in the rankings – which can remain a reference point but not the defining pursuit. Who knows how long this rankings business will survive, anyway? Why hitch our long-term plans to it?
Second, we must not accept the rankings at face value, but critically examine whether the improved rankings are in line with Malaysia’s policy priorities.
Analysing the QS data
The QS data can be useful when appropriately analysed. A brief unpacking of the components of the University of Malaya’s scores in recent years is instructive. The university has shot up in the rankings from 146th in 2016 to an admirable 70th in 2020.
However, its overall score, a weighted average of the six components (shown in Figures 1 and 2) only slightly increased over that period (black line). In other words, the university’s rankings improvement was largely due to other universities progressing poorly in their scores.
When we probe further, we also observe that the university improved most in the “gameable” components of citations and reputation.
Reputation scores derive from QS’ surveys (Figure 1).
Academics cannot appraise their own institution, but nothing stops them from singing high praises of their counterparts. In the 2018/2019 round, Malaysia-based survey participants comprised 4.6% of QS’s global responses.
In the components based on empirical data – faculty-student ratio, international faculty and international students – the University of Malaya’s scores have actually been declining (Figure 2).
Next, we look at QS subject rankings, where the university has celebrated stellar successes in breaching the world’s top 50. Well, that stopped in 2017.
We have been hearing less of UM’s subject rankings in the past two years – and only applause at the overall ranking – because it has been falling, quite steeply, in the subject rankings of its supposed flagship departments.
Electronic and electrical engineering, the darling in 2017 when it shot up to 23rd in the world, slipped to 47th in 2019 (Figure 3).
Development studies also peaked in 2017, touching 26th, but has steadily declined since then (Figure 4).
In sum, the University of Malaya has progressed in areas where its scores can be manipulated and regressed in internationalisation. It has also witnessed all its flagship subject areas fall in the rankings since 2017.
Amidst all this, the university has kept climbing up the overall rankings. These are troubling signs that should make us pause and reflect.
Third, we must resist the temptation to measure and reward success based on the rankings. It is too easy, and as we have found above, deeply flawed.
Can Malaysia extricate itself from the QS universe?
We appreciate that withdrawing Malaysia’s participation in the rankings is a difficult political undertaking. But there is still much we can do that is within our control.
The education minister should issue a moratorium on press releases in response to QS reports and urge universities to follow suit.
We also need to address critically and decisively whether to continue investing so much in the QS system specifically, which, as we have shown above, is highly problematic.
Gerak proposes a sober and balanced consideration of all the available rankings instruments.
Malaysia’s progress in the rankings should be evaluated – in a critical and rigorous manner worthy of academia – every three to five years instead of the current practice of superficial and annual tracking. An immediate step can be to stop jumping at every QS press release, which the profit-seeking company spaces out through the year.
There are many ways to stop the obsession with university rankings. It is time to walk the talk.
Dr Lee Hwok-Aun is a member of the Malaysian Academic Movement (Gerak).
AGENDA RAKYAT - Lima perkara utama
- Tegakkan maruah serta kualiti kehidupan rakyat
- Galakkan pembangunan saksama, lestari serta tangani krisis alam sekitar
- Raikan kerencaman dan keterangkuman
- Selamatkan demokrasi dan angkatkan keluhuran undang-undang
- Lawan rasuah dan kronisme
As a (now retired) Malaysian academic, I care little about my university ranking, which is almost completely influenced by all sorts of factors beyond my control. But I do care about my citations, or whether other scholars find my work interesting or useful to them. I disagree that “heavy weighting of … citations leads to the pursuit of quantity over quality, popularity over originality…” I think the exact opposite is the case, i.e. quality or original publications are more likely to be cited.