Living in Bangladesh, we often tend to raise questions about the education that we receive from universities. The quality of instruction can certainly be taken as an issue, but if we look at professed educational institutes providing high quality education, what must we take as indicators of quality?
When it comes to comparing education providers, ranking is put forth as the indicator by almost all. It not only helps students to decide, but also helps universities as a tool for publicity and for attracting better funding and students. As I inched through every step of my higher education, ranking is what I often looked at while comparing two universities, their qualities, and research.
When it comes to ranking, it’s hard to decide the standards. No uniform standard exists for universities. Based on popularity, three ranking systems are prominent over others. The first and foremost is the Shanghai Academic Ranking of World Universities (ARWU) which was first established in 2003. It came into being as an idea to yardstick the top Chinese universities with universities in the United States. The idea was to stop the brain drain from China. The ranking is updated yearly and considers around 1,000 universities, of which the first 500 are ranked in the league table of the world’s top universities.
Now, how does it rank the universities? The ranking is based on absolute numbers like the number of alumni and staff winning Nobel prizes, the number of staff included in the lists of most highly cited researchers, and the number of papers published in prestigious journals. It only concerns research performance, and it is based on bibliometric assessment -- research performance is based on one central assumption: Scientists who have to say something important do indeed publish their findings vigorously in the open, international journal (serial) literature.
As a response to the ARWU ranking came along the second most popular ranking -- Times Higher Education World Universities Rankings (THE). THE can be considered a research-oriented ranking as well, and it is not size-dependent, based on both bibliometric (37%) and non-bibliometric indicators (reputation surveys on research and teaching 34.5%; income indicators 10.75%; importance of PhD studies 8.25%; internationalisation indicators 5%; and student to staff ratio accounting for 4.5%). The main purpose of this ranking is also to produce league tables of top universities, excluding graduate schools, and those that have not provided data.
The third most popular ranking is the Quacquarelli Symonds (QS) university ranking. The purpose is to produce university league tables. Its activities focus on over 2,000 international universities and business schools. It is similar to THE because it uses similar methodology and is based on both bibliometric and non-bibliometric indicators.
Other university rankings or classifications include, but are not limited to:
Taiwan Higher Education Accreditation and Evaluation Council University Ranking (HEAACT) which considers the 700 top universities for its overall university ranking and around 500 top universities for each subject field. EU U-Multirank, an EU-funded project which aims to respond to the main criticism moved towards the international rankings. Webometrics, which is based on the degree of visibility on the web. U-Map which is based on a number of indicators comparing universities that have similar profiles. SIR (SCImago Institutions Rankings) is grounded on research, innovation, and web visibility indicators.The ARWU system shows 32 universities out of 500 are from China, one is from India. No university from Bangladesh is listed in the ARWU, THE, and QS systems. Webometrics has a list of Bangladeshi universities where they ranked the universities based on four indicators -- impact, presence, openness, and excellence. It shows Shahjalal University of Science & Technology being on top, ranking 2,400 worldwide, followed by Bangladesh University of Engineering and Technology (2,709), BRAC University (2,712), and University of Dhaka (3,222).
Main rankings of the universities face a major criticism: International rankings only cover a very small percentage of the world’s around 17,000 universities, between 1%~10%. This means that the ranking cannot be considered an assessment of the quality of the academic institution, but simply a ranking producing global league tables. Then comes the question of making specialised field-related ranking. The most international rankings predominantly focus on indicators related to the research function of universities.
Measuring the quality of teaching and learning generally undertakes the use of proxies, often with a very indirect link to the teaching process, with the result that these rankings are rarely effective. The link to external stakeholders and environments are largely ignored, whereas reputational factors tend to have disproportional importance in many cases.
The bibliometric assessment faces criticism as well. Inappropriate design, improper calculation, and sloppy application of bibliometric indicators negatively influence the ranking. How the impact factor and citation is quantified, and peer reviewing process carried out, often raise questions. The quality of the technical system is a common set of problems. For example, citation error often changes the number of papers for a specific university, whether co-authors are counted or not, as pointed by researchers.
Then review papers tend to get more citations than a research paper in any specific field, meaning review papers will influence more on the ranking than research papers. A paper written in any other language will get less attention than one written in English.
There are attempts from university authorities and entities to boost respective university rankings. Most attempts do not focus on teaching quality (but do focus on research enrichments), rather on increasing citations and fame. Fame and citation increases ranking, ranking brings more funds/students, funds can be put into research, and thus the cycle goes on. All this is good. But one might ask what place the classroom/teaching quality has in all this. It is crucial that students understand what they are going after when they want to pursue higher studies.