EurActiv Logo
EU news & policy debates
- across languages -
Click here for EU news »
EurActiv.com Network

BROWSE ALL SECTIONS

Experts warn of university rankings bias as EU prepares new table

Printer-friendly version
Send by email
Published 12 July 2013, updated 19 July 2013

To boost the global standing of EU universities, the European Commission has pegged in its higher education strategy a new form of university listing, which analysts say may overturn the US “elite” bias of current commercial rankings.

The strategy, released yesterday (11 July), aims to ensure that European graduates gain the skills they need to work anywhere in the world and that Europe keep its place as a preferred destination for international students.

Europe currently attracts around 45% of all international students but with China, India and other major economies increasing investment in higher education, the branding of EU universities is key.

Currently, students can select from a number of different university ranking systems, with UK-based Times Higher Education, QS and China’s rival Shanghai Index being three of the more well known.

Frustrated with current university rankings - mostly commercial ventures that give greatest importance to research - the European Union is backing a new form of listing.

U-Multirank, a €2 million-plus EU-funded initiative led by Germany’s Centre for Higher Education and the Netherlands’ Centre for Higher Education Policy Studies, aims to offer prospective students and employers a more nuanced and user-friendly guide to universities than a simple one to 100 list.

The European Commission says that over 700 universities have signed up to U-Multirank, which will promote them according to a broader range of factors than traditional rankings, including  quality of teaching and learning, success in knowledge transfer to the workplace and international orientation, as well as reputation for research (see background).

“By increasing transparency of the profiles of European HEIs [Higher Education Institutions], it will facilitate the ‘matching’ of needs for potential international learners or researchers, and thereby help boost the attractiveness of a broader number of European HEIs,” says the communication, which EU leaders and the European Parliament will discuss over the coming months.

The Commission has also invited universities from outside Europe to participate in U-multirank.

'Elite' reputation

Ellen Hazelkorn, a higher education researcher at Ireland’s Dublin Institute of Technology, sees the need for new ranking systems as reputation built up in current listings is self-reinforcing.

“Part of the problem with the rankings … not the Shanghai, but the Times and the QS, is that they measure reputation and reputation is cyclical and it’s not possible to know that there are in fact very many good universities,” she told EurActiv.

Hazelkorn is a lead author of a recent UNESCO and Organisation for Economic Co-operation and Development report on university rankings, ‘Rankings and Accountability in Higher Education: Uses and Misuses’. She thinks part of the Commission’s aim is to boost the profile of universities outside the traditional US elite, whose huge sources of funding permit the kind of depth of research that current rankings favour.

While there are an estimated 16,000 higher education institutions worldwide, current rankings only focus on a select 100 or 200 universities and regularly choose a top ten that are based exclusively in the Anglophone world, mostly the United States.

“It’s not surprising that the universities that are high on the rankings are ones that are the oldest and the most well-endowed. Yes, we have the Oxfords and the Cambridges but most of them tend to be US privates,” Hazelkorn said. “It’s a huge issue across Europe, which is why the European Union is sponsoring this new Multirank in an attempt to present a different view or a different way.”

Part of the motivation for the new listings is also what the Commission views as the under-representation of mainland European universities in current listings.

If used incorrectly, university rankings may also increase societal inequality and affect the labour market as employers focus on graduates from a few select and expensive universities, Hazelkorn says.

“I think there’s an increasing concern about increasing stratification, absolutely, because of the premium on being elite and essentially many of the attributes associated with being high in the rankings come with being very well-endowed and very well-resourced,” Hazelkorn said.

But the Commission does not think that rankings can skew the labour market because the number of students which attend “elite” institutions is so small.

“The job prospects for graduates of research intensive universities which figure in the rankings are certainly good, but as they constitute only a small percentage of the overall graduate population, we cannot speak of skewing the job market or increasing social stratification,” the Commission’s education spokesman, Dennis Abbott, told EurActiv.

“But the current international rankings do tend to reinforce the idea that what counts is research, rather than performance in teaching and learning,” he added.

Zero-sum world

To Hazelkorn, the question remains as to why governments allocate huge resources to universities which only a small proportion of society attends.

She said that “90 or 95% of our students … do not attend elite institutions. That’s what makes them elite. So the question then is why are we spending so much on what people aren’t attending as opposed to what they are attending.”

Needing estimated yearly budget of €1.5 billion, universities ranked in the world’s top 100 may also detract resources from other important areas in national budgets, such as social care, as governments strive for that all-important “world class” label, the researcher says.

That less renowned universities are unable to command the tuition fees of the elite institutions has implications for the education policy of governments wishing to compete on the domestic or international stage.

“In order to compete at that kind of level that does mean in many cases significant sums in a budget,” she says. “We’re talking about an annual budget estimated to be called ‘world class’ of about $2 billion [€1.5bn] a year. Well, that’s fantastic but first of all it’s beyond many government budgets.

“But for all countries we operate in a zero-sum world. If I give more to this area, I’m going to take more from here. We have problems in housing. We have problems in health. We have problems with pensions, problems in every area … Do we put all our eggs in one basket”, Hazelkorn said.

The researcher says that the issue comes from the perception that “elite” institutions are driving national or regional economic and social development, which she says they “are not”.

In the UNESCO report, Peter J. Wells, a UNESCO higher education specialist, says the correspondence between academic prestige and economic success is typically weak.

“For example, in the United Kingdom where the ‘world-class’ university discourse is especially influential … economic success, at any rate until the 2008 banking crisis, depended largely on the growth of financial services, although business and management were (and are) not among the United Kingdom’s most highly ranked subjects,” he says.

Positions: 

The House of Lords European Union Committee said in its report, 'Modernisation of Higher Education in Europe', that unless the Commission can overcome the perceived deficiencies inherent in all ranking systems, it “should prioritise other activities”.

“In the meantime, rankings such as the Times Higher Education World University Rankings may have a valuable contribution to make,” it adds.

Androulla Vassiliou, commissioner for education, culture, multilingualism and youth, said: "European universities need to think global. They must act strategically to capitalise on Europe's reputation for top quality higher education. They need to promote international mobility of students and staff, provide world-class innovative curricula, as well as excellence in teaching and research ... There is no one-size-fits-all model for this: countries need to play to their strengths."

Marc Hall

COMMENTS

  • The Commission seems to take the view, if you don't like how you're ranked, change the ranking system. There is good evidence that research-led universities are engines of innovation with an impact in economic conversion of knowledge. However, it is also the case that much research lies in papers, not patents, and this is the fault of academic career structures favouring production of knowledge and not its utilisation.

    For example, Milken Institute's assessment of performance in biotechnology shows that universities ranking high on millions of research dollars per paper (publishing metric), do not always rank high on on millions of research dollars per patent (translation metric). You get what you pay for. What you do get by focusing on research is an assessment of the extent to which the academic staff are engaged in new knowledge creation and discovery (part of universities core mission), and which informs their teaching so students benefit from this (and ensures intergenerational transfer of knowledge, another core mission). The tension between teaching and research is important, but the research bias favours knowledge and therefore better content of the teaching. This debate, though, will not go away by defining it out of existence as the Commission seems to be wishing for.

    As for the proposed new metrics, these are broadly captured in existing ranking metrics. Knowledge transfer to the workplace would be very hard to measure and I must admit I have no idea what this might even mean, but employment rates of graduates is probably a better proxy to measure knowledge transfer to the workplace by knowledge holders, i.e. the graduates, while patents and start-ups might better capture transfer to the domain of useful knowledge. Similar analysis can be applied to the other metrics to avoid what appears to be a self-serving exercise by the Commission.

    U-Multirank (2 billion euros????!!!), by using national data also falls into the problem of national data being hard to compare across countries (OECD should know this anyway) as it is usually collected for domestic requirements (another self-serving goal, which can show for instance that France outperforms the US in biotechnology, when this is simply not true). In addition, many ranking systems in use (not the ones cited) capture student opinion (not always about drinking places!), while others capture library holdings and use of technology. Any ranking system is only as good as the quality of data, and how it is used. The abuse of ranking systems will not stop with a new one, only new forms of abuse will emerge. Indeed, a new one will identify new fault lines which will entail more money to paper over these cracks.

    European universities are falling behind, not because they are not being measured in the right way, but because in many EU countries they are weak in terms of standard academic performance and productivity with the quality of teaching stifled by overly rigid academic hierarchies for instance. This doesn't mean they can't improve or be world class. The lesson that should be learned from what is happening in Asia is that these institutions are becoming world-class within the existing metrics in many cases from a standing start, and not with 500 years of history behind them. They are being excellent and looking at the policies that are driving this is more productive than wondering why most European universities are slipping down the rankings.

    Another example: in the US, 80% of biomedical research is undertaken by about 50 academic health science centres, of which Europe has very few (Netherlands, UK, Sweden are exceptions while other countries may have one, e.g. Belgium's Leuven and arguably none in France).

    Part of the logic excellence is to attract students to learn from the best, which is what we would want from our universities, not an excuse to institutionalise mediocrity.

    By :
    mike tremblay
    - Posted on :
    12/07/2013
  • Correction to the text: It called U-multirank a €2 billion initiative, rather than the correct figure of €2 million (the correct figure was in the background).
    By :
    march
    - Posted on :
    12/07/2013
  • From the perspective of Central- and South-East European universities, one can only welcome the initiative of the European Commission.

    A recent "The Global Round Table" on PhD training in Central- and South-East Europe concluded: “The most frequently cited international rankings don’t give full insight to the scientific potential of Region’s PhD schools. Purposely-tailored ranking methodologies could in the future give important guidance for PhD schools in the Region”.
    The international round-table decided to send a weak-up call to the EU: “It is in the interest of the EU to reactivate the under-utilised human- and scientific potential in Central- and South-East Europe. This necessitates targeted EU funds to support PhD training in the Region”. The EU Multi-Annual Financial Framework for 2014-2020 should address this issue.
    Last February, a delegation of the round-table participants headed by Prof. Emil Constantinescu, President of Romania 1996–2000, presented the recommendations to senior individuals at the European Commission and the European Parliament. These included Androulla Vassiliou, commissioner for education, culture, multilingualism, youth; and Doris Pack, chair of the EP committee on culture and education.
    Ref.: http://papers.ssrn.com/sol3/papers.cfm?abstract_id=2257704

    By :
    Gilbert Fayl
    - Posted on :
    15/07/2013
  • This is such a great resource that you are providing and you give it away for free. I enjoy seeing websites that understand the value of providing a prime resource for free. I truly loved reading your post. Thanks!

    By :
    Financial Consultant Dublin
    - Posted on :
    14/08/2013
Banners with the Harvard University logo 'Veritas'. Harvard often features in the top 10 in university rankings. Photo: Ian Lamont
Background: 

Universities were invited to sign up to U-Multirank in the first half of 2013, with its formal launch taking place in Dublin on 30-31 January under the Irish presidency of the European Union.

U-Multirank will be developed in 2013-2014 and will receive €2 million in EU funding from the Lifelong Learning Programme, with the possibility of a further two years of funding in 2015-2016. The Commission's goal is for an independent organisation to run the ranking thereafter.

The new listing will rank reputation for research, quality of teaching and learning, and international orientation, among other criteria. It will also try to offer practical applications for the job market by including success in knowledge transfer, in partnerships with business and start-ups, and regional engagement. The ranking can therefore be seen as part of the European Commission’s push for work-based learning to prepare young Europeans for the job market.

More on this topic

More in this section

Advertising

Sponsors

Videos

Video General News

Euractiv Sidebar Video Player for use in section aware blocks.

Innovation & Enterprise Promoted videos

Euractiv Sidebar Video Player for use in section aware blocks.

Advertising

Advertising