Diversity and Performance in U Multirank. Frans Kaiser, CHEPS University of Twente, the Netherlands

Size: px

Start display at page:

Download "Diversity and Performance in U Multirank. Frans Kaiser, CHEPS University of Twente, the Netherlands"

Blaze Fields
8 years ago
Views:

1 Diversity and Performance in U Multirank Frans Kaiser, CHEPS University of Twente, the Netherlands 1

2 Three things on U Multirank One Distinguishing features of U Multirank Two Overview of the U Multirank web tool for comparing university performances Three Some first findings from U Multirank 2014 and its future development

for comparing university performances Three Some first

3 Distinguishing features multidimensional perspective no overall league tables no composite institutional indicators two level analysis (institutional and field ) user driven approach with the option of specific ready made rankings performance profiles in various dimensions

analysis (institutional and field ) user driven approach with the

4 A new instrument to compare university performances University X is the fifth best in the world Multi dimensional ranking: ranks 30+ individual indicators (performance measures) in five dimensions of performance Teaching and learning Knowledge transfer Regional engagement Research International orientation

indicators (performance measures) in five dimensions of performance Teaching

5 Indicators at institutional and field levels Teaching and Learning Institutional ranking Field based ranking Student staff ratio Graduation rate (BA and separately MA) Percentage of academic staff with PhD Percentage of students graduating within normative period (BA and separately MA) Rate of graduate employment Inclusion of work experience in degree programme

of academic staff with PhD Percentage of students graduating within normative period (BA

6 Indicators at institutional and field levels Teaching and Learning Student Satisfaction Indicators Institutional ranking Field based ranking Overall learning experience Quality of courses & teaching Organisation of the programme Contact to teachers Social climate Facilities (libraries, laboratories, rooms, IT) Research orientation of teaching /programme Inclusion of work experience /practical elements

Organisation of the programme Contact to teachers Social climate Facilities (libraries,

7 Indicators at institutional and field levels Research Institutional ranking Field based ranking External research income (per FTE academic staff) Doctorate productivity Total research publication output (per FTE academic staff)* Art related output Field normalised citation rate* Highly cited research publications * Interdisciplinary research publications* Research orientation of teaching (student survey) Number of post doc positions

academic staff)* Art related output Field normalised citation rate* Highly cited research publications *

8 Indicators at institutional and field levels Knowledge Transfer Institutional ranking Field based ranking Income from private sources (service contracts, consultancies, licenses, royalties, trials, etc.) Joint research publications with industry* Patents (per fte academic staff) Co patents with industry (per fte academic staff) Number of spin offs (average over three year period) Patent citations to research publications* Revenues from Continuous Professional Development

) Joint research publications with industry* Patents (per fte academic staff) Co patents with industry (per fte

9 Indicators at institutional and field levels International Orientation Institutional ranking Field based ranking Educational programmes (BA/MA) in foreign language International orientation of degree programmes Opportunities to study abroad (student survey) Student mobility (composite of incoming, outgoing, joint degree students) Percentage of international academic staff Percentage of PhDs awarded to foreign students International joint research publications* International research grants

abroad (student survey) Student mobility (composite of incoming, outgoing, joint degree students) Percentage of

10 Indicators at institutional and field levels Regional Engagement Institutional ranking Field based ranking Percentage of graduates working in the region Student internships in regional enterprises Degree theses in cooperation with regional industry Regional joint research publications* Income from regional sources

Student internships in regional enterprises Degree theses in cooperation with

11 A new instrument to compare university performances Indicator 1 counts for 20%, indicator 2 for 30%, etc., altogether this leads to a score of X No composite overall scores, as there is no theoretical or empirical justification for weighting and adding scores User driven: user decides on areas of performance to compare (and on the kind of university to be compared) YOUR WAY!

, altogether this leads to a score of X No composite overall scores, as there is no

12 A new instrument to compare university performances Ranking order: Top scores = Medal table

13 A new instrument to compare university performances ranking performances of universities as a whole ranking performances in specific fields or disciplines

14 A new instrument to compare university performances Data sources: Self reported: institutional questionnaire department questionnaire student survey Public information bibliometric data patent data

15 Welcome to U Multirank Overview of the web tool Illustration of interactive use Student: looking for a bachelor programme in physics Dean Electrical Engineering: looking to develop partnership with industry Rector : Look for good practice institutions in knowledge transfer The U Multirank readymade rankings

Engineering: looking to develop partnership with industry Rector : Look for

16 U Multirank 2014 is the most comprehensive international data comparison in highereducation 850 universities are included with publicly available data 70 countries have universities in U Multirank 500 1,000 5,000 60,000 of the 874 universities have provided comprehensive data faculties/departments are included in the four field based rankings (physics, electrical and mechanical engineering, business studies) study programmes within these faculties are included students completed the student satisfaction survey

provided comprehensive data faculties/departments are included in the four field based rankings (physics, electrical and

17 U Multirank offers a global view of a large variety of university profiles Worldwide coverage In 2014, 62% of U Multirank universities are from Europe, 17% from North America, 14% from Asia and 7% from Africa, Latin America and Oceania PhD awarding institutions + universities of applied sciences small + large universities specialised institutions + comprehensive universities old (pre 1870) + young institutions (after 1980)

Latin America and Oceania PhD awarding institutions + universities of applied sciences small + large

18 Findings: U Multirank shows a wide distribution of A scores Very few univs. with no A scores No univ. has across the board A scores A scores per univ. % of univs % 1 to % 5 to % 11 to % 16 to % Many univs. have specific strengths Around 100 univs. have a wide range (>10) of A scores On individual indicators performance differences between univs. areclearly visible 300 univs. were not yet visible in global rankings. Of these, 30 have more than 10 A scores

9% Many univs. have specific strengths Around 100 univs.

19 The world s top 100 universities overall? U Multirank demonstrates for the first time the diversity of university profiles in the international context. The findings indicate that it is not possible to meaningfully identify the world s top 100 or 200 universities overall. Instead, U Multirank is a flexible learning tool where students, parents, academics, policy makers, administrators, etc., can find information to support decision making

The findings indicate that it is not possible to meaningfully identify the world s top 100 or 200 universities

20 U Multirank 2014 was only the first step 2015 registrations: around 750 More universities will participate in 2015 and beyond Psychology, computer science and medicine are added as new subject fields in 2015 to be continued

participate in 2015 and beyond Psychology, computer

21 Potential new fields in the long run Mathematics Music Mechanical engineering Chemistry History Electrical engineering Biology Linguistics /modern languages Civil engineering Education Business Computer Science Sociology Economics Medicine Social Work/welfare Geography Psychology Physics Nursing

22 UMR datacollection 2015 Changes to the questionnaires No major shift in datacollection Feasibility and reliability major drivers for changes Data on three years Reduction of redundant questions/ breakdowns Refinement of question on sources of revenues Explicit data not available checkbox Consequences of not updating

23 UMR datacollection 2015 Deadlines (all Finnish institutions are put in batch 3) Institutional First deadline Datacheck Questionnaire reopened Final deadline Batch 1 15 Sept 13 Oct 3 Nov Batch 2 13 Oct 10 Nov 28 Nov Batch 3 31 Oct 28 Nov 15 Dec Field based Batch 1 13 Oct 10 Nov 28 Nov Batch 2 27 Oct 17 Nov 5 Dec

24 More information/contact Contact: Or find us on Facebook, Twitter and Instagram

U-Multirank The Implementation of a Multidimensional International Ranking Where are we, Where are we going?

U-Multirank The Implementation of a Multidimensional International Ranking Where are we, Where are we going? Don F. Westerheijden Presentation to ACA seminar What s new in Brussels Brussels, 2014-01-30