Rankings: A Pakistani Perspective

Rankings: A Pakistani Perspective

Context of Pakistan HEC established 2002 The Higher Education Commission will facilitate Institutions of Higher Learning to serve as an Engine for the Socio-Economic Development of Pakistan Responsible for Policy, Standards, Accreditation, Research Support, Scholarships, Statistics, Funding --- Everything! Strategic Focus Access (2.6% in 2002) Quality (Research, Academic System, Accred.) Relevance (Link to Community & Economy)

2002: State of Higher Education Item Number Number of Universities ranked (QS) in top 600 Universities of the World 0 New Institutions Established 71 Enrollment 276,274 Number of PhD Less than Scholarships 1,500 Total PhD Output 3321

Preliminary Questions Should there be Ranking? Who should conduct Rankings? Is Institutional Ranking Fair? Does Institutional Ranking provide useful information?

Preliminary Response Conduct Rankings: Decision of PM! No entity willing to conduct rankings Therefore HEC must do it, by default! Rankings cannot be absolutely fair Compare Similar Institutions Do not include New Institutions Enormous Public Interest in Ranking Most visited Web Page of HEC

Secondary Questions: Data Which Ranking model is best and most applicable for Pakistan? Which data is to be used for ranking? What is the source of the data and it s reliability? Weightage of factors included in ranking? How important is the size of the Institution? Employer and Graduate Perception data? Peer evaluation data?

Ranking Models Shanghai Jiao Tong s Academic Ranking of World Universities Focuses exclusively on research output and citation impact Webometrics Ranking of World Universities Based on a composite indicator of 1) volume of the Web contents and the visibility and 2) impact of these web publications World University Rankings compiled by the Times Higher Education Magazine Based on composite scores that aggregate weighted indicators, reputational surveys are main source of information. QS University Rankings Composite score focusing on Academic peer review, Faculty student ratio and Citations per faculty

Ranking Alternates Baldrige System of HEIs rating Academic Audit based Rating of HEIs (AUQA-Australia) British HEIs rating system (QAA-UK) Institutional Performance Review system (Scottish-QAA)

Concerns Availability and completeness of the data to be used for ranking Authenticity of the data Variance across ranking criteria used globally Balance between quantitative and qualitative aspects (difficult to collect) in the ranking criteria

Ranking Experience: A Pakistani Context Data Collected by HEC Enormously difficult exercise when done for the First Time, i.e. collection of baseline data No other alternative but to do it oneself No Third Party survey data available Employer, Peer and graduate perception survey ignored since not available Lack of trust in Qualitative Information

Ranking Criteria (2006) Students (Enrollment & Output) 17 Facilities 15 Finances 15 Faculty 27 Research 26 Total Marks 100

Ranking of Institutions in Pakistan In 2004, ranking criteria was developed as one of the QA initiatives. Comparative study of international practices Ranking exercise carried out for the first time in Pakistan in 2006 based on data from FY 02-04 New Universities and Degree Awarding Institutes were excluded Clustering of universities under similar category General Universities Engineering Universities Agriculture Universities Business & IT Institutions Medical Universities

Tertiary Questions: Policy Support for Higher Education @ Govt. Level Ranking Data for support Policy Driven Ranking Quality Assurance Research Innovation

Quality Assurance UGC in 2002 HEC in 2011 Ranking of Universities Not Available Available Quality Enhancement Cells 0 84 Accreditation Councils 7 11 Quality Assurance Agency None Established Approved Journal Criteria None Notified Approved Journals 0 164 Tenure Track Faculty 0 1002 MPhil/PhD Award Criteria Varied Standardized

ICT @ Universities Pakistan Education & Research Network UGC in 2002 HEC in 2011 No. of HEIs connected 16 106 Max. HEI internet bandwidth 128 Kbps 310 Mbps Total HEI internet bandwidth 8 Mbps 6,240 Mbps Video Conferencing No. of HEIs provided facility Nil 75 No. of interactive events Nil 810+ Campus Management Solution No. of HEIs with facility Nil 8 No. of students benefitting Nil 50,000 Automated Modules Nil 9/ 36

Research & Development Program UGC No. of Cases HEC No. of Cases National Research Program for Universities 32 923 Travel Grant to Teacher / Scholar - 5047 Seminars / Conferences / Grants - 656 Pak-US Joint Academic and Research program - 54 Access to Scientific Instrumentation - 2184 Grants for Maintenance of Scientific equipment - 196

Ranking: Aftermath Definitely Controversial No matter what you do It will be wrong! Crucial to make mistakes and learn Shift to Evidence Based Claims Enhanced impact on Govt. Policy Improved International Ranking Competitiveness One Ranking is not enough Shift to Policy Driven Ranking Research Output Ranking

HEC: Impact at a Glance UGC 1947-2002 HEC 2002-2011 Number of Universities ranked (QS) in top 600 Universities of the World 0 5 New Institutions Established 71 66 Enrollment 276,274 803,507 Number of PhD Less than More than Scholarships 1,500 8,000 Total PhD Output 3321 3658

Rankings: Future Rankings are a reality. We have to live with them More types of ranking to address 1: User requirements Program Ranking II: Policy Objectives QEC Rankings Research Rankings Ranking link to Funding (Very Carefully)

Thank You