National Peer Review Network Peer Review of Assessment Dr Sara Booth
01 National Peer Review Network SESSION AIMS 1. To provide an overview of Higher Education Standards (HESF) 2. To provide an overview of institutional and national momentum in peer review of assessment and standards 3. To provide an overview of models of peer review 4. To provide an overview of the national Peer Review Network 5. To get feedback on setting up and sustaining peer review networks 6. To get feedback on what are the key challenges in peer review and what support can you provide in driving this national initiative 2
Peer review is the responsibility of the provider not the regulator. We can t meet standards without peer review. It is a very important part of the standards We have to consider the importance of peer review [ like the work of Kerri-Lee Krause and Mark Freeman] If I go to the criteria on Learning Outcomes 1.5.1: The expected learning outcomes are specified... by informed by national and/or international comparators. I would be expecting there would be periodic review by external people that there is a standard. There are three projects in this area (UK and Denmark have the external examiners system). See the proposed Higher Education Standards Framework Standards 1.5.1; 5.3.2; 5.3.3; 5.3.5 and 5.3.6 Emeritus Prof Alan Robson, Chair, HESP Information Session-Proposed Higher Education Standards Framework 14 th May, 2014
Institutional Momentum in Peer Review University of Tasmania Benchmarking 2009-Present: 7 national and 4 international benchmarking projects including peer review workshops ( for instance, academic transition, assessment policies & processes, higher degree research, UES for Student Centre Directors, promotions policies & processes, health, education in placements, professional studies and literacy numeracy standards, internationalisation) Peer Review of Assessment 2012 : University s participation in the Inter-institutional Review Project (Krause et al., 2013) in Nursing, Economics and Journalism 2013: Internal Teaching Development Grant to develop and trial an online Moderation Tool and resources to support peer reviewers and reviewees and develop national network in peer review 2013: Trial of online Moderation Tool with Faculties of Education (Charles Sturt, Curtin, Griffith, Tasmania & Western Sydney) 2013: Peer review of assessment recognised in the Teaching Performance Expectations (TPEs) 2014: Identified as institutional priority for University Learning and Teaching Committee (ULTC) 2014: Development of draft External Peer Review of Assessment Procedure 2014:Trial with IRU using online Moderation Tool (August, 2014)
National Momentum in Peer Review of Assessment and Standards National Learning Outcomes Standards Forum 9 August, 2013 How to make assessment moderation scalable and sustainable Identify how students, other faculty and external stakeholders can be involved in the assessment moderation process Development of a peer review network Universities Australia Satellite Event, Comparing Learning Outcomes Standards 28 Feb, 2014 Peer moderation is core to standards Need to get public confidence When and how are important questions of moderation Infrastructure, resourcing and costs to the institutions Network of peer reviewers: models to fit the Australian context How can we make it work? The challenge of calibration and the concept of judgement (QAA/HEA research study, 2013 on examiners understanding of standards) Senior Fellowship Emeritus Professor Geoff Scott 2014 Assist the higher education sector to establish the policy and practice frameworks to embed interinstitutional peer review of teaching and learning standards, and Identify and disseminate the most effective assessment practices identified through peer review in each professional or disciplinary area Higher Education Standards Panel Research Fellow Professor Christine Ewan Development of a national consensus on higher education standards in a disaggregated learning environment
See the proposed Higher Education Standards Framework Standards 1.5.1; 5.3.2; 5.3.3; 5.3.5 and 5.3.6 Other measures of learning outcomes Student Progression/ Retention Data Course design & approval Selected Units Admission/ pathways Course Delivery Assessment Student Grades Assessment Design Learning outcomes Assessment as the main measure of learning outcomes Michael Wells, TEQSA, Satellite Event: Comparing Learning Outcomes, Universities Australia, Feb 28 th 2014
National Peer Review Network Peer review is core to assuring standards. External peer review of assessment is gaining momentum in the Australian higher education sector. The aims of this national Peer Review Network (PRN) are to: Provide a forum for sharing and disseminating good practice in external peer review of assessment across different Identify key academics experienced in external peer review of assessment Provide professional learning opportunities for academics and benchmarking partners External Reference Group Professor Richard James, Melbourne University Professor Kerri-Lee Krause, UWS Professor Emeritus Royce Sadler, UQ Professor Chris Rust Di Weddell, OLT Dr Michael Evans, Kaplan Core Peer Review Network Team Dr Sara Booth, Project Leader, University of Tasmania Assoc Prof Mark Freeman, The University of Sydney Assoc Prof Heather Alexander, Griffith University Prof Ron Oliver, Edith Cowan University Mr Mark Thompson, Edith Cowan University Prof Jane Fernandez, Avondale College Project Officer Dr Jeff Beckett, University of Tasmania
Peer Review Network State-based Workshops Peer Review Network Statebased Workshops 13 th August: Melbourne University 18 th September: University of Western Sydney 19 th September: Griffith University 25 th September: Edith Cowan University Register your expression of interest to attend: Sara.Booth@utas.edu.au
Peer Review Network Forum Assuring Grades Across Course Boundaries 12 th November 2014 Park Royal Hotel, Melbourne Airport Networking Dinner Register your expression of interest to attend: Karen@hes.edu.au
Progress to date DVC(A) Universities Australia Meeting RUN Progress to date Regular agenda item Keep informed 23 Council of Deans 7 presentations (DASSH, ABDC, ACDE, ACED, CADAD, DDoGS, CDNM) 1 submitted report for funding for professional learning ACDICT COPHE and ACPET IRU OLT National Conference Victorian Quality Managers Network Keep informed Keep informed and involved in testing UTAS online moderation tool Poster presentation Keep informed
Peer Review Networks in Assessment 1. What networks are currently established for the external peer review of assessment? 2. How do you establish networks in peer review at the national, disciplinary and interdisciplinary levels? 3. Where do you use peer review to good effect? 4. What evidence do you have on how it works? 5. What are your cunning tips?
National conversation on peer review of assessment National Level Academic quality structures & processes Higher Education Standards Framework Higher Education Standards Panel TEQSA Accreditation Bodies Models of peer review Quality Verification System Inter-institutional Moderation Achievement Matters Support structures Peer Review Network Peer Review Forum What are the key challenges in peer review of assessment? Institutional Level Academic quality structures & processes Quality unit role in coordinating blind peer review Secure data collection/storage of data Internal register of units for peer review Academic governance processes in external peer review Accreditation Policies/procedures Subject/unit outlines include peer review feedback Models of peer review Which model/s of peer review will be adopted? Support structures Internal peer review networks Discipline networks Alignment to teaching criteria/frameworks Professional learning on peer review of assessment What support can you provide for this national initiative to go forward?
For more information on the External Peer Review Network http://www.utas.edu.au/student-evaluationreview-and-reporting-unit/nprn