Master Program «Measurement in Psychology and Education»: First Outcomes and Further Steps National Research University Higher School of Economics
Resources: Starting position Some human capacity in area of measurement and educational assessment is available in Russia. Practice of evidence based education policy. Shortages: Institutional capacity to train experts was weak. No graduate or post graduate programs. Most of the experts are out of international cutting edge development and policy discourse in relevant area. Shortage of instrument for educational measurement. Lack of measurement and assessment culture in education. 2
Starting position HSE has won the tender of the World Bank to establish professional graduate program in area of measurement and assessment in education 3
Launching program Review of similar courses and programs in the US, Australia and Europe. Taking one of the strongest centers in psychometrics in the world as a partner and supervisor for our program. Study tour of the program s faculty to University of Massachusetts (UmassAmherst). Special training in specific fields for the program s faculty. 4
Program s goals This only one solution can improve educational quality because each element (specialists, instruments, assessment culture) will have positive feedback from others. What areas does the MP train for? Test development and psychometrics. Researchers in education and human resources. 5
General: Psychometrics Test development Research methods Statistics Applied: Core courses Education Cognitive psychology Assessment in education Human resources Job analysis Personnel assessment 6
Realization of the program Students research activity, including participating in international projects Visiting professors Master classes 7
The first graduates 8
Further trajectories of the graduates Human resources 3 Research 13 (including 2 teachers on our MP) Doctoral programs 5 7 (1 or 2 abroad) 9
The International Laboratory for Educational Policy Research The Laboratory aims to carry out research in education using modern methods of analysis. The laboratory works in cooperation with leading international researchers on projects related to evaluation of education quality and economics of education and educational policy. The largest center of in depth analysis of PISA, TIMSS and PIRLS. Program s faculties, students and graduates co working in many HSE research (next slide) 10
Research activity: PIAAC and AHELO (Russian part of OECD projects). In depth analysis of PISA, PIRLS, TIMSS data SAM School Achievements' Monitoring and ICT an education quality assessment tool for the information and communication technology (IT) competence of secondary school students. National monitoring of educational and professional trajectories of youth. 11
Some of research outcomes Teacher Characteristics and Student Achievements in TIMSS negative effect: frontal and reproductive teaching (math) positive: duration of course (math), teacher s experience etc. The effect of one extra year of schooling on PISA results school effectiveness does not correspond with country rank in PISA hierarchy ; the grade effect is higher for countries where is no dividing into different tracks (general or vocational) the effectiveness of schooling for vocational students is lower than for general students. 12
Some of research outcomes What affects PISA results more: school, family or individual? family, contingent of school, school location and resources, motivation (in descending order) Cognitive skills in composite tasks (in progress) Non-cognitive predictors for successful educational trajectories (in progress) 13
Extra educational activity Research seminar IRT Modeling in Education and Psychology (the first and only in Russia). The First National Students Case Championship «Measurement in Psychology and Education» of the HSE». (Was carried out by program s students). Expertise and consultancy in the CIS and Europe. 14
Extra educational activity Program s faculties, students and graduates coworking in instruction: Course Computer adaptive testing under supervision of UMass. An introductory part of course Basic Statistical Methods and Introduction to SPSS under supervision of program s faculty. Updating course Test development under supervision of program s faculties and University of Illinois (Chicago). 15
Some plans Professional development in area, e.g. postgraduate program. Summer and winter schools. Training modules adapted to teachers Training modules adapted for online teaching Peer reviewed journal Measurement and research in social sciences. 16
Thank you for your attention!