ASIIN Annual Conference 2013 December 12-13, Stuttgart Internal Quality Assurance and Accreditation: the case of SEUA By: Ruben Aghgashyan, SEUA Vice-Rector rubag@seua.am
Agenda 1. SEUA (Polytechnic) at a glance Facts and Figures Internal Quality Management Structure 2. SEUA Internal QA System Academic Programmes e-system Evaluation and Ranking of Teaching Staff 3. Accreditation process at SEUA Conducting the Self-assessment Site-visits to SEUA Campuses 4. Summary Current state of the process Nearest targets ASIIN Annual Conference - 2013, Stuttgart 2
State Engineering University of Armenia (Polytechnic) ASIIN Annual Conference - 2013, Stuttgart 3
State Engineering University of Armenia is the legal successor of Yerevan Polytechnic Institute: one of the leading engineering schools of the former Soviet Union ASIIN Annual Conference - 2013, Stuttgart 4
Mission Statement to create and implement academic/research programs and services consonant with educational and technological needs of the national economy and society, to prepare students for life, career, life-long learning and professional progress in line with changing economic environment and emerging global information society, to create a supportive environment for the comprehensive personal and intellectual development of each individual, generation of law-abiding and responsible citizens. ASIIN Annual Conference - 2013, Stuttgart 5
Organizational Structure of SEUA with its integrated QA system RECTOR Academic Council VICE-RECTOR Educational Reforms &DP Department QA Commission of AC Regional Academic Councils External Experts Academic Affairs Department QA Commission of Student Council Regional QA Commissions Councils of Faculties Continuing Education Centre Academic Planning Division QA Division QA Sub-commissions of Faculty Councils Regular Seminars Local groups of selfassessment ASIIN Annual Conference - 2013, Stuttgart 6
SEUA QA Web-based Online System SEUA Quality Assurance Online e-system (QAeS) is designed and created by a joint team of SEUA and Synergy International Systems Co. based on the methodical framework developed at SEUA. It consists of two main applications: Quality Assurance Web Portal Quality Assurance e-system Tools ASIIN Annual Conference - 2013, Stuttgart 7
The structure of SEUA QA e-system Methodical Framework Information Database of Study Programmes Online Platform of SEUA QAeS Study Programme Processing and Realization Control Tools Teacher s Activity Quality Assessment Rating System ASIIN Annual Conference - 2013, Stuttgart 8
Content of Methodical Framework Structure and management of QA system Policy and strategy of quality assurance Development and restructuring of study programmes Programme monitoring and review Students assessment systems External assessment, accreditation Quality assurance of teaching staff Resource base of the programme Participation of students Internal Information Management External Information Other documents and materials ASIIN Annual Conference - 2013, Stuttgart 9
Information DB of study programme Requisites and objectives of the programme Assessment of the efficiency of the educational processes Structure, content and organization of the programme Quality control and management of the programme Human resource base of the programme Information archive of the programme Technical resource base and student support services ASIIN Annual Conference - 2013, Stuttgart 10
QА е-system Tools and Analysis www.synisys.com www.seua.am
Copyright 2013 Synergy International Systems Inc. ALL RIGHTS RESERVED Application Areas of QAeS Tools Development and quality assessment of study programmes. Tracking and analysis of SEUA teaching staff. Tracking and analysis of survey results gathered from QАеS Portal. Teacher assessment and automated rating generation.
Copyright 2013 Synergy International Systems Inc. ALL RIGHTS RESERVED Some characteristics of QAeS Tools System users have personalized login credentials and corresponding permissions granted individually to every user. The main phases involved in the System for the SEUA study programmes development and control are: proposal submission and approval, programme development and approval, annual monitoring of programme, periodical (cyclic) review of programme.
Copyright 2013 Synergy International Systems Inc. ALL RIGHTS RESERVED Responsible levels for QAeS Tools For all mentioned processes of the SEUA study programmes, system has interactive revision workflows integrated with the participation of different levels of SEUA users: Head of programme working group, Head of Chair, Dean of Faculty, Head of Departments, Academic Secretary, Vice-rectors, Rector
Copyright 2013 Synergy International Systems Inc. ALL RIGHTS RESERVED Some analytical characteristics of Tools Analysis and reporting on the study programmes. SEUA teaching staff data management and analysis. Analytical reporting over the survey results imported from QАеS Portal: Assessment of teacher by students; Course assessment by students; Study programme assessment by graduates; Assessment of employers satisfaction from SEUA graduates.
Copyright 2013 Synergy International Systems Inc. ALL RIGHTS RESERVED Teacher s assessment organization Submission of teacher s selfassessment form. Automated calculation of teacher rating based on: Teacher s self-assessment; Students assessment of the teacher. Peer assessment of the teacher.
Management of Accreditation process at SEUA ASIIN Annual Conference - 2013, Stuttgart 17
Action Plan of SEUA Institutional Self-assessment - 1 Actions Taking part in the trainings organized by ANQA and NVAO within the frames of ARQATA Project workplan Preparation of pilot report of self assessment including the I, III and X Standards (within the frames of ARQATA Project) Submission of Application to ANQA for starting institutional accreditation process according to the procedures set forth in the Accreditation Statute Organization of local trainings by the SEUA QA Department for the members of SEUA Branch and Faculty QA Commisions Forming the Working groups for preparation and provision of SEUA self-assessment processes (Rector s Order) Discussion and approval of the action plan s implementation time table to conduct the self-assessment processes ASIIN Annual Conference - 2013, Stuttgart Time March 2012, Aghveran May 2012, SEUA May 2012, SEUA June 2012, SEUA September 25, 2012, SEUA September- December, 2012 18
Action Plan of SEUA Institutional Self-assessment - 2 Actions Periodic reports (presentations) to SEUA Rectorate on the current progress of the self-assessment process Meetings of coordinating group working groups, provision of video conferences with the branch groups to harmonize the activities. Completion of writing of the separate reports of Yerevan, Gyumri, Vanadzor and Kapan working groups made for all 10 QA Standards. Combining the separate reports in a one (integrated) file forming the SEUA Institutional Self-assessment Report Internal dissemination of the Report to collect opinions, to revise the text (if needed), and to come over with the final version of the Report Parallel translating the Report into English Sending both Armenian and English versions of Self-assessment Report to ANQA ASIIN Annual Conference - 2013, Stuttgart Time September- December, 2012 September- November, 2012 Deadline: Nov.10, 2012 Deadline: Nov.10, 2012 Deadline: Nov.25, 2012 October December, 2012 Deadline: Dec.12, 2012 19
Management of Self-Assessment process The self-assessment of the whole university or its separate unite, as a quite complicated, multifactor and multi-phase process, needs the existence of a priory well developed and clear cut management system to guarantee success of the entire process. The schemes used by SEUA to ensure the administrative management and the organization of information flows needed for conducting the self-assessment processes have been the following. ASIIN Annual Conference - 2013, Stuttgart 20
The Scheme of Administrative Management of SA Process Rector Academic Council Deans of Faculties Vice-Rectors Commission of Academic Council Heads of Chairs and Divisions Head of Department of ER&DP Regional units of QA Phase of Self- Assessment Phase of External Audit Phase of Summing up the results Student Union / Students Formation of the goal and objectives of SA Preparation of the Unit Formation of the working groups realizing SA Forming the Portfolio of SA Making up of SA Portfolio (gathering materials) Familiarization the Unit with the worked out SA Formation of the plan of enhancement actions Working groups formed according to the SA Standards components Formation of Expert Panel Elaboration of the sitevisit formats Study of the worked out SA Report Organization of visits to subdivisions Making up the separate parts of Expert Report Formation of the project (draft) of Expert Report Formation of the project of conclusions Group of evaluators (Expert Panel members) Discussion of the Expert Report project in the Unit Preparation of the Report and Conclusions Discussion of the Report in AC Commission Discussion and approval of the Report and Conclusions BY Academic Council Publishing the final results of evaluation and the Enhancement Action Plan ASIIN Annual Conference - 2013, Stuttgart 21
The Scheme of Information Flows of SA Processes Academic Council Rector National Center for Quality Assurance (ANQA) Commission of Academic Council Vice-Rector Head of Expert Panel Head of ER&DP Department Head of Academic Programs Department Secretary of Experts group Working group compiling the portfolio of SA Dean of Faculty Head of Chair Experts group The object of evaluation Student Union ASIIN Annual Conference - 2013, Stuttgart 22
Site-visits to SEUA Campuses ASIIN Annual Conference - 2013, Stuttgart 23
The list of realized site-visits Within the term of (May 20 - June 8), 2013 the following site-visits have been realized to SEUA SEUA Central Campus in Yerevan, SEUA Regional Campus in Gyumri, SEUA Regional Campus in Vanadzor, SEUA Regional Campus in Kapan. ASIIN Annual Conference - 2013, Stuttgart 24
The List of Expert Panel Members EDUARD GHAZARYAN (the panel Chair) Director of Institute of Mathematics and High Technologies of the Armenian-Russian (Slavonic) University, Dr. Professor DAVID WOODHOUSE Academic Accreditation Commission of United Arab Emirates GRIGOR ALAVERDYAN The Head of the Chair of Theory of Wave Processes and Physics of Yerevan State University, Associate Professor EDUARD DANOYAN The Deputy Dean of the Faculty of Informatics and Applied Mathematics of Yerevan State University, Associate Professor LAURA SIMONYAN A 4 th Year Student of the Faculty of Romano German Philology of Yerevan State University ASIIN Annual Conference - 2013, Stuttgart 25
The meetings taken place in Yerevan -1 Within the visit programme meetings with the following groups have been realized: University Rector (the start meeting), representatives of the working groups caring out the parts of the self-assessment report Vice-rectors, Deans of Faculties, representatives of Chair Heads, representatives of employers, heads and representatives of separate units, ASIIN Annual Conference - 2013, Stuttgart 26
The meetings taken place in Yerevan - 2 representatives of different groups of students, representatives of teaching staff, representatives of Student Union, heads and members of scientific collaboration units and research laboratories, staff of QA responsible department. A series of visits to the educational and research Centers and Laboratories took place as well. ASIIN Annual Conference - 2013, Stuttgart 27
The current state of SEUA institutional accreditation process A draft of the expert panel Report based on the SEUA institutional self-assessment report, the results of the site-visits, and the individual reports of expert panel members worked out for all of the accreditation criteria, has been sent to SEUA consideration and discussion. ASIIN Annual Conference - 2013, Stuttgart 28
Summary ASIIN Annual Conference - 2013, Stuttgart 29
Summary: SEUA Internal QA today In last 3-4 years all the main components of SEUA internal QA System have been created including: Organizational structure and responsible units, Methodical guides and procedures for QA of study programmes, Web-based on line system uniting: information data base of regulatory/ methodical support documents, and QA tool set for study programmes. ASIIN Annual Conference - 2013, Stuttgart 30
Summary: starting accreditations Two parallel accreditation processes have been initiated : Institutional accreditation by ANQA, Programme accreditation for Software Engineering and Information Security BE and ME programmes by ASIIN and ANQA (within the Tempus PICQA Project). ASIIN Annual Conference - 2013, Stuttgart 31
Summary: nearest QA targets To complete competency based reorganization of all SEUA study programmes with integrated QA mechanisms. To prepare the teaching staff and administration of SEUA to quality assessment and management of restructured programmes. To test and apply the developed SEUA Web-based QA online system in SEUA QA processes. To prepare new study programmes to national / international accreditations. ASIIN Annual Conference - 2013, Stuttgart 32
THANK YOU FOR ATTENTION ASIIN Annual Conference - 2013, Stuttgart 33
Components of Teacher Assessment Rating System Self-assessment based on actual information Academic, Research, Methodical, and Social activity components Pear Review Reviews done by colleagues, Reviews of Head of Chair Assessment by Students Professional and Personal characteristics ASIIN Annual Conference - 2013, Stuttgart 34
Number of students & admission 123.700 students (Total), among them - 114.600 Bachelor - 9.100 Master - 17.800 In the free of charge system - 22.700 In non-state universities There are about 7000 foreign students studying in Armenian HEIs from 41 countries, mostly of Asia, as well as of other four continents. According to the Law on Education and the Law on Higher and Postgraduate Education admission and selection is carried out by introducing unified secondary school final examinations, which are held at knowledge assessment centers set up to replace the former centralized admission examinations system. ASIIN Annual Conference - 2013, Stuttgart 35
Yerevan the capital city for all Armenians ASIIN Annual Conference - 2013, Stuttgart 36
Yerevan the capital city for all Armenians The beauty of night Yerevan ASIIN Annual Conference - 2013, Stuttgart 37
Armenia - a unique open museum ASIIN Annual Conference - 2013, Stuttgart 38
Objectives of SEUA QАеS Portal Sharing information about quality assurance system, quality control of study programs and QA processes in SEUA. Addressing potential students and customers needs in finding information about particular study program and its details. Administrative access provides easy content management, as well as survey management tools.
Copyright 2013 Synergy International Systems Inc. ALL RIGHTS RESERVED Surveys imported from QAeS Portal Assessment of teacher by students; Course assessment by students; Study programme assessment by graduates; Assessment of employers satisfaction from SEUA graduates.
Facts and Figures - 3 At present over 10 thousand students following 4 degree programs, more than100 foreign students studying in English and Armenian language groups. In addition, over 800 learners at the SEUA central and regional affiliated high schools. The academic staff of the University exceeds 800, most of them with Scientific Degrees. With its developed research system and infrastructure the University is nationally recognized as the leading center in technical sciences and technologies. ASIIN Annual Conference - 2013, Stuttgart 41
12 11 13 10 9 8 7 6 5 4 3 2 1 0 1 14 2 Specialty: 3 4 5 Information Security Software Engineering 10 6 9 8 7
9 8 10 10 9 8 7 6 5 4 3 2 1 0 1 2 3 4 1. Graduates' theoretical knowledge corresponds to the job requirements 2. Graduates demonstrate practical skills 3. Graduates are able to identify, formulate and solve engineering problems 4. Graduates are capable of solving management problems 5. Graduates have enough knowledge of computer technology and applied programmes 6. Graduates have enough foreign languages skills in the professional field 7. Graduates have necessary record keeping skills in Armenian 8. Alumni prove to have a creative approach in their professional activities 9. Graduates have satisfactory business skills 10. Graduates have skills in cooperation with colleagues and teamwork 7 5 6
Formation the Working Groups in Accordance with the Standards Group I Group II Group III Group IV Group V Group VI Group VII II. MANAGEMENT AND ADMINISTRATION IV. STUDENTS V. ACADEMIC AND TEACHING SUPPORT STAFF VI. RESEARCH AND DEVELOPMENT VII. INFRASTRUCTURE AND RECOURSES VIII. SOCIAL RESPONSIBILITY IX. EXTERNAL RELATIONS, INTERNATIONALIZATION The groups were coordinated by the University Rector and Vice-rectors responsible for the appropriate fields. The SEUA QA Division was ensuring and coordinating the cooperation between all concerned sides and working groups. ASIIN Annual Conference - 2013, Stuttgart 45
Higher Education System of Armenia (Facts & Figures) ASIIN Annual Conference - 2013, Stuttgart 46
National Qualification Framework of RA Is confirmed by the RA Government in 2011 Elementary Education Basic Education Craftsman Secondary Education Specialist Bachelor Master Researcher (Scientific Degree- Candidate of Science) ASIIN Annual Conference - 2013, Stuttgart 47
Organization of HE Degree Programmes The main education programmes of higher professional education are conducted through various types of teaching: full-time, parttime or external education. The academic year, as a rule, starts on September 1st and is comprised of 2 semesters with 20 and 22 weeks of duration respectively. 3 cycle preparation of specialists is implemented within the framework of Higher Education of Armenia: - Bachelor s degree programme: 4 years duration, 240 ECTS - Master s degree programme: 2 years duration, 120 ECTS - Researcher s (PhD) programme: 3 years duration, 180 ECTS ASIIN Annual Conference - 2013, Stuttgart 48
Institutions functioning in RA 26 State Universities, of which 16 with their 14 branches belong to the system of the Ministry of Education and Science (MES); 4 HEIs founded by interstate agreements and state participation, and funded by the MES; 2 HEIs in the system of the Ministry of Defense; one higher education institution in the system of each of the following Ministry/Bodies: Police, Ministry of Emergency Situations, Mother See of Holy Etchimiadzin. 40 Private Universities, among them: 31 Accredited Universities 83% of state universities and 76% of non-state universities are located in Yerevan, others in 8 provinces (Marzes) of the RA ASIIN Annual Conference - 2013, Stuttgart 49
Accreditation of Armenian HEIs: main principles and characteristics ASIIN Annual Conference - 2013, Stuttgart 50
Main objectives and regulations - 1 Accreditation as a tool for the certification of the quality of a HEI s activities and offered academic programmes Is realized by means of academic audit of HEIs aimed at the assessment of efficiency and adequacy of internal quality assurance processes In the Republic of Armenia the external quality assurance system is realized through institutional and academic programme accreditations of HEIs ASIIN Annual Conference - 2013, Stuttgart 51
Main objectives and regulations - 2 Institutional accreditation is a periodically repeated mandatory process for all HEIs functioning on the territory of the Republic of Armenia The Statute on Accreditation of Tertiary Level Institutions and Academic Programmes in the Republic of Armenia is approved by RA Government Decree No 978-N on June 30, 2011 The primary provider of accreditations is the National Center for Professional Education Quality Assurance (ANQA), established in 2008 by RA Government. ASIIN Annual Conference - 2013, Stuttgart 52
Accreditation Phases Accreditation, both institutional and academic programme, is carried out in the following three consecutive phases I phase Self-assessment conducted by the educational institution II phase Site-visit carried out by an independent external expert panel III phase Production of the final report and decision making by ANQA Accreditation Committee ASIIN Annual Conference - 2013, Stuttgart 53
Facts and Figures - 1 Yerevan Polytechnic Institute (YPI) was founded in 1933 having only 2 departments and 107 students. In 1980-1985 reached its peak with about 25000 students and more than 66 majors, becoming the largest higher education institution in Armenia. On November 29, 1991, the Yerevan Polytechnic Institute was reorganized and renamed State Engineering University of Armenia (SEUA). In 2005, by the Resolution of the RA Government the traditional name Polytechnic was returned to the University as an acronym. ASIIN Annual Conference - 2013, Stuttgart 54
Facts and Figure - 2 The Central Campus of the University is located in Yerevan and the Branch Campuses - in Gyumri, Vanadzor and Kapan. 4 study programs of vocational and higher education conferring the qualification degrees of Junior Specialist, Bachelor, Master and Researcher (PhD). The University also offers extended education courses by means of a network of continuing education structures. The University has affiliated high schools in Yerevan and Regional Campuses, aimed at recruiting future gifted students from schools. ASIIN Annual Conference - 2013, Stuttgart 55
Copyright 2013 Synergy International Systems Inc. ALL RIGHTS RESERVED The Home Page of SEUA QАеS Portal SEUA Quality Assessment e-system Portal Each section in the portal provides information on the specific topic.
Copyright 2013 Synergy International Systems Inc. ALL RIGHTS RESERVED QАеS Portal: sharing possibilities Any particular topic in the portal can be shared in the social networks or via email.
Copyright 2013 Synergy International Systems Inc. ALL RIGHTS RESERVED QАеS Portal: Study Programme search Portal is equipped with a study program searching functionality.
QАеS Portal: study programme format Copyright 2013 Synergy International Systems Inc. ALL RIGHTS RESERVED
Copyright 2013 Synergy International Systems Inc. ALL RIGHTS RESERVED QАеS Portal: a bridge to the Tools Portal acts as a bridge to the QАеS Tools application. Portal is developed in Armenian and English languages.
Entrance to Study Programme Tools Copyright 2013 Synergy International Systems Inc. ALL RIGHTS RESERVED
Some document forms used in Tools Copyright 2013 Synergy International Systems Inc. ALL RIGHTS RESERVED
Some document forms used in Tools Copyright 2013 Synergy International Systems Inc. ALL RIGHTS RESERVED
Possible presentation forms of reviews Copyright 2013 Synergy International Systems Inc. ALL RIGHTS RESERVED
Possible presentation forms of reviews Copyright 2013 Synergy International Systems Inc. ALL RIGHTS RESERVED