Appendix B Catalonia Prepared by the Agencia per a la Qualitat del Sistema Universitari

Transcription

1 Appendix B Catalonia Prepared by the Agencia per a la Qualitat del Sistema Universitari En Europe coexiste une diversité de modèles d'institutions responsables de la promotion et de la gestion de l'évaluation de la qualité universitaire. Un élément qui marque la différence entre eux est le niveau de participation relatif des gouvernements et des universités au cours de leur configuration. En Catalogne, l'agence pour la Qualité du Système universitaire a adopté un modèle de caractère mixte auquel participent conjointement les universités publiques et l'administration universitaire. Le décret de fondation du Consortium Agence pour la Qualité du Système universitaire en Catalogne (Decret 335/1996 de 29 d'octobre, copie adjointe) dit: "(...) le système universitaire en Catalogne (...), afin d'atteindre le degré de qualité dans la prestation de services qu'il offre à la société (...), doit doter les différents niveaux de responsables, pour gouverner et gérer les universités catalanes, des instruments nécessaires pour l'évaluation de la qualité de l'enseignement et de la recherche, pour mettre en place des programmes d'amélioration et les rentabiliser, en dernier lieu, des ressources disponibles et de l'effort d'investissement dans le cadre des budgets publics. L'établissement d'un nouveau modèle de financement universitaire, dans lequel serait prises en compte l'évalution de la qualité des services prêtés par les universités, l'approbation des nouveaux cursus d'étude ainsi que la programmation universitaire dans ses deux aspectes de ré-ordonnancement de l'offre existante et d'implantation de nouveaux enseignements, obligent à disposer d'un système objectif et rigoureux d'évalution du fonctionnement du système universitaire considéré dans sa globalité (...)" Le Conseil de Direction de l'agence est constitué des recteurs et des présidents des Conseils sociaux des sept universités publiques catalanes qui, en étant quatorze menbres, constituent la majorité du Conseil, le gouvernement étant représenté par trois menbres, qui sont le gérant de la Commission pour les Universités et la Recherche et les directeurs des Universités et de la Recherche. Le président est nommé par le gouvernement, sur avis des recteurs et des présidents des Conseils sociaux; le directeur est nommé par la Commission, sur avis du Conseil de Direction; et le secrétaire est nommé par le Conseil de Direction. Ainsi, l'agence pour la Qualité du Système universitaire de Catalogne est configuré comme un instrument permettant d'impulser des mesures de qualité et d'évalution continue des universités, en même temps qu'il doit fournir les éléments de coordination nécessaires afin que les universités se proposent des objectifs et des programmes de qualité communs. Appendix C Overview: State of the art of external evaluation procedures in Europe Austria, University sector

2 Evaluation activity Initiators of evaluations No national agency but a national legal framework for evaluation procedures. Cross-university evaluations: The Ministry of Science and Transport and Universitätenkuratorium. Evaluations concerning the university or the respective study programme: Rectors and Deans of studies. Projects (on study programmes and disciplines). Programmes, research and institutional activities; affirmative actions (Federal Minister). Quality assurance and enhancement, development planning. The choice of the appropriate evaluation method (peer review, expert opinion, surveys, assessment of teaching through students, performance indicators) is at the initiators disposal. Peer review: self evaluation, site visit, report with proposals for enhancement. Teaching, research and organisational matters. Austria, Fachhochschulen Fachhochschulrat. evaluation Independent. 16 members, appointed by Ministry. Every 5 years Fachhochschul-study programmes must apply for recognition. Accreditation and evaluation board. Fachhochschul-study programmes/fachhochschulen. Programmes.

3 Accreditation/prolongation and quality improvement. An internal part (self evaluation), external part (peer review, site visit and final report) and followup. 14 aspects, e.g. pedagogic-didactic concept, research and development activities, organisation, international activities, resources, study programme etc. Belgium,flemish speaking commy Flemish Interuniversity Council. evaluation Rectors Conference. 8 years. Coordination and organisation of evaluations. All 6 universities. Programmes. Quality improvement and accountability. Self evaluation, site visits and public report. Teaching and learning. Belgium, frenchspeaking commy Legislation is being prepared to establish evaluation procedures for both the university and non-university sector. Denmark

4 evaluation Centre for Quality Assurance and Evaluation of Higher Education. Independent status under the Ministry of Education. The board consists of the five chairmen of the national education councils, who are appointed by the Minister of Education. 6 years. Planning, initiation and implementation of evaluations, secretariat for the experts. 12 university level institutions + non-university institutions. Programmes. Quality improvement. Self-evaluation, site visits, user-surveys, public report. Teaching and learning. Finland Finnish Higher Education Evaluation Council. evaluation Independent status under the Ministry of Education. Council consisting of 12 ministry appointed members from universities, polytechnics, student organisations and business and industry. Supportive body assisting the institutions and the Ministry of Education in evaluation activities. Planning, organisation and coordination of programme evaluation. Accreditation: planning and implementing. Institutional evaluation: funding of external team, consultation in planning and deciding the external team. 20 university-level institutions and 29 polytechnics. Institutional disciplines programmes and specific

5 themes. Audit and accreditation of polytechnics. Accreditation of continuing specialisation programmes. Polytechnics: accreditation and quality improvement Universities: quality improvement. Generally: steering committee for planning, self evaluation, peer review, public report. Programmes: Teaching and learning, in some cases research with the Finnish Academy. Institutional evaluations: strategy, organisational matters, facilities and services, finances, external contacts, quality assurance. Institutional audits: quality strategy. France Comité National d Evaluation. evaluation Independent referring to the President of the Republic. Council comprising 17 members: 11 academics., 4 representatives of the Economic and Social Council, 1 from the Conseil d Etat, 1 from the Cour des Comptes. 8-9 years. Coordination, planning and implementation of evaluations. Universities, "ecoles et les grandes etablissements" under the auspices of the Ministry of tertiary education. Institutional, disciplinary, analysis of institutional mission statements. Auditing purposes, quality improvement, information of stakeholders. Quantitative and qualitative.self evaluation. Experts conduct site visit, confidential report, CNE prepares final public report. All activities: teaching and research.

6 Germany Evaluation activities The 16 Länder are responsible for evaluation activities. There are three regional evaluation agencies. The Hochschulrektorenkonferenz has initiated national programme to enhance the exchange of information and experience on quality improvement. The programme runs from 1998 to Evaluations carried out so far cover universities and Fachhochschulen. subject-oriented at departmental (faculty) level. Internal self control as well as accountability. Annual/bi-annual teaching reports, self evaluation, visit by peers, evaluation report, follow-up including a contract between the evaluated department and the head of the institution. Greece Evaluation activities No documentation on national evaluation procedures has been made available Iceland Evaluation activities The Ministry of Education, Science and Culture carries out evaluations. None. Universities and institutions without research responsibilities. Programmes/ disciplines.

7 Quality improvement and accountability. Steering group, self evaluation, peer review team appointed by steering group, site visit, surveys, public final report. Teaching and learning. Ireland, university sector Pilot evaluations. Evaluation activities Universities, procedures to be reviewed by Higher Education Authority. 7 universities. Depends on the results of the pilots. Accountability and quality improvement. Peer review, self evaluation, site visit, public report. Teaching and learning, research, administrative s. Ireland, nonuniversity sector National Council for Educational Awards. evaluation Government. 5 years. Planning and implementation of quality assurance and accreditation. Non-university institutions. Institutional reviews, full course evaluations, programmatic reviews evaluation of new

8 institutions. Quality enhancement, accountability, accreditation. Self study, site visit and report. Teaching and learning. Italy According to new legislation: Evaluation activities 1. Each university has to set up assessment centres defining parameters 2. A national committee on evaluation has been established by the Ministry of Universities to evaluate the efficiency of the higher education system 3. A new rule on the allocation of state funds. Several pilot projects have been carried out since 1992 to test different evaluation and quality assurance approaches. Luxemburg Evaluation activities No documentation on national evaluation procedures has been made available. Netherlands, HBO-raad evaluation Netherlands Association of Universities of Professional Education (HBO-raad). Universities of professional education (Hogescholen) in the form of HBO-raad. 6 years, second cycle has started in Planning organisation and coordination of

9 evaluations, secretariat function in the external committees. 59 universities of professional education (hogescholen). Programmes. Quality improvement and accountability. Self evaluation, site visit, follow-up. Public evaluation report delivered in two parts: one for each institution and one for the sector. Teaching and learning. Netherlands, VSNU evaluation Association of Universities in the Netherlands (VSNU). Universities in the form of the Rectors Conference. Steering group for External Quality Assurance consisting of five presidents and rectors of Dutch universities. 6 years, 3rd cycle starts in year planning, organisation and implementation of the evaluations, secretariat function in the external committees. 14 universities. Disciplines/ programmes. Quality enhancement, improvement and accountability. Self evaluation, site visit, public report, metaevaluation. Teaching, learning and research. Norway Norway Network Council.

10 evaluation The Ministry of Education, Research and Church Affairs. Council comprising 13 members who are appointed by the Ministry. Advisory body on higher education which is among others responsible for quality assurance and development in higher education. All higher education institutions. Institutional evaluation, evaluation of programmes and aspects of broad interest for higher education. Quality audit. Quality assurance and development. Pilot projects comprised: Start conference, self evaluation, site visit, public final report. Pilot projects: Teaching and learning. Portugal The Evaluation Council. evaluation The Foundation of Portuguese Universities (FUP). 10 Council members from FUP, universities, industry and students. 7 years, first cycle will be finalised by year Coordination of evaluation projects. 15 universities and 1 public university-institution. Programmes. Quality improvement and accountability. Self evaluation, external evaluation comprising expert committee, site visit and final global report. Teaching and research.

11 Spain evaluation Plan Nacional de Evaluación de la Calidad de las Universidades. Council of Universities whose secretariat assures the coordination of the evaluation activities. The Permanent Assembly of the Council holds the overall responsibility for the activities, a Technical committee holds the practical responsibility. Each university has created a evaluation committee. Coordination and management of the national evaluation plan. 52 of 64 universities. Institutional. Quality improvement. Enhancement of the institutional evaluation at the universities. Self evaluation, external evaluation, final report on the. Report on the quality of the university prepared by the evaluation committee. Report on the quality of the universities prepared by the technical committee. Teaching, research and administration. Sweden The National Agency for Higher Education. evaluation Ministry of Education. A board whose members are appointed by government. The board represents the academic commy, students and business and industry. Seven departments, one of which is responsible for evaluation.

12 Audits are carried out in a 3 year cycle. Evaluations are carried out at an ad hoc basis. Accreditation is carried out at request. Responsibility for coordination of all evaluation activities at a national level. Whole public sector higher education, i.e. 14 universities, 17 university colleges and 7 colleges of fine arts. Quality audit, programmes/disciplines/phenomena relating to higher education and accreditation. Accountability and quality improvement. 1. Quality audit; audit team, self-evaluation, site visit, report. 2. Accreditation; application and peer review (incl. site visit) on the basis of given criteria. 3. Programme/discipline evaluation; varying according to the purpose of the projects. Ad 1. Strategies of quality enhancement, leadership. Ad 2. Teaching and the research element in the programme, depth and breadth, resources. Ad 3. Varying according to the purpose of the projects. United Kingdom evaluation The Quality Assurance Agency for Higher Education. Representative bodies of higher education institutions. A board whose members are appointed by the higher education institutions representative bodies (4), by Government (4) and 6 are independent. In summary: Operation of programmes of review of performance at institutional and programme levels. Promotion and support to continuous quality improvement Advice to government on degree

13 awarding powers and university title. Licensing of access courses. Audits of overseas collaborative links. All institutions offering higher education programmes. Institutional and programme level. Primarily accountability, but also enhancement. Audit: peer review based on self-assessment and quality assessment reports and site visit, audit report. Subject review: peer review, self assessment, visit, subject review report and subject overview reports. Institutional audit: quality strategy. Subject review: teaching and learning. Appendix D Guidelines for the presentation of the state of the art of national evaluation procedures in higher education in Europe CONTENT Evaluation procedures 1. of the evaluation procedures (who has initiated and who funds the evaluation activities: government, individual HE institutions, Rectors' Conference, a national agency or agencies owned by either the Ministry or the Rectors' Conference) In case of the existence of a national agency: 1.1 the governing structure of the national agency (e.g. board, committee, council) 1.2 evaluation cycle if any 1.3 the role of the evaluation agency in connection with an evaluation (e.g. responsibility for the administration, the secretariat functions or other) 2. Scope and level of the evaluation activities (e.g. only higher education or only vocational studies or both) 3. The evaluation focus (programmes, disciplines, institutions, quality assurance mechanisms or research or a mixture of those) 4. of evaluation activities (accountability, quality improvement, both) 5. The main elements of the evaluation procedures (type of experts used, the organisation of the self evaluation, the site visit, the report, publication policy) 6. which are evaluated (e.g. curriculum structure, teaching and examination methods, organisation and financing)