University Accreditation Commission SELF-EVALUATION REPORT Poznań, November 2008
SELF-EVALUATION REPORT Table of contents 1. Introduction 2. History of UAC and its role in the Polish higher education system 3. Methodology and procedures used by UAC 4. Standards concerning the accreditation of a field of study 5. Internal quality assurance 6. Compliance of UAC s operations with European Standards and Guidelines 7. Analysis of weak and strong parts of UAC 8. Future plans 9. List of abbreviations 10. List of tables 11. List of appendices 12. Appendices 2
1. Introduction The external review, the University Accreditation Commission is subject to, has the following purposes: University Accreditation Commission wants to confirm in this way its exceptional position in Poland as the best non-governmental quality assurance agency in the country and to send to the university sector the confirmation that it observes European standards and procedures and operates with the methods accepted by European agencies and European Quality Assurance Register. It also intends to improve its position in Europe and especially throughout the Bologna countries. The University Accreditation Commission as a quality assurance agency wishes to be included in the European Quality Assurance Register, therefore it is required to undergo external review to demonstrate that it operates in full or substantial compliance with the European Standards and Guidelines for Quality Assurance in Higher Education (ESG) as well as it fulfills the conditions specified by the European Quality Assurance Register. In this way the University Accreditation Commission also wants to fulfill the requirement of a regular audit, as specified in paragraph 3.8 of ESG. The University Accreditation Commission also finds in the review procedure, thus in preparing the SER and then in collecting opinions and remarks of the panel of experts, an excellent opportunity to confront its practice with the European standards, to identify its strengths and weaknesses and to improve its activity in such a manner.
2. History of UAC and its role in the Polish higher education system General information On October 18 th, 1997 the Agreement of Polish Universities Concerning the Quality of Education was signed. The Agreement aimed at the creation of the standards of education quality at universities according to those of the European Union, upgrading of the quality of education and the promotion of high-quality courses of studies. As a result of this agreement on January 31 st, 1998 according to the resolution of the Conference of Rectors of Polish Universities (CRPU) the University Accreditation Commission was established. The goals of UAC s activity were: the creation of an accreditation system of courses of studies at universities, promotion of students mobility both in the national and international dimension, enhancement of the education quality, creation and implementation of the standards of education quality at universities and recognition of the HEI s ensuring high quality of education. UAC carries out its mission by conducting assessments of the quality of education offered by higher education schools interested in obtaining the confirmation of this quality. Accreditation is voluntary and it is accorded to a concrete field of study (not to the whole institution or its department). The activity of UAC covers Polish universities, but it may also cover other Polish higher education schools upon their request for the accreditation of their courses of studies. UAC consists of vice-rectors of the schools-signatories of the aforementioned Agreement. The tenure of UAC members is equal to the term of academic authorities (in years 1998-2008 3 years, from this year 4). In its 10 years of activity UAC accorded the accreditation in 40 fields of study and accomplished more than 400 accreditation procedures. As the accreditation is accorded generally for 5 years, UAC acting in a regular way has already started reaccreditation procedures. About twelve hundred professors as experts preparing standards and members of assessment groups were involved in the activity of UAC. Basic principles of the activity of UAC Polish universities have always been seen as a special part of the Polish higher education sector. The university education has traditionally been strongly related to research, and academic excellence was the most important factor for the assessment of both the faculty and the students. For many years (till the beginning of 90s), due to a limited enrollment and the system of entry examinations, university students represented the top group of school graduates and were additionally subject to a strong selection during the first two years of their university career. The graduates were often better educated than those leaving other European universities, but at the same time in terms of the number of students per total population, Poland was located far behind other developed European countries. 4
This situation started to change quite dramatically in the last decade of the twentieth century. Despite a decrease in the funding of the higher education sector there has been a dramatic increase of the number of students, which has, since then, at least tripled. A growing demand for higher education was accompanied by the development of the private education sector and by a rapid expansion of the system of fee based extramural studies at state-supported and private schools. Therefore, very quickly, a growing concern has been observed with the ways of keeping the quality standards among many of the academics. Universities still hold their special position among all higher education institutions in Poland. There is only 19 of them (the total number of higher education schools in Poland is about 400), but they provide education to more than 30% of all students in our country. Although subject to pressures resulting from the economic situation and the increasing number of students, universities still cultivate the old academic culture and try to evolve in order to respond to challenges of the new socio-economic situation, needs of the society, and more generally, of their external environment. Always willing to extend co-operation with foreign schools, universities were enthusiastic to make the most of the opportunity given by the Socrates program. However, while preparing to introduce the ECTS points, universities realised that what was really needed was a more general solution ensuring compatible and agreed quality standards, thus allowing for the mobility of students, and for a general solution to assurance and management of the quality of higher education. Very soon it became clear that the only way to achieve those goals was to create a system of accreditation. The problem was urgent and since the Ministry of Higher Education was not capable of delivering a solution in the foreseeable future it was decided to establish an organisation that, at least for the time being, would help familiarise academic communities with the idea of accreditation. A formal decision was made during the meeting of the Conference of Rectors of Polish Universities in January 1998, after an intensive preparatory work of the task committee formed by a group of vice-rectors from all universities and other academic schools. That decision established four basic principles of the university accreditation: accreditation would be voluntary evaluation would involve fields of study rather than the whole institutions or their departments evaluation criteria should be developed by representatives of the faculty from the units involved - separately for different fields of study the final outcome of the evaluation should be of a yes-no character rather than a multi- grade classification. It was also agreed that the necessary conditions to apply for accreditation would be the implementation of an internal system of the quality management and the ECTS. Why voluntary? Academic communities are not so much in favour of having any external bodies influencing their policies. Polish universities, similarly to other universities around the world are not necessarily fond of rapid changes - in other words - they prefer evolutions to revolutions. Therefore, it was assumed that the introduction of the university accreditation might be successful only if the faculty members accept the need for it and decide to join in voluntarily. If so happens accreditation will result in a creation of a kind 5
of a good quality club and as such it will attract new members seeking recognition of their qualities. One of the basic principles of accreditation - voluntary accreditation - adds a positive feature to it. Why fields of study rather than institutions? All higher education institutions in Poland are noticeably differentiated and this is true also for Polish universities. They differ in terms of size and structure. Also, within each university one finds outstanding departments of which a given institution can be proud and such units which, so to say, deviated from their path to excellence. Therefore, accreditation of whole universities or faculties would not create an atmosphere of a serious self-assessment and improvement, but would rather stimulate protective behaviour with a final result of having all universities accredited without inducing real changes. Moreover, such unspecific accreditation would have to be based on very general criteria and it is well known that using macroscopic parameters one often gets a false picture of events on a microscopic level. Finally, there are several areas of education subject to intensive and sometimes even revolutionary changes: librarianship is evolving towards information management and services, environment protection has nearly as many meanings as there are schools teaching it, also there is a general trend for introducing all kinds of interdisciplinary studies, new curricula etc. One can expect that at least in some fields of study evaluations will have to be based on flexible and changing standards. This is yet another reason for having assessment criteria designed by representatives of a given faculty from units involved - separately for different fields of study. Without an agreement on compatibility of curricula and harmonised standards, an increase of students' mobility both within a university and also between different schools would be unimaginable. Such an agreement is an indispensable necessity for opening channels of continuous education and especially for switching students from one level of the university education to another. Two-grade scale of evaluations The creation of an objective, quantitative assessment of the quality of education is simply inconceivable. Moreover, even if it were possible, the process of "measurement" would take a prohibitively long time, probably about ten years. Thus, the period between data collection and its future assessment in a subsequent situation would make collected information unreliable because the data would simply become void and therefore of little use. Up until now, the only tested method is peer review - a practice most commonly used in evaluations of scientific projects and publications. Such an evaluation, however, by its nature is of a qualitative rather than quantitative nature. Therefore, the natural outcome of such an assessment should be good enough or not good enough. Now, after 10 years of activity we are ready to introduce the system of four-grades evaluations (outstanding, good, acceptable, non-acceptable). Serving the universities but opening for other schools As it follows from the above discussion UAC has been established to help universities sustain the quality of education, support the development of new courses, help universities solve problems of student mobility (on a national and international scale), 6
finally - organise continuous education and in the long run - ensure international recognition of Polish degrees and certificates. However, it was clear from the very beginning that university accreditation should be extended also to other schools, especially for collegiate schools and higher education institutions offering the same courses as those taught at the universities. The majority of colleges offer their students the Bachelor's degree and therefore many of the graduates want to continue education at universities. Secondly, there are majors taught mostly at schools other than universities and in such cases it would only be natural to think of creating joint accreditation paths instead of doubling efforts and creating independent accreditation systems. The main activities of UAC Accreditation is the main area of UAC s activity. First units were accredited upon preparing the necessary documents and process principles in June 1999. Throughout ten years of its activity the University Accreditation Commission performed over 400 accreditation processes in 39 fields of study and within the scope of Artes Liberales Academy program conducted jointly by several universities. In total 393 certificates of high education quality have been issued, including 23 for the period of two years. Accreditation renewal processes are currently being conducted. A significant complement of the UAC s activity is MOST Student Mobility Program, adopted by CRPU in 1999 and which was commenced in the academic year 2000/2001. This program enables students from the universities forming UAC to do part of their studies (one semester or one academic year) in another higher education institution which is a member of UAC so that it counts as part of their course of studies. Nearly one thousand people take advantage of such a possibility every year. All organizational activities related to the implementation of this program (determination of the student number limits for each higher education institution, coordination of applications, delivery of the necessary documents etc.) are performed by the UAC s Office. The University Accreditation Commission also provides a convenient platform for experience exchange and exchange of information on issues important for the academic community in Poland. Within the activities of UAC projects of electronic registration of candidates for studies have been developed, interventions have been made to resolve urgent issues (e.g. teacher standards), common positions of universities have been developed (e.g. in the scope of teaching foreign languages or requirements to be fulfilled by a higher education institution in order to provide the macro-field of study). A survey concerning the stage of the implementation of the Bologna Process in Polish universities was performed twice (2004 and 2006). Since 1999 the University Accreditation Commission has annually issued a Bulletin containing basic data on higher education institutions signatories of the Agreement Concerning the Quality of Education. Apart from the Bulletin many valuable publications devoted to the evaluation problems, such as: - Ewaluacja a jakość kształcenia w szkole wyższej [Evaluation and the education quality in a higher education institution], edited by Anna Brzezińska, Jerzy Brzeziński and Andrzej Eliasz (SWPS Publishing House, 2004) 7
- Ewaluacja procesu kształcenia w szkole wyższej [Evaluation of the teaching process in a higher education institution], edited by Anna Brzezińska and Jerzy Brzeziński (Humaniora Foundation Publishing House, 2000) - Proces Boloński zbiór dokumentów [Bologna Process Set of documents] (UAC, 2004) have been issued within the framework of UAC. The University Accreditation Commission cooperates with other organisations or institutions for education quality assurance. The Agreement on mutual recognition of the accreditation of the chemistry fields of study was concluded between UAC and the Accreditation Commission for Technical Universities in the fall of 2006. In 2008, UAC concluded an agreement on mutual accreditation of chemistry fields of study with the European Chemistry Network. First common accreditation certificates were granted this year in June. UAC was a co-founder of the Central and Eastern European Network of Quality Assurance Agencies in Higher Education (CEE Network) and participates in its activities on a regular basis. In 2002-2006 prof. Stanisław Chwirot, the chairman of UAC, was a member of the Network s Steering Committee, whereas, since 2006 prof. Marek Wąsowicz, the present chairman of UAC, has held a seat on the Steering Committee. 8
3. Methodology and procedures used by UAC The accreditation process conducted by the University Accreditation Commission is: voluntary the accreditation system is developed for a given field of study only when at least five units of various universities providing this field of study are interested in the accreditation diverse the education quality standards are developed by experts selected from among persons proposed by communities interested in accreditation. UAC required only that these standards were not lower than those resulting from the corresponding legal acts and imposed the necessity to implement the ECTS system and the internal system for the education quality assessment and management. The experts who develop standards are suggested that these should be significantly higher than the legally required minimum so that the university accreditation may lead to the establishment of the High Education Quality Club positive the organizational unit requests for the education quality certificate and knows the standards to be fulfilled in order to obtain the accreditation. The preparation of the request involves deep self-evaluation. Further, its outcomes are verified by the evaluation team inspection. Moreover, in case of the refusal to grant the accreditation the decision is not publicly announced temporary the CRPU s education quality certificate is granted for a definite period of time for five years in principle and in exceptional cases for two years. After the expiry of this period the entire accreditation process is repeated and an additional assessment criterion is the implementation of the evaluation team s recommendations mentioned in the minutes from the previous inspection open the basic goal of the university accreditation is the promotion of the high education quality at the higher level. Therefore, the university accreditation system is open for each school providing a field of study for which there are accreditation procedures (participation in the accreditation process is presented in Table no.1). 9
Table no.1 ACCREDITATION GRANTED IN 1999-2008 1999-2001- 2003-2005- 2007- Total 2000 2002 2004 2006 2008 Catholic University of Lublin 4 5-7 2 18 Pontifical Academy of Theology 1 1 1 1 1 5 A. Mickiewicz University 7 14 6 7 7 41 University of Gdańsk 3 7 2-3 15 Jagiellonian University 7 15 6 2 10 40 Cardinal Stefan Wyszyński University 1 3-1 2 7 University of Łódź 5 10 6 5 4 30 M. Curie-Skłodowska University 5 12 4 5 2 28 Nicolaus Copernicus University 4 11 5 3 3 26 University of Opole 2 3-3 - 8 Rzeszów University - - - 1-1 University of Szczecin 1 6 3 - - 10 University of Silesia 4 10 4 1 3 22 Warsaw University 5 17 9 6 12 49 University of Białystok - 3 1-1 5 University of Warmia and Mazury - 8 1 - - 9 University of Wrocław 4 13 4 6 7 34 University of Zielona Góra - 1 1 - - 2 University of Gdańsk and Medical Universtity of Gdańsk - 1 - - 1 2 University of Technology and Life Sciences in Bydgoszcz - 1 - - - 1 AGH Universtity of Science and Technology - 3 - - 1 4 Pułtusk Academy of Humanities - - - - 1 1 The Academy of Fine Arts in Cracow - - 1 - - 1 The Academy of Fine Arts in Warsaw - - 1 - - 1 Pedagogical University of Cracow - 1 - - - 1 University of Podlasie - - 1 - - 1 Collegium Civitas - - 1 - - 1 Gdańsk University of Technology - 1 1 - - 2 Cracow University of Technology - 2 - - - 2 Technical University of Łódź - 5 - - 1 6 Poznań University of Technology - 1 - - - 1 Rzeszów University of Technology - 1 - - - 1 Szczecin University of Technology - - 2 - - 2 Silesian University of Technology - 2 - - - 2 Warsaw University of Technology - 2 1 - - 3 Wrocław University of Technology - 4 - - 3 7 Pontifical Faculty of Theology in - 1 - - - 1 Wrocław Academia Artes Liberales program - 1 - - - 1 Warsaw School of Social Sciences 1 - - - - 1 and Humanities Warsaw University of Life Sciences - - - - 1 1 54 165 61 48 65 393 10
The accreditation procedure for a given field of study is commenced when at least five universities file accreditation requests. The number of higher education institutions requesting accreditation may be lower in case of unique fields of study provided by few higher education institutions (such as musicology). The requirement of five units requesting accreditation does not apply in case of the accreditation renewal for a successive period. So far UAC regulations relate to fields of study mentioned in the list announced by the Minister of Science and Higher Education. Many universities currently established, with the Minister s consent, specific fields of study (such as acoustics at Adam Mickiewicz Universtity); other similar requests await the decision to be made. This means that, in the future, UAC will need to consider the possibility of conducting accreditation processes for such new fields of study as well (thus at the request of one higher education institution). The development of the accreditation system for one field of study lasts from one to one and a half year. The accreditation of a field of study for which standards have already been developed lasts approximately 4 months. The specificity of the UAC s activities involves inclusion of persons appointed by the academic community into the accreditation process. The particular standards of the assessment are therefore developed with the participation of the representatives of stakeholders. The faculty (department) requesting accreditation for a particular field of study presents at the same time a list of candidates for the group of experts, evaluation teams and appellate teams to UAC. The list of candidates should include two independent academics employed in the higher education institution requesting accreditation and three independent academics from the outside this institution. Moreover, the list should contain basic information about the achievements of the candidates (along with a written consent to become candidates). From all of the proposed candidates UAC selects a group of experts, between six to twelve individuals, including the chairman of the group and evaluation teams, after the standards are approved. The group of experts and the evaluation teams are elected for the period of four years. The task of the group of experts is to prepare, within two months since the appointment, particular standards of the quality of education for a given field of study. These standards should meet the aforementioned requirements and generally specify higher requirements than those resulting from the commonly effective regulations. The particular standards are subject to approval by UAC. During the first three years of UAC s operation the group of experts carried out a systematic review of the standards of the quality of education which was related to the need to specify and modernize the contents of the curriculum of a given field of study. The University Accreditation Commission has developed a new formula of standards, greater importance is attached to the determination of education goals and the examination of their outcomes. The new formula of standards (through the introduction of a greater number of the assessed education process elements, the teaching staff and the infrastructure supporting the teaching process) should also facilitate diverse final assessments (according to the four degree scale), which will provide better knowledge about the extent of compliance with four groups of standards related to: the teaching staff with research taken into consideration, the teaching process, the internal quality assurance system and the teaching infrastructure. 11
The unit is assessed by the evaluation team including from 3 to 5 individuals. Its composition (approved by UAC) is selected in such a way as to avoid crossassessment of the accredited units. Moreover, a rule applies that an individual employed in a higher education institution under assessment cannot be a member of the evaluation team. Members of the evaluation team choose a chairman from among their team, who directs the works of the team. The tasks of the evaluation team include conducting a comprehensive assessment of the education in a specific field of study in a given higher education school on the basis of the general and particular standards prepared by the group of experts. Within this scope the basic material is a request for accreditation, which is essentially the selfevaluation report prepared (according to the model suggested by UAC) by the unit of the higher education institution subject to the assessment. The necessary element of the assessment is the inspection of the higher education institution which allows to verify the information contained in the self-evaluation report and also involves meetings with the academic staff and students and the management of the faculty and of the higher education institution. After the completion of the inspection the evaluation team prepares a written report and presents it to UAC along with a request to award accreditation, to defer accreditation until specific conditions are met or to refuse accreditation. The period between the appointment of the team and the submission of the final report cannot exceed 6 months. Upon investigating the report prepared by the evaluation team UAC makes the relevant decision through the adoption of a resolution. In case the evaluation team prepares a request for two-year accreditation, deferment of the accreditation or its refusal, the Presidium of UAC transfers the report to the higher education institution concerned, which can raise its comments and objections (within 30 days). When the higher education institution questions the findings and the conclusions of the report, UAC appoints an appellate team. The appellate team consists of three to five individuals selected from among the candidates proposed by the higher education institutions who had not previously participated in the accreditation process. The appellate team may change the evaluation of the evaluation team and formulate a different conclusion. UAC makes resolutions in an open voting by the majority of votes with the presence of at least 50% of its members. By March 24th, 2007 (i.e. till the change of the Principles of the accreditation process) the resolutions of UAC on accreditation, its deferment or refusal were transferred to the approval by the Conference of Rectors of Polish Universities. From March 24th, 2007 the resolutions of UAC on granting the accreditation, refusal or deferment of accreditation are final in relation to processes commenced after this date. CRPU has merely the competence of the final instance to which the higher education institution concerned may appeal against the UAC s decision only in case of the breach of procedures. In such a situation the case returns to UAC which repeats the accreditation process. The accreditation of the University Accreditation Commission is granted for five years (and in exceptional cases for two years). During this period UAC monitors the compliance with standards of a given unit and in case explicit deviations are found it may upon the application of the aforementioned procedures adopt the resolution to revoke the education quality certificate granted to the unit. Upon the expiry of the five (or two) year period the unit concerned may request the renewal of the accreditation. 12
The accreditation process is paid. The accreditation fee is PLN 12 000 and is paid when the request for accreditation is filed. The total amount is alloted for the remunerations of experts, members of evaluation and appellate teams and for the coverage of inspection costs. 13
4. Standards concerning the accreditation of a field of study 4.1 The development of accreditation standards The particular accreditation standards are determined for individual fields of study by a group of experts, taking into consideration the requirements stipulated in the Resolution on principles of the accreditation process of CRPU of January 31 st, 1998. Two necessary prerequisites have been stipulated in the Resolution: having implemented the internal principles of stimulation and assessment of the quality of education having developed a credit system compliant with the ECTS. The first requirement results form the basic task of UAC which is the stimulation of quality improvement and aims at the introduction of an organized and increasingly professional management of education quality into the Polish higher education institutions. The second requirement was the expression of the strategic policy of CRPU intended for the stimulation of the participation in the European student and employee exchange programs and fast and full preparation of the higher education institutions for integration with the European education systems. The implementation of ECTS is also aimed at establishing a framework for the stimulation of student mobility between domestic higher education institutions. The main general requirement of the guidlines contained in the CRPU s Resolution of 1998, on principles of the accreditation process, is compliance with the staff requirements specified by UAC for a given field of study and compliance with the particular standards developed by the group of experts. At that time, the principle of maintaining the relationship between teaching and research resulting from the tradition was recognized as important to the extent that it was included in the Magna Charta of European Universities (Bologna 1988). The other general requirements introduced in the CRPU s Resolution were as follows: the compliance of classes (lectures, seminars, practices, labs etc.) with the academic specialization and research achievements of academics conducting them employed in the higher education institution as full-time employees the participation of professors in the performance of the curriculum the number of students in a given field of study per one independent academic for which the higher education institution providing the field of study under accreditation is a primary full-time workplace. The maximum numbers will be specified by the group of experts the compliance of the study program in a given field of study and the cycle of studies, including particular subjects and issues, with the scope of knowledge and skills, which are necessary to achieve the European education standards the graduate profile specified by the organizational unit providing a given field of study examination of the students opinions about the conducted teaching classes 14
the teaching infrastructure including, in particular, the availability of literature recommended for the individual subjects to students, in the library of the higher education institution the modernity of the teaching technologies applied and the adequacy of the equipment of laboratories and other teaching rooms to the number of students having documented cooperation with important academic centers providing a similar field of study; in case of foreign higher education institutions lecturer and student exchanges. Entrusting the development of particular standards to the UAC s groups of experts results from the following assumptions: each community can and should develop standards adequate to the requirements relating to the teaching in a given field of study (geographers field classes; physicists, chemists, biologists, biotechnologists laboratory classes; specialists in humanities requirements concerning the operation of the library) many disciplines of education are subject to dynamic changes of curricula and contents, which should be reflected in the periodic reviews of standards university education is inherently associated with scientific research. Thus, the research level is one of the unit assessment criteria and the requirements concerning the quality of the staff must be determined adequately to the situation in various disciplines, always in such a way that they should indicate the level higher than the average and stimulate development. The accreditation standards have been subject to dynamic changes resulting from amendments to legal regulations concerning higher education, the performance of tasks imposed by the Bologna Process. In 2002 the Minister of Science and Higher Education introduced education standards for the majority of fields of study; therefore, experts could refer to them as being in force and they stopped determining the curriculum contents. In the same year the Minister of Science and Higher Education specified requirements to be fulfilled by the unit for establishing and conducting a field of study and indicators concerning the number of students per one titular professor or doctor with a postdoctoral degree conducting the field of study. The UAC s particular standards contained requirements much higher than those introduced by the Minister of Science and Higher Education within the scope of a number of teaching staff (a number of professors or doctors with the postdoctoral degree with a speciality corresponding to the field of study) or a number of students preparing diploma theses per one professor or doctor with a postdoctoral degree, the size of student groups or representing all specialities in the field of study by employees with the postdoctoral degree. The presence of ECTS package was the condition for the possibility of requesting accreditation, which motivated its development and implementation of the national MOST student mobility program, assuming the settlement of student s achievements on the basis of ECTS credits to be used not only in case of foreign student exchange. ECTS was introduced into the Polish higher education system in 2006. 15
Three-cycle organization of studies was introduced through the Higher Education Act of July 2005 and standards for successive fields of study contain conditions for the accreditation of 1 st and 2 nd cycle of studies. In recent years UAC also attached importance to the formation of friendly study environment for the disabled people by universities. After 9 years of activity, the performance of a few hundred accreditation processes, the University Accreditation Commission developed suggestions of amendments in the Resolution on the accreditation process. These concern both the preliminary requirements of the accreditation and the particular requirements which are indications for groups of experts how to develop standards for individual fields of study. The Conference of Rectors of Polish Universities approved these amendments on March 7 th, 2008. They are valid for fields of study for which particular standards are currently developed and will be approved in the future. The first is journalism and social communication. 4.2 The effective accreditation standards 4.2.1 Preliminary requirements Upon the amendment of the CRPU s resolution on principles of the accreditation process the preliminary requirements are stipulated in the article 22 of the CRPU s Resolution on principles of the accreditation process (of January 31 st, 1998, as amended). The preliminary requirements are as follows: the unit requesting accreditation of a field of study meets all requirements of the education standards for a given field of study specified by the Minister of Science and Higher Education, it meets conditions required by the Minister of Science and Higher Education to conduct a field of study the unit implemented an internal quality assurance system and the ECTS system (a credit system compliant with the European system (ECTS) had been introduced for a given field of study) the field of study and the level of education fulfill the staff requirements adopted by UAC in particular standards for a given field of study the unit requesting accreditation of a field of study or the unit in which the unit requesting accreditation is located is entitled to award doctoral degrees and meets particular standards concerning: the academic staff the teaching process the teaching infrastructure the internal quality assurance system. 4.2.2 The academic staff The evaluation of the academic staff, conducting classes in the accredited field of study, shall concern: 16
the education level and the improvement of the academic teachers qualifications teaching achievements of academics achievements of academics the work of academics for the home university Appendix no. 4 - Appendix no. 7 to the Resolution: Criteria for the evaluation of the academic staff. 4.2.3 The teaching process The evaluation regarding the teaching process shall concern: the compliance of the study program, the teaching program and the forms of classes in a given field of study and the level of studies, including particular subjects and issues, with the scope of knowledge and skills which are necessary to achieve the profile of a graduate the staff teaching classes, especially the compliance with the type of classes with the research specialization and research achievements of the academic teachers conducting classes the method of informing about the study program and the curriculum the organization of seminars and the quality of diploma theses scholarly activity of students. Appendix no. 5 - Appendix no. 8 to the Resolution: Criteria for the evaluation of the teaching process. 4.2.4 The teaching infrastructure The evaluation regarding the teaching infrastructure shall concern: the adjustment of the auditoriums, teaching rooms, laboratories and their equipment to the number of students the IT infrastructure 1) libraries, publishing houses and printing houses, academic bookstores 2) administrative facilities connected with the teaching process 3) student facilities 4) conditions for the teaching of the disabled. Appendix no. 6 - Appendix no. 9 to the Resolution: Criteria for the assessment of the teaching infrastructure. 4.2.5 The internal quality assurance system The evaluation regarding the operation of the internal quality assurance system shall concern: the method of verifying the assumptions of the study program and supervising the results of its execution the method of informing about the teaching offer and the contents of this information 17
the method for determining the roles of all participants of the teaching process, including students 1) the method of student evaluation 2) the method of evaluating the teaching staff Appendix no. 7 - Appendix no. 10 to the Resolution: Criteria for the evaluation of the internal system of quality assurance. 4.3 Accreditation standards for fields of study Various Polish higher education institutions (technical, medical, artistic) provide 118 fields of study. A few dozen of them are provided by universities. UAC established accreditation systems for the majority of them (33 fields of study, 6 philological specialities and 1 program). Units providing them expressed a will to undergo the assessment of the community. Some university fields of study such as law, mathematics, administration did not request accreditation yet. Appendix no. 8 Accreditation granted in 1999-2000 Appendix no. 9 Accreditation granted in 2001-2002 Appendix no. 10 Accreditation granted in 2003-2004 Appendix no. 11 Accreditation granted in 2005-2006 Appendix no. 12 Accreditation granted in 2007-2008 Appendix no. 21 Accreditation standards for the philosophy field of study Appendix no. 22 Accreditation standards for the oceanography field of study Appendix no. 23 Accreditation standards for the biotechnology field of study Appendix no. 24 Part I Accreditation standards for the first-cycle studies in chemistry, process engineering and chemical technology fields of study Part II Accreditation standards for the second-cycle studies in chemistry, chemical technology and chemical and process engineering fields of study Appendix no. 25 Accreditation standards for the slavic speciality in the philology field of study 18
5. Internal quality assurance The efficiency of managing people at an institution, and especially UAC, largely depends on the fact if people responsible for the results of work are able to create conditions that motivate employees to the attainment of common goals. It concerns three aspects: the impact on the group chaired by them, the impact on the other people s behavior and on goals to be achieved. Outstanding leaders, commited to work employees who form competent teams and cleary set goals are important determinants of leadership, which is an element of the system at UAC. The single-person bodies of UAC are as follows: the chairman of UAC and the secretary. The collegial bodies are: Presidium of UAC, composed of the Chairman and their deputies and Commission, composed of 19 vice-rectors appointed by universities and a person appointed by the Conference of Rectors of Polish Universities. The Vice- Rectors are appointed in particular higher education institutions according to the their own statutes. They shape the education quality culture in their own higher education institutions. The Secretary participates in the works of the Presidium of UAC. Groups of experts and evaluation teams are the bodies appointed by UAC for each field of study subject to the accreditation. The Chairman, Presidium and Commission develop a long-term policy of UAC concerning the achievement of goals and perform operational activities UAC meets chairmen of groups of experts and chairmen of evaluation teams. It takes decisions about their composition, approves particular standards and grants accreditation. The Secretary and UAC Office play a particular role. Their tasks include organizing the current work of the commission, maintaining contacts with higher education schools interested in accreditation, providing organizational and technical conditions for the works of UAC, groups of experts and evaluation teams. The Office maintains a web site www.uka.amu.edu.pl, each year issues the Bulletin How to obtain the mark of quality, organizes seminars for evaluation teams, participates in the organization of evaluation team inspections, maintains contacts with groups of experts, evaluation teams and higher education schools, conducts the national MOST student mobility program in cooperation with Universities-signatories of the Agreement for Education Quality. Appendix no. 2 The Resolution of the Conference of Rectors of Polish Universities of January 31 st 1998 concerning the principles of the accreditation procedure Table no. 2 The University Accreditation Commission location and its bodies Throughout over ten-year of its activity UAC aimed at the achievement of goals stipulated in its mission: stimulation of the improvement of the quality of education determination of the teaching standards development of an accreditation system for fields of study 19
Table no. 2 The University Accreditation Commission location and its bodies 20
Throughout successive years these goals were achieved by UAC which formulated long- and short-term tasks: from the popularization of the accreditation idea among the Polish academic community to the establishment of the accreditation of the fields of study. The University Accreditation Commission developed models of documents, internal principles concerning the monitoring of the compliance with the standards, the renewal of accreditation, principles of the appointment of evaluation teams. In 2009 UAC will commence the 3 rd round of accreditation of the first accredited fields of study. The Universtity Accreditation Commission appointed as many groups of experts as there are fields of study, large philology specialities and programs it accredited. The groups of experts are composed of professors or doctors with a postdoctoral degree who enjoy prestige in the academic community and ensure reliable and responsible performance of tasks. In case of unique fields of study (e.g. oceanography) professor Blanchard from the University in La Rochelle (France) (an expert in this field) was invited to be an expert. For the first round of accreditation of the journalism field of study the experts were: professor Gerd G. Kopper from the University in Dortmund (Germany) and an illustrious representative of the journalist practice (Mr Stanisław Podemski, ed.). The group of experts and the evaluation teams are elected for the period of four years. After the expiry of this period the groups of experts are appointed for the next tenure. Partly, the same individuals are appointed by the community to the groups of experts. The evaluation teams are composed of experts and other individuals appointed by experts from the list of individuals proposed by higher education institutions according to article 10. Students who are members of evaluation teams represent the student government of the higher education institution providing the field of study under assessment. The University Accreditation Commission cooperates with the local accreditation commissions within the framework of the Conference of Rectors of Polish Academic Schools they are members of the CRPAS Accreditation Commission. UAC cooperates with the Accreditation Commission of Technical Universities within the scope of the accreditation of chemical fields of study (the commissions concluded the agreement for mutual recognition of accreditation of chemical fields of study); the informatics field of study (provided by both universities and universities of technology) was accredited in cooperation with experts of this commission. UAC also cooperates with the Accreditation Commission of the Foundation for the Promotion and Accreditation of Economics Fields of study (a representative of UAC is a member of this commission). The University Accreditation Commission participates in meetings of the Quality Forum organized each year. UAC is a member of the CEEN Network. In 2008 UAC signed an agreement with the European Thematic Chemistry Network Assotiation on the common accreditation of chemical fields of study. Apart from the UAC s evaluation teams aslo international experts were members of evaluation teams. Eurobachelor Label of Chemistry and Euromaster Label of Chemistry accreditation were granted to 5 units (Appendix no. 15). UAC introduced internal principles of the appointment of groups of experts and evaluation teams. The members of these bodies are selected by UAC from the list of individuals proposed by units providing a given field of study. The unit proposes two its own professors or doctors with a postdoctoral degree and three from the outside (candidates are members of the Polish Academy of Sciences, employees of other types 21
of higher education institutions such as universities of life sciences, of technology, of economics and medical universities and scientific institutes). The principles of the University Accreditation Commission for the appointment of evaluation teams are shaped by experience they are composed of experts determining the standards and other individuals selected by this group from the list of individuals proposed by higher education institutions providing a given field of study. From among them teams counting 3-5 individuals are selected during a special seminar organized in order to prepare candidates for the role of evaluators of the specific field of study provided by the specific higher education institution. The teams are appointed by the very community according to the following principles: no member of a team can be a person who was or is employed in the higher education institution subject to the assessment, An individual may request to be excluded from the suggested team composition due to the broadly defined conflict of interests, mutual assessments are unacceptable (team A goes to B, B goes to C, C to A). various specialities provided within the framework of a given field of study are, if possible, represented in the team (Appendix no. 17 - Appointment of expert groups and evaluation teams). UAC developed mechanisms for the preparation of the evaluation teams for the execution of difficult and peculiar tasks seminars for the evaluation teams. At these seminars members of evaluation teams obtain detailed information on tasks to be performed, on psychological conditions, on further procedures and experience of their predecessors (in case of the renewal of accreditation after the expiry of a five year period) or of similar fields of study or the model one psychology is presented. A member of the Presidium of UAC or a Secretary of UAC participates in the seminar. UAC has its own internal principles of monitoring the compliance with accreditation requirements (Appendix no. 20 Monitoring the compliance with the standards). UAC introduced a suggested schedule of the inspection of the evaluation team (Appendix no. 14). UAC has its own internal principles of the renewal of accreditation (Appendix no. 18). The participants of the accreditation process are: management and academics of the units providing the field of study requesting accreditation at universities or in other public or non-public higher education schools (if they request such accreditation), students, students of doctoral studies. During the accreditation process members of evaluation teams meet academics and students (which is obligatorily included in the inspection schedule) and additionaly with academics and students during inspections of selected classes. During these meetings the participants in the accreditation process share observations concerning the education quality and the conducted accreditation process. Members of the evaluation team exchange opinions and formulate recommendations. They transfer them to the Rector s management at the final meeting. 22
The inspection is an excellent opportunity to become acquainted with the experience of colleagues. The team s task is not to control but to find if standards are met and in case there are objections to indicate how the standards may be achieved. Fast development of the university accreditation, especially in the first 5 years, could not be possible without the involvement of hundreds of individuals who for the common good accepted additional charges of both the preparation of requests for accreditation and procedures and also the performance of difficult tasks which include a reliable and objective assessment of faculties, departments and chairs applying for accreditation. An important effect was to give a new meaning to the importance of education quality issues at universities. Another important, although constituting a side effect, was the increasing integrity of the university community. Upon accreditation one can observe an increase in the horizontal contacts between units participating in accreditation. The introduction of a broad, common accreditation conducted by the State Accreditation Committee obligatory for all fields of study, the development of programs for first and second cycle studies, significantly higher standards of the UAC regarding both staff and the teaching process have slightly decreased the number of units applying for the renewal of accreditation which can be seen in the course of 2 nd round of accreditation. For many years UAC has informed study candidates in the Bulletin for high school graduates issued annualy by the weekly Perspektywy about fields of study which have UAC accreditation. 23
6. Compliance of UAC s operations with European Standards and Guidelines ENQA European standards for the external quality assurance of higher education 2.1 Use of internal quality assurance procedures Standard: External quality assurance procedures should take into account the effectiveness of the internal quality assurance processes described in Part I of the European Standards and Guidelines The standard and the procedures adopted by UAC contain all the elements of the internal quality assurance system described in Part I of the European Standards and Guidelines. UAC requires the unit requesting accreditation of a field of study to submit a request for accreditation which is a type of a self-evaluation report, of having the internal quality assurance system which contains the following requirements: constant verification of the program assumptions by external experts the existence of formal procedures stipulating the approval of the programs by external bodies regular review of the programs adapting the contents of the programs to the profile and the mode of the studies, the availability of the didactic offer, the program assumptions and the expected results of the education a clearly defined role of the students and other participants of education in the quality assurance process clearly defined (published) criteria and procedures for student evaluation: - appropriate to the goals of education (the program of studies and courses - taking into account the stages of the program execution (diagnostic evaluation, current, final) - taking into account the context of dispute (arguments, acts of fate, absences), - providing for administrative control and verification - mechanisms and procedures to ensure the quality of the teaching staff are present - the examination of students opinions about their classes - the selection and the appointment of academic teachers taking into account their subject matter and didactic qualifications - conditions for the improvement of teaching skills, especially in the case of teachers starting the profession 24
- the dismissal mode for teachers whose knowledge and qualifications are called into question - the feedback system regarding the quality of one s own work. Appendix no. 2 - The Resolution of the Conference of Rectors of Polish Universities of January 31st 1998 concerning the principles of the accreditation procedure articles 22b, 23, 27 Appendix no. 7 Appendix no. 10 to the Resolution 2.2 Development of external quality assurance processes Standard: The aims and objectives of quality assurance processes should be determined before processes themselves are developed, by all those responsible (including higher education institutions) and should by published with a description of the processes to be used The University Accreditation Committee on its own formulates framework operation mechanisms that are used in external education quality assurance processses. Detailed goals and tasks for a given accademic year, as well as long-term perspectives are set by UAC at its first meeting, therefore the goals are defined prior to the development of the accreditation procedures. Decisions of UAC on standards and procedures are preceded by analyses conducted by specially appointed groups of experts, chosen by the community, which will prepare particular standards (for a given field of study) on the basis of principles which are generally known and prepared jointly by stakeholders, including higher education institutions. It is noteworthy that although the procedures are prepared by UAC (with the participation of key stakeholders), their final form is that of the resolution of the Conference of Rectors of Polish Universities which defines clear goals and provides the description of procedures which will be applied. It is worth mentioning that the goals are dynamic. After 10 years of its activity, in 2008, UAC decided, given previous experience, to specify more precisely the accreditation process principles to include the requirements concerning the internal system of quality assurance, introducing a four-grade scale of the compliance with particular standards. Mega-standards were also made more specific, and these are the guidelines for expert groups on how standards for each field of study should be defined. These changes are introduced with adequate time in advance, they are consulted, published (publicly anounced) and implemented carefully. The adopted principle is that all commenced procedures have to be completed according to the old principles. Information on goals and tasks, as well as the description of procedures to be used are published on UAC s website at: www.uka.amu.edu.pl and contain explicit statements of the aims and objectives of the processes. They are also made publicly available at universities through Vice-Rectors and published in an annual Bulletin by UAC. 25
2.3 Criteria for decisions Standard: Any formal decisions made as result of an external quality assurances activity should be based on explicit published criteria that are applied consistently The principles of the accreditation process were disseminated at higher education institutions - signatories of the Agreement for the Quality of Education, during the ratification by senates of higher education institutions, by Vice-Rectors members of Commission. UAC s Bulletin first published in 1998 and issued annualy which contains basic documents concerning accreditation and the on UAC s website launched after the first UAC meeting in March 1998. The general standards presented in the Resolution are provided with particulars for each field of study by the expert group appointed by UAC. These standards (separate for each field of study) are approved at the UAC s plenary meeting. The interested units may learn about them at the website and the text of standards is sent to university units providing the field of study by mail along with the invitation to accreditation. The final decision to grant or refuse the accreditation is based on the request for accreditation which is, in principle, the report of self-evaluation of the unit providing the field of study under accreditation and on the report of the evaluation team which is analysed in detail and discussed prior to the final decision at the plenary meeting of UAC. 2.4 Processes fit for purpose Standard: All external quality assurance processes should be designed specifically to ensure their fitness to achieve the aim and objectives set for them The aim of UAC is to stimulate the improvement of quality of education, to determine the standards of education quality and to develop an accreditation system for fields of study at universities. In the first years of UAC s activity, experts specialists for each field of study and philological specialities, appointed by UAC apart from the requirements contained in the standards defined by UAC, were also involved in establishing the contents of curricula. Currently, upon the introduction of education standards for each field of study by the Minister, experts define the particular requirements for a field of study considering the teaching and research achievements and also the conditions for studying. The experts undertaking the external assurance activity have appropriate skills and are competent to perform their task. These are the best specialists in a given field recommended by university units providing a given field of study (higher education institutions submit proposals of two candidates from their unit and three candidates from an external unit). The development of particular standards specific for a given field of study is the subject of the meeting of the group of experts appointed by UAC. Members of evaluation teams appointed for each accredited field of study meet at a seminar prior to an inspection in units applying for accreditation. Evaluation teams learn about the detailed goals and the principles of the accreditation process, about the criteria of evaluation and also the psychological aspects of evaluation. 26
If necessary (thus far sporadically) international experts can be invited both to expert groups and evaluation teams. UAC has also published, apart from UAC s Bulletin, manuals for evaluation teams: - Ewaluacja procesu kształcenia w szkole wyższe, red. nauk. Anna Brzezińska, Jerzy Brzeziński, Wyd. Humaniora 2000 - Proces samooceny, Herbert R.Kells, Wydawnictwo Naukowe UMCS, oprac. meryt. Magdalena Jaroszewska - Ewaluacja a jakość kształcenia w szkole wyższej - UAC i SWPS, red. Anna Brzezińska, Jerzy Brzeziński, Andrzej Eliasz, Wydawnictwo SWPS Academica 2004 - Jakość kształcenia w szkolnictwie wyższym, red. Maria Wójcicka, Centrum Badań Polityki Naukowej i Szkolnictwa Wyższego, UW 2001 - Zewnętrzne zapewnianie jakości kształcenia w szkolnictwie wyższym red. Maria Wójcicka, Jolanta Urbanikowa, Centrum Badań Polityki Naukowej i Szkolnictwa Wyższego, UW 2001. Participation of students currently involves their participation in the meetings with the evaluation team (obligatory meetings of members of the team with students). In some way we also evaluate the participation of students by investigating the internal system of quality assurance of the accredited unit. Students will participate in the team evaluating fields of study whose standards are developed according to new principles. Used by UAC review procedures are sufficient to provide adequate evidence to support the findings and conclusions reached. The collected material is sufficient and provides information on all interesting issues (the units self-evaluation report, the schedule of the evaluation team inspection, the discussion of the meeting of the team with the management of the faculty or the department provides an opportunity to obtain broader and additional information). The activity of UAC definitely mobilizes the communities to improve the quality of education. UAC has the possibility for public activity on the educational market. Procedures introduced by UAC stimulate better functioning of institutions by improving the provided field of study. UAC disseminates information about granting accreditation, solemny gives certificates of high quality of education and students obtain excerpts of the certificates in their diplomas to confirm graduation from an accredited field of study. The unit has the right to use the logo of this certificate on its website, correspondence and can be proud of it. For many years the information about UAC accreditation has also been included in bulletins for study candidates. 2.5 Reporting Standard: Reports should be published and should be written in a style which is clear and readily accessible to its indended readership. Any decisions, commendations or recommendations contained in reporst should be easy for a reader to find Reports of the evaluation team are developed according to the Appendix no. 3 to the Resolution on the principles of the accreditation process. The report consists of 7 parts. 27
In the first one the team provides its opinion on the accreditation request which is in fact a self-evaluation report. The second part is a report from an inspection. It contains conclusions from meetings with the management of the unit providing the field of study requesting accreditation, with employees, with students, and in the next part it refers to the general standards contained in article 21. Then it refers to the compliance with particular standards and contains information about the implemantation of the recommendations of UAC s evaluation team, if the unit previously participated in the acreditation process. If the unit would like to introduce other comments, both positive and negative one, it may do it prior to the final conclusion. The unit requesting accreditation learns about the content of the report which is sent to the Rector of the higher education institution and the faculty management. The outcomes of accreditation are published on the UAC s website. They contain or they will contain information about the level of compliance with the standards in four groups and the fourgrade scale. Full reports are not published due to the current act on the personal data protection in force in Poland. 2.6 Follow-up procedures Standard: Quality assurance processes which contain recommendations for action or which require action plan, should have a predetermined follow-up procedure which is implemented consistently Over the last 10 years of UAC s activity there have been only several cases out of a few hundred that the reports contained no comments or recommendations concerning the fulfillment of standards. The recommendations are included in the final conclusion and if resolutions of the decisive bodies were necessary for their implementation, this information was often sent to UAC Office prior to the decision to grant accreditation. UAC requests for information concerning, among others, the degree of the fulfillment of UAC s recommendation in the middle of the accreditation period (Appendix no. 3). If the application contains recommendations which, when fulfilled guarantee accreditation, the decision is postponed by the time needed to fulfill the recommendations and the team inspects the unit again and prepares another report. In case some crucial standards are not met UAC may revoke the previously granted accreditation. All these activities result in that areas identified for improvement are dealt with speedily and that further enhancement is encouraged. A year prior to the expiry of the accreditation UAC s Office takes steps to facilitate the renewal of accreditation (2 nd cycle). (Appendix no. 18 Renewal of the accreditation). 2.7 Periodic reviews Standard: External quality assurance of institutions and/or programmes should be undertaken on a cyclical basis. The length of the cycle and review procedures to be used should be clearly defined and published in advance In the middle of the accreditation period the unit providing the accredited field of study is obliged to submit information. Based on this information (and data contained in UAC s Bulletin) Commission at its plenary meeting analyses the collective and individual information about the fulfillment of the accreditation standards and the recommendations. It sends the confirmation of standards fulfillment to the unit or it 28
requests the unit and its superiors to present a remedial program if the standards (standard) are not met and monitors the implementation of this program (Appendix no. 3). UAC grants accreditation for a definite period of time (two or five years). Then, if the unit expresses such will, the renewal of accreditation process takes place. The applied procedures are renewed, and they are clearly defined and published in advance and they do not introduce any new, unexpected requirements (Appendix no. 18). 2.8 System-wide analyses Standard: Quality assurance agencies should produce from time to time summary reports describing and analysing the general findings of their reviews, evaluations, assessments etc. The University Accreditation Commission is not an agency employing many people. Therefore the task of information processing is transferred to the stakeholders. However it must be pointed out that UAC: collects a wealth of information about individual programmes and institutions issues an annual Bulletin, which is also published on the website it provides the CRPU with periodical reports and analyses includes a research and development function within its activities it actively participated in the development of the Bologna Survey it transfers the acquired knowledge through book publications and papers in journals on the higher education systems (for instance, Academic Forum) it activaly participates in conferences on the education quality to honor the 5 years of UAC s activity a report on the achievements of the Commission was developed. 6.2 ENQA European standards for external quality assurance agencies 3.1 Use of external quality assurance procedures for higher education Standard: The external quality assurance agencies should take into account the presence and effectiveness of the external quality processes described in Part 2 of the European Standards and Guidelines External quality assurance procedures in higher education and assessement of their compliance with standards included in Part 2 of ESG have been described in clause 6.1 of this report. 3.2 Official status Standard: Agencies should be formally recognised by competent public authorities in the European Higher Education Area as agencies with responsibilities for external quality assurance and should have an established legal basis. They should comply with any requirements of the legislative jurisdictions within which they operate 29
UAC was created on the basis of the Agreement of Rectors of Polish Universities for the Quality of Education. The principles of its activity and principles of the accreditation process and the standards are included in the CRPU s Resolution on the principles of the accreditation process of January 31 st, as amended. Apart from this one other commissions appointed by conferences of rectors initiated their activity. The Conference of Rectors of Polish Academic Schools consisting of Polish university rectors is according to the Higher Education Act of 2005 a legal entity and operates on the basis of the Act of the Associations (Table no. 3 The position of UAC among other higher education institutions and schools). The State Accreditation Committee appointed by the Minister of Science in 2001 commenced its activity on January 1 st, 2002 and according to the Higher Education Act it can cooperate with domestic and international organizations focused on the education quality assessment and accreditation. This is the case with the University Accreditation Commission. UAC has been a member of the CEEN Network since 2000 and its former and the current chairman has been a member of the Steering Committee since 2002. UAC s representatives actively participate in transforming CEEN into a European legal entity. In 2005 UAC organized workshops of the CEE Network Mapping External Quality Assurance in Central and Eastern Europe: a Comparative Survey workshops, and a meeting of the Steering Committee of the CEE Network. UAC s members participate in international sessions and conferences concerning the education quality. Accreditation granted by UAC is highly appraised by the academic community and it has earned its position given the fact that UAC s accreditation is voluntary (Appendices: 8, 9, 10, 11 and 12). 30
Table no. 3 The position of UAC among other higher education institutions and schools Ministry of Science And Higher Education Universities Technical Schools Conference of Rectors of Polish Universities Conference of Rectors of Polish Technical Schools University Accreditation Commission State Accreditation Committee Economic Schools Conference of Rectors of Economic Schools Commision for the Accreditation of Technical Schools Non Public Schools Public Schools Medical Schools Agricultural schools Conference of Rectors of Medical Schools Conference of Rectors of Agricultural Schools Foundation for the Promotion and Accreditation of Economic Education Commision for theaccreditation of Medical Universities Conference of Rectors of Academic Schools in Poland Pedagogical schools Conference of Rectors Pedagogical Schools Commision for the Accreditation of Pedagogical Schools Artistic Schools Conference of Rectors of Artistic Schools
3.3 Activities Standard: Agencies should undertake external quality assurance activities (at institutional or programme level) on a regular basis The CRPU s Resolution imposes certain tasks on UAC which are performed by the Commission constantly and consistently. The main task of UAC is to develop an accreditation system. Next year UAC will initiate the third cycle of accreditation of fields of study at universtities and in units from outside universities which apply for accreditation. 3.4 Resources Standard: Agencies should have adequate and proportional resources, both human and financial, to enable them to organise and run their external quality assurance process(es) in an effective and efficient manner, with appropriate provision for the development of their processes and procedures UAC consists of 19 Vice-Rectors and a representative designated by CRPU. The tenure of UAC used to be 3 years and since the last elections of Rector management it is 4 years. UAC appoints groups of experts and evaluation teams. Groups of experts develop detailed standards for a given field of study, depending on its size they may include 6 to 12 individuals and the evaluation teams may include 9 to 35 individuals also depending on the size of the field of study. Teams operate in groups of 3 to 5 individuals. Since the beginning of its activity over 1200 individuals directly involved in the accreditation process and the preparations made in units have cooperated with UAC. The activity of the University Accreditation Commission, groups of experts and the evaluation teams is organized by the UAC Office, which consists of UAC s secretary AMU professor, two administrative employees and two individuals employed on a contract basis one manages the website, the other financial settlements. According to the CRPU s Resolution the UAC Office is located in Poznań at Adam Mickiewicz University. The activities of UAC and its Office are financed by 19 universities, whose representatives are members of the commission, whereas the costs connected with the accreditation of a field of study are born by units requesting accreditation. Agencies should have adequate and proportional resources, both human and financial, to enable them to organise and run their external quality assurance process(es) in an effective and efficient manner, with appropriate provision for the development of their processes and procedures 3.5 Mission statement Standard: Agencies should have clear and explicit goals and objectives for their work, contained in a publicly available statement 32
The agreement of Rectors of Polish Universities of October 18 th,1997 clearly defines the mission and the way to implement the goals. It stipulates that the UAC s main mission is: 1. unifying standards of the quality of education within particular courses of studies 2. the development of an accreditation system for these courses of studies 3. cooperation with respect to the development of common systems of accreditation with higher education institutions of a similar research level and their associations 4. cooperation with accreditation institutions 5. the admission to the European network of accreditation agencies 6. the development of the system of students mobility. As previously mentioned the goals implemented by UAC are subject to dynamic changes. In 1998 there were two goals, in the following 4 years goals 3 and 6 were added and in 2005 goals 4 and 5. UAC has developed accreditation systems for 33 fields of study, 6 philological specialities and 1 program, for which particular standards were developed and approved. It cooperates with community commissions such as: - Accreditation Commission of Universities of Technology (agreement on the recognition of accreditation of chemical fields of study, accreditation of IT studies) - Foundation for Promotion and the Accreditation of Economic Fields of Study (accreditation of economic fields of study at universities with the participation of experts designated by FPAEFS) - a representative of UAC is designated to the Accreditation Commission of the Promotion and the Accreditation of Economic Fields of Study - UAC participates in the works of the accreditation commission of CRPAS including all community commissions - UAC conducts the accreditation of chemistry with the European Chemistry Thematic Network Association It developed a domestic MOST student mobility system for students from universitiessignatories of the Agreement for the Quality of Education. Annually 1500 individuals apply for the program and over 1000 go to various centers every year. 3.6 Independence Standard: Agencies should be independent to the extent both that they have autonomous responsibility for their operations and that the conclusions and recommendations made in their reports cannot by influenced by third parties as higher education institutions, ministries or other stakeholders UAC is a unit appointed by the Conference of Rectors of Polish Universities. It was ratified by university senates. Thus it is independent of the Ministry and other higher education institutions. 33
UAC appoints independently of higher education institutions a group of experts from among candidates suggested by units providing a field of study requesting accreditation. The decision concerning the choice of an expert is made by UAC collectively. Owing to this procedure one may choose individuals who enjoy great support in the community (the connection between UAC and the community is natural). It has to be stressed once again that UAC is totally independent when it comes to the decision about the selection of expert teams. No institution can force UAC to choose a given candidate to the group of experts. The group of experts suggests the membership of evaluation teams and of individual teams provided that none of the people who are members of the team are connected with the higher education institution to be inspected and that there are no mutual evaluations and that the specialities are represented to their best. The evaluation teams autonomously include final conclusions concerning compliance of the unit with the standards and to what extent. Upon taking cognizance by UAC with the accreditation process and the conclusions of the evaluation team UAC may grant or refuse accreditation but it cannot modify the conclusion of the team. In case of doubts UAC may appoint an appellate team which inspects the unit once again and presents conclusions. UAC autonomously and independently takes the final decision due to the right to take the final decision granted to UAC. 3.7 External quality assurance criteria and processes used by the agency Standard: The processes, criteria and procedures used by agencies should be pre- defined and publicly available. The processes will normally be expected to include: - a self-assessment or equivalent procedure by the subject of the guilty assurance process - an external assessment by a group of experts including, as appropriate, student member(s), and site visits as decided by the agency - publication of a report, including any decisions, recommendations or other formal outcomes - a follow-up procedure to review actions taken by the subject of the quality assurance process in the light of any recommendations contained in the report. A very important element (not included in the mission of the State Accreditation Committee) is that the accreditation of the unit is voluntary. This is how the University Accreditation Commission propagates the culture of quality. The procedures and standards are defined and published on the UAC s website and in the Bulletin. Decisions about granting the accreditation are publicly announced on the UAC s website and the Bulletin and in the Guides for study candidates. Although UAC would like to publish entire final reports, unfortunately it is subject of restrictions imposed by the act on personal data protection. After the accreditation is granted to the unit the entire report of the evaluation team is sent to the unit. Only the department or faculty management is responsible for the extent to which the report is publicly made available (they may publish a part of the report on the website, send it to the academic staff by e-mail or choose another way to announce it). UAC leaves it to the discretion of the unit. The unit providing the 34
accredited field of study obtains a certificate of high education quality along with excerpts from this certificate for students; it is the confirmation that they graduated from the field of study accredited by UAC. The unit has the right to use the logo of this certificate on its letterheads. The preparation of a request for accreditation (which replaces the self-evaluation report) along with the ECTS information package is one of the elements of the accreditation process. Students participate in the accreditation process a meeting with the students is one of elements of the inspection performed by the evaluation team and a representative of the student government in the higher education institution where a field of study undergoes the accreditation will be a member of the evaluation team. 3.8 Accountability procedures Standard: Agencies should have in place procedures for their own accountability As a result of this agreement on January 31 st, 1998 according to the resolution of the Conference of Rectors of Polish Universities the University Accreditation Commission was established. UAC s web page contains full information about: the mission, strategic goals and the tasks of the University Accreditation Commission the principles of the accreditation procedure and the general standards the detailed standards concerning the accreditation of particular fields of study the granted accreditations, the signatories of the Agreement of Polish Universities on the Quality of Education an information bulletin How to obtain the mark of quality the MOST system of students mobility. The University Accreditation Commission bulletin How to obtain the mark of quality, issued since 1998, contains reports concerning the accredited fields of study, tasks for the upcoming year, and the information about procedures. After 5 years of its activity a report from the activities was developed which included both the procedures and the detailed standards and the information from the course of the accreditation The University Accreditation Commission in the years 1998 2003. The analyses concerning the quality of education and the university accreditation can be found in The Academic Forum and in studies and post-conference materials: - The evaluation of the educational process in a higher education school, Poznań 2000 - The evaluation and the quality of education in a higher education school, Warsaw 2004 - The management of the education quality assurance system in a higher education school and its monitoring, Olsztyn 2004 35
- Stanisław Chwirot, The system of the evaluation of fields of study conducted by the University Accreditation Commission, pages 15-24 in The evaluation of the educational process in a higher education school, - Stanisław Chwirot, The standards of the education quality assessment the perspective of the University Accreditation Commission, pages 5-17 in The evaluation and the educational process in a higher education school, - Stanisław Chwirot, University Accreditation in Poland three years late, Conference materials of the Educational Enterprise Foundation, Łódź 2001 - Andrzej T. Jankowski, Polish System of Accreditation in Higher Education - A collaboration between West Chester University of Pensylwania and the of Silesia, Poland. UAC does not commission tasks connected with accreditation to other units. UAC meets with the chairman of the group of experts at its plenary meeting. The chairman of the group of experts presents on its behalf the suggestions of detailed standards for a given field of study and reports expert comments. Suggestions of possible changes are consulted by the chairman of the expert group again and it is only then that the UAC validates them. UAC, at the plenary meeting, meets with the chairmen of evaluation teams, who present conclusions from the visits of the evaluation teams and the evaluation of the application for accreditation and possible comments concerning the procedure and the course of the accreditation. UAC organizes seminars for evaluation teams, during which members of the evaluation teams may also report comments concerning the principles of the procedure. In the year 2005 external standards which the agency has to meet were determined and UAC has been preparing for 3 years to undergo the external assessment: by the act of 2005 the Conference of Polish Academic Schools were given a formal status, with CRPU and the University Accreditation Commission as members, was granted a legal status since March 2007 the accreditation decisions made by UAC do not require the formal acceptance from CRPU in March 2008 the principles of the accreditation procedure were changed to adapt them to the changes introduced in the system of higher education and the European standards and it was publicly published. One of the main goals of the external assessment that UAC will submit to, was the requirement of the mandatory cyclical external review of the agency s activities at least once every five years. 36
7. Analysis of weak and strong parts of UAC Weaknesses: Strengths: lack of the direct participation of student representatives in the works of the evaluation teams inability to publish complete reports of the evaluation teams due to the current Polish law the results of UAC s activity are long-term ones thus far it has been impossible to create a mechanism through which accreditations granted by UAC would result in particular decisions made by higher education institutions little popularisation of UAC s activity and its mission outside the higher education institution community insufficient participation of foreign experts in the assessment of education quality too little activity by UAC on the international scale. the specificity of activities for the mission, ensuring the propagation of the culture of education quality voluntary submission to accreditation by units quick and easy reaction to the changing environment not based on standards imposed externally it includes the best experts and specialists designated by academic communities consists of university vice-rectors, who have become trusted by their community by the very fact of their election to the position plenary meetings are not only about making accreditation decisions, but also about subject matter discussions on the crucial problems connected with education and the evaluation of quality stimulates activities of other institutions focused on the quality of education. In conclusion, the University Accreditation Commission is not an agency employing many people. Therefore the task of information processing is transferred to the stakeholders. However it must be pointed out that UAC: - collects a wealth of information about individual programs and institutions - issues an annual Bulletin, which is also published on the website - provides the CRPU with periodical reports and analyses - includes a research and development function within its activities 37
- actively participates in the development of the Bologna Survey - conveys the acquired knowledge through book publications and papers in journals on the higher education systems(for instance, the Academic Forum) - actively participates in conference on the education quality. 38
8. Future plans The nearest future poses some serious challenges for the University Accreditation Commission. The new act of higher education has introduced as a general rule the three cycle system of studies, and also some new forms of their introduction such as macrofields of study. There is a need to think about the way in which UAC could accredit macrofields, how the accreditation of first and second cycle studies should be conducted, whether an attempt should be made to broaden the scope of its activity to cover the third cycle studies (doctoral studies). According to the new act and the documents from the conference in Bergen (2005) and in London (2007) there is a need to draw greater attention to the well-defined set of competences, skills and attitudes of a graduate as the basis for the evaluation of accreditation and for the selection of tools for such an evaluation. The standards applied by UAC should refer to the framework qualification structures (thus affecting the national framework). Other important plans for the future include: obtaining an international position by joining the EQAR register advanced cooperation with employers on the establishment of quality assurance standards and education quality assessment process possible inclusion of experienced persons into expert groups becoming active throughout Europe obtaining mutual recognition of European accreditations obtaining the right to audit other accreditation agencies covering all higher education schools in Poland activities aimed at achieving a high quality, prestige and recognition. 39
9. List of abbreviations UAC CRPU CRPAS FPAEFS MOST - University Accreditation Commission - Conference of Rectors of Polish Universities - Conference of Rectors of Polish Academic Schools - Foundation for Promotion and the Accreditation of Economic Fields of Study - Student Mobility Programm AFA Cr The Academy of Fine Arts in Cracow AFA W The Academy of Fine Arts in Warsaw AGH UST AGH University of Science and Technology AMU A. Mickiewicz University Coll Civ. Collegium Civitas CSWU Cardinal Stefan Wyszyński University CUL Catholic University of Lublin CUT Cracow University of Technology GUT Gdańsk University of Technology JU Jagiellonian University MCSU M. Curie-Skłodowska University NCU Nicolaus Copernicus University PAH Pułtusk Academy of Humanities PAT Pontifical Academy of Theology PFT Pontifical Faculty of Theology in Wrocław Program Academia Artes Liberales program PUC Pedagogical University of Cracow PUT Poznań University of Technology RU Rzeszów University RUT Rzeszów University of Technology SUT Silesian University of Technology SzUT Szczecin University of Technology TUL Technical University of Łódź UB University of Białystok UG University of Gdańsk UG and MU University of Gdańsk and Medical University of Gdańsk UL University of Łódź UO University of Opole UP University of Podlasie US University of Szczecin UTLS University of Technology and Life Sciences in Bydgoszcz UW University of Warsaw UWM University of Warmia and Mazury UWr University of Wrocław UZ University of Zielona Góra WrUT Wroclaw University of Technology WSSSH Warsaw School of Social Sciences and Humanities WULS Warsaw University of Life Sciences WUT Warsaw University of Technology 40
10. List of tables Table no. 1 A list of UAC s accreditation certificates granted to higher education schools in 1999-2008 Table no. 2 The University Accreditation Commission location and its bodies Table no. 3 The position of UAC among other higher education institutions and schools 41
11. List of appendices 1. The Agreement of Polish Universities Concerning the Quality of Education 2. The Resolution of the Conference of Rectors of Polish Universities of January 31 st 1998 concerning the principles of the accreditation procedure 3. Appendix no. 6 to the Resolution: Information about the standards compliance 4. Appendix no. 7 to the Resolution: Criteria for the evaluation of the academic staff 5. Appendix no. 8 to the Resolution: Criteria for the evaluation of the teaching process 6. Appendix no. 9 to the Resolution: Criteria for the assessment of the teaching infrastructure 7. Appendix no. 10 to the Resolution: Criteria for the evaluation of the internal system of quality assurance 8. Accreditation granted in 1999-2000 9. Accreditation granted in 2001-2002 10. Accreditation granted in 2003-2004 11. Accreditation granted in 2005-2006 12. Accreditation granted in 2007-2008 13. Appendix no. 3 to the Resolution: The framework report of the evaluation team 14. Appendix no. 4 to the Resolution: Suggested schedule of the evaluation team inspection 15. List of accreditation from ECTNA 16. Circulation of accreditation documents 17. Appointment of expert groups and evaluation teams 18. Renewal of the accreditation 19. Cooperation of the UAC Office with the evaluation team and the unit providing the field of study under assessment 20. Monitoring of the compliance with the standards 21. Accreditation standards for the philosophy field of study 22. Accreditation standards for the oceanography field of study 23. Accreditation standards for the biotechnology field of study 24. Part I Accreditation standards for the first-cycle studies in chemistry, process engineering and chemical technology fields of study Part II Accreditation standards for the second-cycle studies in chemistry, chemical technology and chemical and process engineering fields of study 25. Accreditation standards for the slavic speciality in the philology field of study 42