Teaching and Training Quality Management

Transcription

1 Teaching and Training Quality Management IT1-LEO

2 Information sur le projet Titre: Code Projet: Teaching and Training Quality Management IT1-LEO Année: 2011 Type de Projet: Statut: Pays: Accroche marketing: Résumé: Projets de transfert d'innovation Clôturé IT-Italie Cette proposition vise à promouvoir une culture d'amélioration de la qualité et de l'évaluation dans les processus éducatifs et de formation grâce à l'utilisation des outils TIC. Les activités visent à obtenir un "guide des bonnes pratiques" décrivant la base pour la construction d'un modèle transféré. Le but est de concevoir et d'appliquer un logiciel qui permettra de créer un "e-portfolio" personnalisé, habilitant l'utilisateur d'auto-évaluer des aptitudes et des compétences. La recommandation du Parlement européen et du Conseil de Juin 2009 relative à l'établissement d'un cadre de référence européen pour l'assurance de la qualité dans l'enseignement et la formation professionnels, a identifié un certain nombre d'indicateurs pour évaluer la qualité de l'éducation et la formation, comprenant les investissements dans la formation des enseignants et des formateurs comme un moyen de promouvoir l'appropriation des enseignants et des formateurs dans le processus de développement de la qualité dans l'efp. Teaching and Training Quality Management - TQM project involved seven partners from four countries. In the framework of the actions promoted by the Italian Ministry of Education (Law n.150/2009), the initiative aimed to evaluate methodologies of teachers and trainers performances with the purpose of test and improve standards in the quality systems in VET, as from EQUARF recommendation. TQM transferred two significant evaluation experiences: the Grundtvig "SEALL Self-evaluation in Adult Life Long Learning" project, and "Te-Pni" project. The common denominator between the two projects was the methodological approach considering self-evaluation as a training process. Through a punctual research action with the involvement of significant stakeholders and trainers, the products and action model of good practices identified was adapted to the Italian context and tested with a significant sample group of trainers. TQM contributed to the discussed subject of the evaluation of trainers by validating a bottom-up action model, consisting of a training process for teachers/trainers and a prototype of e-portfolio. At the end of the action, a change has been observed in the attitude of trainers with reference to the evaluation: before the project experience, the teachers considered the evaluation of thei work as a tool for measuring their own professionalism: during the life of the TQM project, partners and participants tried to define a different state-of-mind and process which, through self-reflection and dialogic reflection, could improve teaching efficacy and didactic quality. TQM project has been promoted by the Telematic University Leonardo da Vinci (acronym UNIDAV, IT), which has been working for years in pedagogical research and high education of trainers, and which coordinated the activities and tests in Italy. Universities of Ulster (UK) and EVALITAS (AT), as holders of the good practices to be transferred, were involved in the consortium with the task of transferring the products and methodologies, participating in the research team for adapting and training the teachers/coaches working on test performance. In Austria, a control team consisting of 36 teachers has been activated to test the e-portfolio application. Ud'Anet srl (IT) kept responsibility for customizing the e-portfolio application and creating ICT tools to support the dissemination. EFQUEL (BE) ensured the consistency of the activities with the political lines for quality assurance at the European level and coordinated a call for paper aimed at gathering contributions from all overe Europe on the topic of VET quality and teaching evaluation systems. INVALSI (IT) has been charged of coordinating the research activities and the data analysis. Insight srl (IT) was in charge of project monitoring. Description: TQM project was divided into 8 WPs, each of them included activities developed in synchronism. Training tools used in previous projects "SEALL" and "Te-pin", managed 2

3 Information sur le projet by by EVALITAS and UNIVERSITY of ULSTER, partners in TQM Project) have been adapted to the current target groups/countries. After an Analysis and adapting phase that aimed to identify the model to be used, model has been transferred to a group of three tutors during two training sessions; technical partner Ud'Anet (IT) developed an online application for the creation of an e-portfolio model for teachers and trainers as well as an executive plan of laboratories. The pilot activities have been carried out in Italy by applicant UNIDAV and in Austria by EVALITAS. In each country, a group of teachers (54 teachers in Italy and 36 in Austria) has been involved in didactic laboratories for the training on evaluation, self-evaluation and the use of the platform/application for the building of their own professional e-portfolio. During the didactic laboratories and the online activities on the e-portfolio platform, each teacher's group has been coached by a trained group of tutors (3 in Italy, supported by 3 assistants and a coordinator, 2 in Austria). Two online surveys have been carried out: one before the pilot and the other one after its conclusion. In Italy, 189 schools, belonging to the national INVALSI sample, have been contacted to take part into the first survey. After gathering school and individual teachers accessions, 2533 teachers and trainers have been invited to fill in the online survey questionnaires have been collected. The same survey has been filled in by 54 teachers who participated in the didactic laboratories and who, after the pilot, filled in the second online survey and took part into a Focus Group session. In Austria a group of 36 teachers participated in the two online surveys and the pilot. The teachers, as for their membership into professional networks and systems affecting the national and European educational systems, played the role of facilitators acting as multiplying factors for the transfer, adoption and implementation of the good practices from original projects. Once concluded the pilot phase, the comparison between data from the two surveys allowed to evaluate the results and the impacts of the actions. The teachers attitude on the evaluation evolved from a tool for measuring the teacher s professionalism to a global process which involves the whole teaching system to improve the quality of the didactic. In the teachers' opinion, the evaluation became therefore a tool to support the teaching activity. After the call for paper launched by EVALITAS with the aim to collect international papers on the themes of VET quality and evaluation systems in different countries, partnership carried out a Digital Journal Improving quality of vocational training tools, frameworks and current practices (available online at the link: which allowed to promote at European level the scientific research on the themes touched by the project. The project s activities have been presented in several international conferences, as the EARLI conference, DIDAMATICA and the EFQUEL conference. Promotional actions and activities were carried out all along the initiative in order to achieve exploitation and diffusion of results and products. Particularly, 6 thematic workshops and 2 seminars have been held to focus different aspects of the evaluation and e-portfolio issues in order to provide information about policies, tools and good practices. In these occasions, a large diffusion has been achieved within teachers and workers in the VET sector. The evaluation of project activities has been performed by partner Insight & Co (IT) which monitored all the training and diffusion events as well as all the project meetings through a number of satisfaction surveys. Thèmes: Sectors: *** TIC *** Formation tout au long de la vie ** Étude interculturelle ** Orientation professionnelle ** Formation continue * Qualité * Formation ouverte et à distance * Entreprise, TPE, PME * Égalité des chances *** Enseignement ** Activités Spécialisées, Scientifiques Et Techniques ** Information et Communication 3

4 Information sur le projet Types de Produit: Information sur le produit: Matériel d'apprentissage Site Internet Enseignement à distance Procédure pour l'analyse et le pronostic des besoins de la formation professionnelle Matériel pour l'enseignement Méthodes d'évaluation DVD The project activities have been developed by each partner on the basis of roles and tasks, designed by the whole partnership during steering groups meetings. Information and updates have been disseminated via the project website as well as a newsletter issued in 4 editions. In order to ensure a wide promotion to TQM initiative, partnership participated in international conferences (EARLI Conference, DIDAMATICA and EFQUEL Conference). As for the arrangement of a pilot action in countries involved (Italy and Austria), a questionnaire has been released to collect data from beneficiaries of the experimentation, to detect propensity, participation and attitude towards self-evaluation in vocational and educational training: data collected, supported by an international study on institutional educational frameworks and laws in the countries involved in the project (Italy, Austria and Northern Ireland), have been used to compose a report on the good practice on "Comparative study of the normative and institutional framework concerning self-evaluation within VET in n countries. The report also describes the experimentation actions carried out during the project TQM and the software/platform implementation process to create a customized "e-portfolio" for the self-evaluation of skills and competences. Final reporting documents of the project describe results extracted from questionnaires and assessments, as well as approach and attitudes of the pilot target groups (teachers and trainers), methodologies adopted to define a self-evaluating system built on an already existing model. Also a guide to the use of the "e-portfolio" software was carried out (text and video tutorial: to support a general agreement on good practice in self-evaluation of teachers and trainers in VET, both in national and international systems. Page Web du projet: 4

5 Contractant du projet Nom: Ville: Pays/Région: Pays: Type d'organisation: Site Internet: UNIDAV Università Telematica Leonardo da Vinci Torrevecchia Teatina (CH) Abruzzo IT-Italie Université/école supérieure spécialisée/academie Personne de contact Nom: Adresse: Ville: Pays: Téléphone: Fax: Site internet: Christian Sciarretta Piazza San Rocco 2 Torrevecchia Teatina IT-Italie christian.sciarretta@unidav.it 5

6 Coordinateur Nom: Ville: Pays/Région: Pays: Type d'organisation: Site Internet: UNIDAV Università Telematica Leonardo da Vinci Torrevecchia Teatina (CH) Abruzzo IT-Italie Université/école supérieure spécialisée/academie Personne de contact Nom: Adresse: Ville: Pays: Téléphone: Fax: Site internet: Christian Sciarretta Piazza San Rocco 2 Torrevecchia Teatina IT-Italie christian.sciarretta@unidav.it 6

7 Partenaire Partner 1 Nom: Ville: Pays/Région: Pays: Type d'organisation: Site Internet: Insight&Co srl Pescara Abruzzo IT-Italie Entreprise de petite et de moyenne taille (jusqu'à 250 employés) Partner 2 Nom: Ville: Pays/Région: Pays: Type d'organisation: Site Internet: European Federation for Quality in E-learning Brussels Bruxelles Cap, Brussel Hof BE-Belgique Autres Partner 3 Nom: Ville: Pays/Région: Pays: Type d'organisation: Site Internet: INVALSI Instituto Nazionale per la valutazione del Sistema educativo d'istruzione e Formazione Frascati Lazio IT-Italie Autres Partner 4 Nom: Ville: Pays/Région: Pays: Type d'organisation: Site Internet: Ud'Anet New Enterprise Technology Torrevecchia Teatina (Chieti) Abruzzo IT-Italie Université/école supérieure spécialisée/academie 7

8 Partenaire Partner 5 Nom: Ville: Pays/Région: Pays: Type d'organisation: Site Internet: Evalitas Bauer Messner EvaluierungsKG Graz Styria AT-Autriche Autres Partner 6 Nom: Ville: Pays/Région: Pays: Type d'organisation: Site Internet: University of Ulster Coleraine Northern Ireland UK-Royaume-Uni Autres 8

9 Produits Project website Interim Report Pilot action: call for teachers' participation Pilot action: questionnaire and survey Comparative study in VET within European Countries e-portfolio online application Digital Journal Final Report Final Publication Research in Didactics Tutors' training Workshop materials Project Newsletter 9

10 Produit 'Project website' Titre: Project website Type de Produit: Site Internet Texte marketing: The TQM project website at is the most important "manifesto" of the initiative, reporting information, listing activities and actions implemented, describing methodologies adopted and showing results and outcomes. Description: Website is in Italian and English languages; it is divided into different sections (except from the homepage), they are: - project, describing the initiative TQM; - activities, listing the work-packagegs; - community, involving project parget groups; - courses, containing didactic material and demos; - contacts, listing the partners and project responsibilities. Cible: project partnerships, teachers, VET professionals, training agencies, school directors, education and training designers, institutions, teachers unions and associations Résultat: TQM project website Domaine d'application: dissemination, information, Adresse du site Internet: Langues de produit: italien anglais &prd=1 10

11 Produit 'Interim Report' Titre: Interim Report Type de Produit: Autres Texte marketing: Report released after the first year of activities; language of the document is italian Description: Activities performed and first drafts of results carried out have been described. A financial report is also included in the document. Cible: National Agency Résultat: Activity and financial report regarding the first thirteen months of the project (from 30/09/2011 to 31/10/2012). Domaine d'application: Reporting Adresse du site Internet: Langues de produit: italien product files Content TQM_Report - integrato.pdf Interim Report &prd=2 11

12 Produit 'Pilot action: call for teachers' participation' Titre: Pilot action: call for teachers' participation Type de Produit: Méthodes de distribution Texte marketing: Experimentation phase Description: Public call intended to teachers and VET professionals that want to take part into the pilot action to build up an "e-portfolio". The selected teachers particpated in the didactical laboratories in order to deepen evaluation's methodological aspects and to learn to use the application for the e-portfolio development. Each teacher developed its own e-portfolio. Cible: Teachers, VET professionals Résultat: Call to be disseminated through newsletter and website. Teachers' e-portfolios. Domaine d'application: Adresse du site Internet: Langues de produit: italien product files Content Avviso selezione docenti sperimentazione e portfolio TQM.pdf Participants selection for teachers pilot action &prd=3 12

13 Produit 'Pilot action: questionnaire and survey' Titre: Pilot action: questionnaire and survey Type de Produit: Procédure pour l'analyse et le pronostic des besoins de la formation professionnelle Texte marketing: The survey allowed to collect data regarding teachers' approach to self-evaluaton: two questionnaires have been administered to teachers interested in pilot action in Italy (Regione Abruzzo) and Austria, one before and the otherone after the experimentation. A Focus Group has also been carried out in Italy. Description: The first survey aimed at understanding teachers' attitude and approach to evaluation and self-evaluation, in order to collect data and information to produce the software for e-portfolio for teachers. The comparison between the data from the first (before the pilot) and the second (after the pilot) questionaire allowed to evaluate the impact of the action as well as to understand the evolution in teachers' attitude on evaluation. The final survey was also constituted by a Focus Group session, aiming at deepening the questionaire's data. Cible: Teachers, VET professionals Résultat: Questionnaire, Focus Group Domaine d'application: Adresse du site Internet: Langues de produit: allemand italien product files Content Analisi dati Focus Group e Questionario POST.pdf esportazione questionario PRE IT.pdf Experimentation Final Report EN.pdf Griglia verbalizzazione focus-finale.pdf Linee guida per l'osservatore Finale.pdf Protocollo organizzativo dei focus Finale.pdf Questionario finale IT.pdf Testo del questionario e traccia dei Focus Group somministrati al gruppo di docenti italiani al termine della sperimentazione &prd=4 13

14 product files QUESTIONARIO PRE-SPERIMENTAZIONE_VERSIONE_1_7_ITA_ONLINE.pdf Questionnaire Report questionario post IT.pdf Report questionari post AT.pdf Report questionari pre AT.pdf Report sperimentazione tutor.pdf testo questionario POST AT.pdf testo questionario PRE AT.pdf

15 Produit 'Comparative study in VET within European Countries' Titre: Comparative study in VET within European Countries Type de Produit: Procédure pour l'analyse et le pronostic des besoins de la formation professionnelle Texte marketing: Comparative study of the institutional and normative framework concerning self-evaluation within VET in European Countries. Description: Study has been performed within project partners country, as Austria, Northern Ireland and Italy: different parts have been assembled in a unique document describing different approaches, laws and possible import of foreign methodologies into Italian VET system. The report also describs the experimentation carried out during the project and the software implementation process to create a customized "e-portfolio" for the self-evaluation of skills and competences. Domaine d'application: Adresse du site Internet: Cible: teachers, VET trainers Résultat: Paper for a comparative study Langues de produit: italien anglais product files Content Final Country Report EN.pdf SE within vet_tqm_country report.pdf &prd=5 15

16 Produit 'e-portfolio online application' Titre: e-portfolio online application Type de Produit: Site Internet Texte marketing: E-portfolio application is online at It is a web based application developed for teachers and trainers to evaluate methodologies and achievements all along their careers. Description: E-portfolio is composed of many online environments for learning, research and assessments, which have been implemented after a period of studies and design together with the number of teachers aiming at responding to their learning and assessing needs. On the e-portfolio homepage at user can access the guides and tutorial Cible: Teachers, Trainers, VET professionals Résultat: Two versions (ITA-ENG) of the "User Guide for the e-portfolio" application (files are attached); Video tutorial for the use of the e-portfolio online application. E-portfolio application is listed among the Results of the project and numbered 10. User guides are listed as Result number 11. Domaine d'application: Personal e-portfolio Management System Adresse du site Internet: Langues de produit: anglais product files Content Guida Utente - EN.pdf E-portoflio User guide (English version) Guida Utente - ITA.pdf User guide for e-portfolio application url-video-tutorial.txt Video tutorial for the use of the e-portfolio application &prd=6 16

17 Produit 'Digital Journal' Titre: Digital Journal Type de Produit: Autres Texte marketing: Research on the VET quality and evaluation systems in Europe "Improving quality of vocational training tools, frameworks and current practices" Description: The contributions have been collected through a call for paper for quality indicators in vocational educational training methodologies and examples of use. By presenting a series of good practices carried out in Europe, the research deepens the topic of VET quality and suggests improvement strategies in order to define a common methodology. Cible: VET professionals Résultat: Papers Domaine d'application: Adresse du site Internet: Langues de produit: anglais product files Content Improving quality of professional training.pdf TQM-call-for-Chapters_ _FINAL.pdf Call for papers &prd=7 17

18 Produit 'Final Report' Titre: Final Report Type de Produit: Autres Texte marketing: Report released after the conclusion of the project activities; language of the document is Italian Description: Activities performed and the list of the results carried out have been described. A financial report is also included in the document. Cible: National Agency Résultat: Domaine d'application: Adresse du site Internet: Langues de produit: italien product files final report TQM.pdf &prd=8 18

19 Produit 'Final Publication' Titre: Final Publication Type de Produit: Autres Texte marketing: Report of the activities carried out during the project Description: The Final Publication summarizes and describes the activities carried out during the project and the adopted methodology. It also analyzes the reached results in order to allow an easy understanding of project's strenght points weaknesses and to capitalise the learned lessons as well. Cible: Teachers, VET trainers, public Résultat: Paper Domaine d'application: Adresse du site Internet: Langues de produit: italien product files Report sperimentazione.pdf Results of the pilot actions in Italy and Austria (published Sept. 2013) &prd=9 19

20 Produit 'Research in Didactics' Titre: Research in Didactics Type de Produit: Autres Texte marketing: TQM project has been presented during some interantional conferences that focuse on innovative didactical technologies. Description: TQM project was illustrated during the following meetings: - EARLI conference "Responsible Teaching and Sustainable learning", Munich, Germany, 27h/31st of August 2013, - Didamatica, Pisa, Italy, 7th/9th of May EFQUEL Innovation Forum, Barcelona, Spain, 26th and 27th of September 2013, ProgrammeEIF2013_ pdf Cible: researchers in the education field, teachers and VET trainers Résultat: Domaine d'application: Adresse du site Internet: Langues de produit: italien anglais product files Ambienti digitali, autovalutazione e percezione degli insegnanti testo.pdf Ambienti digitali, autovalutazione e percezioni degli insegnanti slides.pdf Developing an e-portfolio for teachers' self-evaluation.pdf EFQUEL_TQM presentation.pdf Poster Didamatica.pdf Stringher_30_08_2013_REV_presentata [modalità compatibilità].pdf &prd=10 20

21 Produit 'Tutors' training' Titre: Tutors' training Type de Produit: Modules Texte marketing: Didactical materials utilized during the two training sessions for the tutors involved in the project. Description: The italian tutors who coordinated the teachers' group during the experimentation, have been trained on the topic of evalutaion, by deepening methodologies, tools and skills needed for implementing anmd monitoring evaluation activities. Two training sessions have been carried out as follows: the first one in Graz, Austria (19th/21st of June 2012) and the second one in Torrevecchia Teatina, Italy (8th and 9th of November 2012). Cible: Tutors Résultat: Domaine d'application: Adresse du site Internet: Langues de produit: anglais product files Competences for SE _TQM.pdf Documentation Train the trainer Graz.pdf How does SE work.pdf InputSEDialogue.pdf Methods _Tools_Instruments_TQM.pdf Processing and Analyzing data.pdf Professionalism_QiBB.pdf Sealll01_UK_web.pdf Teacher feedback.pdf &prd=11 21

22 product files TOI_A_PROD_3 101_2.pdf What makes SE successful _TQM.pdf Why Self-evaluation_ TQM.pdf

23 Produit 'Workshop materials' Titre: Workshop materials Type de Produit: Autres Texte marketing: For each project's event are provided the programme and the speakers' contributions. Description: During the project have been organized the following workshops: W1) 10/10/2012: The evaluation of professionalism of the teacher for quality in education W2) 15/03/2013: Teachers' e-portfolio and self regulated learning W3) 17/04/2013: From traditional evaluation to the concept of teachers' e-portfolio: self evaluation and certification W4) 06/05/2013: The teacher portfolio as tool for personal and professional development for personal branding: concepts and models S1)Clil training in Italy and in Abruzzo Region S2) 20 years of Educational Technologies: at which point are we at school? IT Work Group)05/06/2013: Rooms and tools for creating and sharing educational contentsedit delete AT Work Group) Pilot action in Austria, tutors' training Cible: teachers, VET trainers Résultat: Domaine d'application: Adresse du site Internet: Langues de produit: italien product files III workshop Cenerini - eportfolio_un_fenomeno globale.pdf globale.pdf Pedrizzi - Il contesto_della_valutazione_ pdf programma III wshop TQM e-portfolio.pdf Stringher - Utilizzo_eportfolio_TQM_ pdf II workshop D'Angelo.pdf &prd=12 23