DEVELOPMENT OF INNOVATION, MULTILATERAL PROJECTS, LEONARDO DA VINCI LIFELONG LEARNING PROGRAMME 1 PROJECT NUMBER LLP NO-LEONARDO-LMP

Transcription

1 DEVELOPMENT OF INNOVATION, MULTILATERAL PROJECTS, LEONARDO DA VINCI LIFELONG LEARNING PROGRAMME 1 PROJECT NUMBER LLP NO-LEONARDO-LMP PROJECT HANDBOOK Authors: Béla Gayer Erik Engh Géza Gremsperger 2009 This project has been funded with support from the European Commission. This publication (communication) reflects the views only of the author, and the Commission cannot be held responsible for any use which may be made of the information contained therein. 1 Decision N 1720/2006/EC of the European Parliament and of the Council of 15/11/2006 establishing an action programme in the field of lifelong learning, published in the Official Journal of the EU N L327/45 on 24/11/ /34

2 Table of Content 1/ Scope 3 2/ Application 5 3/ Terms and definitions 6 4/ Documentation 7 5/ Management responsibility 10 6/ Communications Meetings 12 7/ Management review 14 8/ Resource management 15 9/ Infrastructure 17 10/ Work environment 18 11/ Product realization 19 12/ Intellectual Property 20 13/ Measurement, analysis and improvement 22 14/ Appendices: - as options are: 25 Appendix A Non-conformance report and corrective actions 26 Appendix B Checklist 27 Appendix C Questionnaires for performance from: MHtE/Hungary 28 Appendix D Questionnaires for performance from: CFL/Sweden 34 OK. students let s start... 2/34

3 1. Scope The project sponsored by European Commission has a great importance for the young generation educated in VET welding schools or in the higher education. The project identification is as it follows: DEVELOPMENT OF INNOVATION, MULTILATERAL PROJECTS, LEONARDO DA VINCI LIFELONG LEARNING PROGRAMME. Project/Contract number: LLP NO LEONARDO - LMP. In this iqsim PROJECT HANDBOOK the identification of the contract will be referred as it follows: Contract with EU. The project nomination is as it follows: Innovative Simulator Tools for Quality Management Production Process Training in VET. In this iqsim - PROJECT HANDBOOK the nomination of the project will be referred as it follows: iqsim project. Official language of the iqsim project is: ENGLISH. 3/34

4 MANAGING TOOL: iqsim PROJECT HANDBOOK In order to reach maximal results using the given intellectual and material resources much more effective the iqsim project consortium has decided to implement a set of quality management like special rules fitting to its innovation and intellectual activity as it is the core activity in the frame of this iqsim project and meanwhile taking into consideration the fact that consortium members geographically are located on diverse places in Europe. The special tool to realize to the main objectives - using IT technology in distance and face to face educational activity - and considering the objective facts this iqsim PROJECT HANDBOOK was developed and accepted by the iqsim consortium members. This iqsim PROJECT HANDBOOK covers the needs for a simple yet effective way of managing an EU sponsored Leonardo da Vinci Pilot Project however belonging specially to the Sixth Framework Program for Research and Technological Development of EU and to the Lifelong Learning Program. The objectives of this iqsim PROJECT - HANDBOOK are: a./ to maintain an special effective linking to ISO 9001:2008, b./ to achieve and maintain such a professional level which maintain and enhances the reputation of the iqsim project, c./ to ensure compliance with relevant professional welding requirements and the obligations laid down in the Contract with EU, d./ to ensure the deliverables meet the contractual requirements. This iqsim PROJECT - HANDBOOK covers topics as follow: - documentation (documents, reports), - management responsibility (customer focus, quality policy, planning, responsibility communication, management review), - resource management (human resources, infrastructure, work environment), - product realization (planning of product realization, customer-related processes. 4/34

5 2. Application This iqsim PROJECT HANDBOOK has been developed with the intention to meet the minimum requirements basically for managing Leonardo da Vinci projects with 5-7 participating organizations each with a limited number of participants. This manual specifically relates to the managing activity for the iqsim project. The tools and methods proposed are in line with measurements of iqsim project therefore in general sense limited in scope and functionality, but good enough for reaching the goals of this iqsim project but on the other hand they are easy to manage with a low cost profile. The HANDBOOK utilizes negative reporting techniques. This means that it is expected that the original plan and time schedules fixed in the application form and/or in Contract with EU for Innovative Simulator Tools for Quality Management Production Process Training in VET will be followed, The plan and schedules are also published on web site of iqsim project: 5/34

6 3. Terms and definitions General information: in this HANDBOOK the basic terms and definitions are used, however there are some special ones valid for iqsim project as it follows. Expressions: - Shall: is an absolute requirement which shall be followed strictly in order to conform with the contract requirements, - Should: is a recommendation, an alternative solutions having the same functionality and quality are acceptable, - May: indicates a course of action that is permissible within the limits of the contract ( permission), - Can: is conditional and indicates a possibility open to the user of the contract. Deliverables: documents containing the results in different phases of the iqsim project for each workpackages, Reports: containing results in form of text, either on financial situation or on the intermediate or final deliverables and meetings, Milestone: planned time schedules and deliverables, Project Coordinator (Project Manager): nominated organization responsible for contracting partner for Leonardo da Vinci office and for coordination of the activities of the iqsim project partners, Workpackage: is a list of activities to reach the goal of the iqsim project by the participants in different working groups and by cooperation among them, Leader of workpackage: is a nominated person within an organization responsible for the coordination of the activities of the participants in different working groups, Documents and reports: when an occurrence happens, or non-conformance, then the documenting and reporting system which is specified in this HANDBOOK comes into action, Contact persons: Contact Persons each belonging to the iqsim consortium are nominated by consortium member organizations and their name, responsibilities and contact data (e.g. address) are listed in Contract with EU (Section 2. Participating Organizations), Participants: project participants (organizations) and members of consortium are listed in Contract with EU : in Section 2. Participating Organizations, and in Section 5.: Consortium partners involved, Workgroup leader: from the different organizations each belonging to the iqsim consortium are defined by their name, and contact data (e.g. address) are listed in Contract with EU (Section 2. Participating Organizations). 6/34

7 4. Documentation In the iqsim project there are several reports or documentations like: user s requirements, PROJECT - HANDBOOK, manuals for software, the trainer s and student s guides, IT based links and learning materials and guides translated into different languages, etc. Official documents as specified in the Contract with EU should have an unique identification and they should be traceable and archivating till the run out time for that document. Documents downloading: common documents can be downloaded and shared through the use of a download or exchange page as defined in Contract with EU (Section 5.: Deliverables, outputs /products/ results). Standard report layout for project reports: all reports and official project documents should have a common document layout or document design and/or format. Examples of reports and standard document formats/layouts are enclosed in Contract with EU (LIFELONG LEARNING PROGRAMME: Project Handbook: Annex III: Guidelines for Administrative and Financial, Management and Reporting - Selection 2008). Standard documents format to be used: for all preliminary working papers, documents should be submitted in the following format: Word XP.doc format. Final documents format to be used: should be delivered according the Contract with EU and if appropriate (option) Adobe: pdf. format. Document identifications and revision handling: all documents should be identified with the following elements: - document name, 7/34

8 - document revision, staring from 0.1 and moving upwards according to number of revisions, - date for the current revision, - page numbers, - name(s) of author(s). Creating presentations and papers: - Use of logos: all official reports, papers, presentations, articles and so forth should contain the logo of the Life Long Learning Program. The correct logo can be downloaded from the iqsim project web site: The logo as a minimum should be visible at the front page. - Use of reference to project: all official reports, papers, presentations, articles and so forth should contain a reference to the Life Long Learning Program. The reference for EU COMMISSION shall be as follows: This project has been funded with support from the European Commission. This publication (communication) reflects the views only of the author, and the Commission cannot be held responsible for any use which may be made of the information contained therein. Administrative routines and documents: time sheets, travel reports and cost claim reports shall be submitted from each project partner to the Project Coordinator (Project Manager) each fourth month according to the Contract with EU (LIFELONG LEARNING PROGRAMME: Project Handbook: Annex III: Guidelines for Administrative and Financial, Management and Reporting - Selection 2008). The responsible contact person for each of the consortium members of iqsim project should ensure that all participants submit these data (mentioned above) to the Project Coordinator (Project Manager). The contact person should collect and submit these data to the Project Coordinator (Project Manager). Reporting routines and reporting documents: The reporting activities shall be executed with the following documents: 8/34

9 - Time schedule for reporting to the Project Coordinator (Project Manager) is defined in Contract with EU (and in LIFELONG LEARNING PROGRAMME: Project Handbook: Annex III: Guidelines for Administrative and Financial, Management and Reporting - Selection 2008), the format necessary can be downloaded from the iqsim project web site. - Time schedule for reporting deliverables is defined in Contract with EU: (Section 5.: Deliverables List and Deliverables- outputs / products/ results), the format necessary can be downloaded from the iqsim project web site. - Travel reports and Cost Claim shall be reported on the specified documents according to Contract with EU (LIFELONG LEARNING PROGRAMME: Project Handbook: Annex III: Guidelines for Administrative and Financial, Management and Reporting - Selection 2008), the format necessary can be downloaded from the iqsim project web site. - Standard cost elements to be used is found in the Contract with EU (and in LIFELONG LEARNING PROGRAMME: Project Handbook: Annex III: Guidelines for Administrative and Financial, Management and Reporting - Selection 2008) the format necessary can be downloaded from the iqsim project web site. NOTE: 1/ Please Note: All cost elements must be documented with an original receipt or invoice when possible or by photo copy. 2/ Please note: All reported meetings shall be documented through Minutes of Meetings. These Minutes of Meetings shall be enclosed the timesheets when submitted. Documents for reporting to Project Coordinator (Project Manager): If formats of the documents are different from the examples given in the project web site, the documents (prepared and used) must contain the same information and conclusions. The following documents shall be submitted according to the time schedule and the Contract with EU: - Time sheets for hours, - Travel reports, - Cost Claim reports, - Minutes of Meetings, - Dissemination report for the period. NOTE: Please note: The iqsim project may also add a spreadsheet for summary of project hours and costs. If implemented then this spreadsheet should be used by iqsim project participants for reporting purposes as well. 9/34

10 5. Management responsibility Customer focus The customers for iqsim project are the students in the VET schools and higher education and the trainers. This has a consequence namely that software and other learning tools, leaflets, etc. should be user s friendly: transparent. The members of the consortium and the trainers during the life time of the iqsim project should have regularly feed - back from members of the educated group (e.g. Appendix C). Likewise, the consortium members will provide feed-back and advice to the trainers, students and others participating in the iqsim project and exploiting the project results during the project period. Management Quality Policy (Project Policy) The quality policy of this iqsim project is to achieve sustained, high quality deliveries by providing services which consistently satisfy with the needs and expectations of the user s requirement in order to reach customer satisfaction. The quality level needed to reach user s satisfaction and fulfil the requirements in Eu - Contract is achieved through adoption of a system of procedures that reflect the competence of the project members to existing cooperation with VET schools and other, even higher educational, institutions. Achievement of this policy involves all project members and staff, who are individually responsible for the quality of their work, resulting in a continually improving working environment for all and useful practical applicable results. To achieve and maintain the required level of assurance the Project Coordinator (Project Manager) retains responsibility for the Quality System with its routine operation and procedures. Planning All activities characterized by deliverables in different working packages (Contract with EU: Section 5: Summary of work packages) to be reached by the consortium as a whole and for the individual members should be planned and the time schedules should be regularly up-dated according the work phases and the schedules provided in the Contract with EU: (Section 5.: Deliverables List and Work package Number). Responsibility and communication The Project Coordinator (Project Manager) for iqsim project is defined in the Contract with EU (Section 2. Participating Organizations). The communications are regulated (see later) and should have high level information contents, particularly in cases when it is related to the learning material and financing issues. 10/34

11 The Project Coordinator (Project Manager) is responsible for: - scheduling and conducting Project Meetings and making intermediate and final reports, as regulated in Contract with EU, - ensuring that the iqsim project time schedule reporting are followed by each workgroup leader, - ensuring that the requirements and deadlines for iqsim project deliverables are met, - financial evaluation and reporting. The Workgroup Leader is responsible for: - scheduling and conducting Intermediate Meetings, - creating workgroup reports according to the requirements of the Project Coordinator (Project Manager), - submitting financial reports, time sheets, cost claims and so forth, according to the requirement of the Project Coordinator (Project Manager). Transferring of responsibilities: may be executed upon request to and the decision of the Project Coordinator (Project Manager) and this should be submitted - as an option - on a standard format enclosed in Appendix A. 11/34

12 6. Communications Meetings Kick - off meeting: This is the first meeting and the project oriented work starts. The partners, the member of workgroups will know each other personally and they will agree to common (and detailed working) plan for cooperation and communication. The Minute of Meetings will specify tasks, time schedules and responsibilities. An agenda before meeting should be made giving enough time to the participants to prepare. Project Meetings: Project Meetings are regularly scheduled meetings for all members of iqsim project consortium team or sub-team at which individual status reporting after each project meeting is one of the standard agenda items. Each workgroup leader should give a status report of his/her workgroup activities at such meetings. An agenda before meeting should be made giving enough time to the participants to prepare themselves. Objectives are: - to provide a forum for communication among all iqsim project consortium teammembers so that they can inform one another of their status, sharing experiences, providing suggestions, raising ideas and concerns, and resolving problems, - to motivate team-members to meet delivery deadlines by reviewing each person's accomplishments in a peer environment, - to provide a mechanism for continuous improvement of processes being used by the team, - to create a clear Minutes of Meeting with actions for each meeting. Intermediate Meetings: Intermediate Meetings may be scheduled ones for members of a one or more workgroup team and where individual status reporting is one of the standard agenda items. An agenda before meeting should be distributed giving enough time to the participants to prepare themselves. Objectives are: - to provide a forum for communication among relevant team-members so that they can perform a task or solve intermediate questions that has been raised, share experiences, provide suggestions, raise concerns, and resolve problems, - to provide a mechanism for continuous improvement of tasks, - to create a clear Minutes of Meeting with actions for each meeting. 12/34

13 Ad- hoc Meetings: This type of meeting is not a long run and in advance planned meeting. An agenda before meeting should be agreed e.g. by phone, , etc. with the participants giving possibility to prepare themselves. Objectives are: - if some urgent issues emerge and there is an occasion for a limited time (sometimes only for some hours long) to discuss and arrange some of the mutually most important and urgent issues, - to create a clear Minutes of Meeting with actions distributed to interested parties. Other types of communication: - shall be submitted to the contact addresses given in Contract with EU (Section 2. Participating Organizations), - visual communication: can be done through the use of Skype or video conference system, - phone, etc. 13/34

14 7. Management review The Project Coordinator (Project Manager) of the iqsim consortium has to make a management review just according to the time-table and before the different type of meetings. This review should be reported and circulated to the members of the consortium. The Project Coordinator (Project Manager) continually reviews the resources and time schedules to ensure that adequate staff, equipment and materials are available to meet iqsim project requirements. 14/34

15 8. Resource management Organization According to the Contract with EU all iqsim project members and staff are allocated with authority to perform their allocated tasks and responsibilities. The following provides a summary of the principal responsibilities of each job role, and these are clarified in greater detail within Contract with EU (Section 5.: Workplan and workpackages). All iqsim project members and staff share the authority and responsibility of identifying non-compliances (non-conformities) or possible improvements, and recording (documenting) these instances such that corrective action can be taken, both to rectify the immediate situation and to prevent recurrence. All these are done with possibility to estimate and demonstrate the efficiency of corrective action(s) as well. Human resources Responsibilities of project personnel: Project Coordinator (Project Manager): - approves the Quality Manual, - manages the different processes in iqsim project, - organizes project management review, - defines time schedules, - manages resources and payments, - approves Work Package Deliveries, - creates interim and final reports, - organizes Project Meetings, - handles the non-conformities and corrective actions, - controls the web site of iqsim project, - up-load the accepted documents (deliverables, working papers etc.) to web site of iqsim project, - keeping touch with the responsible person for iqsim project nominated by EU Commission. Workgroup Leader: - organizes work and actions for project members, staff and work package groups according to the time schedules and if necessary create detailed work descriptions, - specifies content and deliverables for the work package, - manages resources, time schedules and deliverables for work package groups, - organizes meetings for work package group members, - reports to Project Coordinator (Project Manager) the current status of work package, - submits time sheets and cost reports to Project Coordinator (Project Manager) according to the (pre)defined time schedules, 15/34

16 - allocates resources to project members and staff, - organizes and follows up subcontracting, if relevant. Project members and staff: - carries out tasks according time schedules and descriptions submitted by Workgroup Leader, - submit time sheets and cost claims according to the project time schedules using the prescribed forms for the work. Subcontractor: a subcontractor is a company hired by an iqsim project partner to perform part of the work of a task or separate tasks job. A subcontractor must be a separate legal entity with an organization number. The subcontractor shall be bound with the same contractual requirements as the iqsim project partner. A separate non-disclosure contract should be signed or be a part of the contract with the subcontractor and provided to Project Coordinator (Project Manager). 16/34

17 9. Infrastructure All members of the iqsim consortium must have all means and tools of infrastructure which are necessary for carrying out the work of prescribed quality. This includes: word processor with the document format specified, facilities, Skype software for communication, access to meeting facilities for project meetings. 17/34

18 10. Work environment All members of the consortium should have such premises which are suitable for general meetings, workgroup meetings, team-work and there is enough energy capacity for connecting PC-s or projectors to the mains and hygienic equipments are in good condition. Some welding related basic standards and database should be available. 18/34

19 11. Product realization Planning of product realization The Contract with EU basically has the product realization plan (Section 5.: Work plan and work packages). This one should be detailed for each workgroup. These plans should be up-dated regularly according to the realized work phases. The status of the Contract with EU should reviewed regularly specially when preparing for a new project meeting. Customer-related processes These are two types of basic education processes discussed in this iqsim project: - one is the class-room and - other is the distance learning processes. Learning materials should be prepared in form of hard copy or digitalized ones and they need to be applicable for class-room and distance educations. The IT tools should be in good condition for usage. For the pedagogical processes should have the tools necessary (e.g. Smart Board, etc.) and trained and qualified training personnel. The learning materials should have acceptable price. Design and development The iqsim project content developments are developed in modular units and the continuous development is an on-going and documented process. The first step is a PILOT WELDING TRAINING COURSE PROGRAM, which followed by improved ones. Product and service provision The consortium members can produce and develop content in the frame of iqsim project which will be covered by, or require, intellectual property (see the EU regulation: Education Training Youth - Intellectual Property Guidelines for promoters of training projects October 1997.) 19/34

20 12. Intellectual Property (IP) Copyright legislation is part of the wider body of law known as IP. The term IP refers broadly to the creations of the human mind. IP rights protect the interests of creators by giving them property rights over their creations. The Convention Establishing the World Intellectual Property Organization (1967) gives the following list of subject matter protected by IP rights: - literary, artistic and scientific works; - performances of performing artists, phonograms, and broadcasts; inventions in all fields of human endeavour; - scientific discoveries; - industrial designs; - trademarks, service marks, and commercial names and designations; protection against unfair competition; and - all other rights resulting from intellectual activity in the industrial, scientific, literary or artistic fields. For the purposes of copyright protection, the term literary and artistic works is understood to include every original work of authorship, irrespective of its literary or artistic merit. The ideas in the work do not need to be original, but the form of expression must be an original creation of the author. The Berne Convention for the Protection of Literary and Artistic Works (Article 2) states: The expression literary and artistic works shall include every production in the literary, scientific and artistic domain, whatever may be the mode or form of its expression. The Convention goes on to list the following examples of such works: books, pamphlets, other writings, lectures, addresses, sermons translations, adaptations, arrangements of music and other alterations of a literary or artistic work, which are to be protected as original works without prejudice to the copyright in the original work. Collections of literary or artistic works such as encyclopedias and anthologies which, by reason of the selection and arrangement of their contents, constitute intellectual creations, are to be protected as such, without prejudice to the copyright in each of the works forming part of such collections. NOTE: The Intellectual property issues for the iqsim project resides by the Project Coordinator (Project Manager) organization unless otherwise is agreed upon. The copyright issues for the material published during the iqsim project period resides by the Project Coordinator (Project Manager) organization unless otherwise is agreed upon. If any of the iqsim Project Partners wa nt to claim Intellectual Property or 20/34

21 copyright to the project results, then this should be notified to the Project Coordinator (Project Manager) and an appropriate agreement shall be signed. The Creative Commons licenses are model Licenses for such agreements: The translations of learning materials: belonging to iqsim project could be done free of charge translated by the members of iqsim consortium and allowed to give to the participant (students and trainers) of welding courses. 21/34

22 13. Measurement, analysis and improvement Audit: In the framework of iqsim project there will be two kinds of internal and/or external (even third party) audits: - one is the system and performance audit before deadlines of milestones, and - the other one is auditing the product quality, the deliverables (outputs). The means for audits are: - non-conformance form (as an option see: Appendix A), and - checklist (as an option see: Appendix B), The auditors could be for: - for internal audit: Project Coordinator (Project Manager) and/or workgroup leader, and/or any other person nominated by the Project Coordinator (Project Manager), and - for external audit: expert authorized by the EU Commission. Control of monitoring and measuring: The basic tool and document for monitoring and measuring the out-put during the iqsim project time span is the Contract with EU. All other monitoring tools (which are in the Appendix A - D) should be in synchronous with this one. Some written or in meetings declared procedures should support the realization of the contract with EU, as it follows: General procedures for measuring performance: Time schedules and deliverables: A list covering time schedules and deliveries based on the Contract with EU should be created by the Project Coordinator (Project Manager) and agreed upon by the workgroup leaders. Such a list may be divided in two sets, one for activities with meetings, courses, conferences and so forth, and second one covering deliverables. The structure, or lay-out, of the deliverables are defined by the Project Coordinator (Project Manager) and workgroup leaders in accordance with the Contract with EU. Reporting according to time schedules: Reporting time schedules is the process of recording for each task and each workgroup, the effort expended for the reporting period, the estimated effort 22/34

23 remaining to complete the task, and the estimated completion date. Objectives are: - to monitor how the workgroup is performing relative to plan so that potential problems can be pinpointed and addressed at an early stage, - to regularly re-assess the personal commitment of each participants, - to re-evaluate project resources for the tasks, - to evaluate the course performance (according the proposal from CFl- Sweden see later APPENDIX D). NOTE: 1/ Please use as an option: APPENDIX: A, APPENDIX: B, APPENDIX: C and APPENDIX D. Time schedule for iqsim project: Time schedule covering activities, (meetings, courses, conferences, reporting schedules and so forth) for this project is basically in the Contract with EU (Section 5.: Work-plan and work-packages). List of deliverables and responsibilities: List of deliverables and responsibilities covering activities are basically in the Contract with EU (Section 5.: Work-plan and work-packages). Control of non-conforming product: Non-conformance as a general issue: Once non-conforming items (optionally: bugs, errors and suggestions) have been noticed they are identified by location, associated documents, or specific markings to prevent their inadvertent use. All non-conforming items and complaints are subject to review and rectification in mutual understanding with the Project Coordinator (Project Manager). The type and extent of non-conformity is documented in order to establish trends and identify possible areas for improvement. The corrective action required to prevent recurrence is evaluated, documented, and its effective implementation is monitored. All rectification is subsequently re-inspected to ensure complete project satisfaction. The iqsim project has established procedures for review of all activities in order to identify and evaluate all possible improvements in methods/learning materials and its procedures. All iqsim project participants are encouraged to suggest improvements in the project. A standard None-conformance Report and corrective action as an option - is enclosed in APPENDIX A. 23/34

24 Deviation from time schedules If any deviations occur from the time schedule a non-conformance notice should be submitted to the Project Coordinator (Project Manager). The non-conformance notice may be followed by a corrective action report declaring the steps that will be taken in order to correct the non-conformance. If the corrective actions are not regarded as satisfactorily, then the Project Coordinator (Project Manager) may release a document for transfer of responsibilities or decide on a new corrective action (see para: 5. in this iqsim - Project Handbook). Corrective action A corrective action is an action undertaken in order to eliminate the causes of existing incongruence, irregularities, or any other undesirable action in order to prevent their repetition. When a non-conformance occurs a corrective action has to be initiated and a corrective action report (written or oral) should be submitted to the Project Coordinator (Project Manager) with a time schedule for initiating the relevant actions needed. A standard Corrective Action Report (APPENDIX A) as an option is enclosed. Analysis of data evaluation improvement: Reporting performance results of pilot and/or normal welding course: Evaluation of the iqsim project performances (e.g.: Prototype of iqsim online simulator service on web) will take place during the project life time and according to an evaluation plan following the time schedules. To ensure the quality of the welder s courses according to iqsim project there will be a PILOT TRAINING COURSE PROGRAM organized which will be followed by on-going and (after finishing the course) a summarizing evaluation. The results of this will used and they will be the feed-back for improving the learning method and materials as well. A standardized set of evaluation forms has been developed in order to ensure that the evaluation follows the same pattern and that it becomes unified in form and presentation. Sets of evaluation forms, questionnaires etc. of performances as an option and/or pattern free to use and modify by consortium members are presented in: APPENDIX C and APPENDIX D - from CFL- Sweden. 24/34

25 14. Appendices: (options!) Appendix A Appendix B Appendix C Appendix D Non-conformance report and corrective actions Checklist Questionnaires for performance of welding course, from MHtE - Hungary Questionnaires for performance of welding course, from CFL - Sweden 25/34

26 Appendix A (an option!) NON-CONFORMANCE Version: 1.0 REPORT Date: Report Date: Signature: Report No.: WP No.: Lead organization: Circulation to: Finding: Requested report time: Action for correcting the findings Date: Signature: Corrected: Date: Signature: 26/34

27 Appendix B (an option!) CHECKLIST Version: 1.0 PROJECT Date: Item Topic Status Date Signature 1 Check that all the partners understand the aim of WP1 2 Check that all the partners understand the aim of WP2 3 Check that all the partners understand the aim of WP3 4 Check that all the partners understand the aim of WP4 5 Check that all the partners understand the aim of WP5 6 Check that all the partners understand the aim of WP6 7 Check that all the partners understand the aim of WP7 8 Confirm that the partners understand and are fully conversant with tools and technology and the training requirements of the end-users 9 Confirm and check the deadlines with the partners and adjust if necessary 10 Check that there is a degree of flexibility in the time allowed to produce the work 11 Confirm with the partners that the tasks set are appropriate for them and make changes to the individual workloads if necessary 12 Confirm that all partners are undertaking the work required by this WP and that it conforms to the needs of the WP 13 Confirm that the evaluation strategy is adequate for the WG objectives 14 Conform that the internal and external evaluation groups are correctly structured 15 Check that the main outcome, the concept definition of the project fits to the aims of the WP s 16 Check that outcome and results are well documented 17 Confirm accuracy of information and sources as well as possible 18 Install a feedback process to improve the quality of outcome and results 19 Check that interim and final reports are correctly structured 27/34

28 APPENDIX C (an option!) Questionnaires for performance of welding course MHtE/Hungary COURSE COUNTRY PLACE TRAINING CENTRE DATE 1 = EXCELLENT, 2 = VERY GOOD, 3 = GOOD, 4 = POOR 5= VERY POOR NO 1 OVERALL EVALUATION QUESTION MY PERSONAL EVALUATION OF THE WHOLE COURSE IS 2 COURSE APPROACH HOW CAN BE EVALUATED THE COURSE'S APPROACH, TAKING INTO ACCOUNT MY PROFESSIONAL NEEDS? 3 COURSE'S STRUCTURE MY PERSONAL EVALUATION REGARDING THE BALANCE BETWEEN THEORETICAL AND PRACTICAL PARTS IS 4 THEORETICAL PART MY PERSONAL EVALUATION OF THE THEORETICAL PART OF THE COURSE IS 5 PRACTICAL PART MY PERSONAL EVALUATION OF THE PRACTICAL PART OF THE COURSE IS 6 BASE MATERIALS AND CONSUMABLES HOW ARE THE PROPERTIES AND THE DESIGNATION OF THE MATERIALS DESCRIBED? 7 BASE MATERIALS AND CONSUMABLES HOW ARE THE STORAGE AND HANDLING PROCEDURES OF THE MATERIALS EXPLAINED? 28/34

29 8 BASE MATERIALS AND CONSUMABLES HOW ARE THE GEOMETRICAL AND THE CLEANING PREPARATION PROCEDURES CLARIFIED? 9 WELDING PROCESS HOW IS THE WELDING CYCLE DESCRIBED? 10 WELDING PROCESS HOW ARE THE CHOICE AND THE INDIVIDUAL EFFECT OF EACH WELDING PARAMETER CLEARLY ANALYSED? 11 WELDING EQUIPMENT HOW CAN BE EVALUATED THE VARIETY OF WELDING EQUIPMENT AVAILABLE DURING THE PRACTICAL PART? 12 PRACTICAL EXERCISES HOW CAN BE EVALUATED THE PRACTICAL EXERCISES (QUANTITY AND RELEVANCE)? 13 WELDING IMPERFECTIONS HOW ARE THE ORIGIN AND THE RELATED CORRECTIVE ACTIONS OF THE WELDING IMPERFECTIONS ANALYSED? 14 STANDARDS HOW CAN BE CONSIDERED THE EFFECTIVENESS OF THE COURSE FOR APPROACHING THE FINAL EXAMINATION? 15 STANDARDS HOW IS THE APPROACH REGARDING THE RELEVANT STANDARDS ADOPTED DURING THE COURSE? 16 HEALTH AND SAFETY HOW ARE SAFETY PROCEDURES DESCRIBED? 17 REPORTING HOW IS PRESENTED THE FINAL REPORTING AFTER WELDING? 18 QUALITY CONTROL HOW ARE THE MAIN CRITERIA FOR QUALITY CONTROL AFTER WELDING (DESTRUCTIVE AND NON-DESTRUCTIVE) EXPLAINED? 29/34

30 WELDING COURSE PROVIDED BY MHTE No. 1 = EXCELLENT, 2 = VERY GOOD, 3 = GOOD, 4 = POOR 5= VERY POOR My personal evaluation of the practical organization of the course? 2 My personal evaluation of the course documentation is? 3 My personal evaluation of the quality of the video material is? 4 My personal evaluation of using video material with English language is? 5 My personal evaluation of the duration of the video clips are? 6 My personal evaluation of the video examples relevant to my work experiences is? 7 My personal evaluation of the relevance of the course to my work is? 8 My personal evaluation of the learning outcome from the video examples with subsequent discussions is? 9 My personal evaluation of the effectiveness of the training methodology is? 10 My personal evaluation of the video material as a tool that improved the instructional process is? 11 My personal evaluation of the video material as a tool that help improving my understanding of welding topics, for instance welding defects, is? 12 My personal evaluation of the training method as a tool that improved my motivation is? 13 My personal evaluation of the timetable in the course is? 14 My personal evaluation of the pedagogical effort of the course leaders is? 15 My personal evaluation of inn the future having access to more video clips demonstrating advanced welding technique material is? 16 My personal evaluation of in the future having access to more video clips related to examples from real working life, is? 30/34

31 PLEASE WRITE YOUR COMMENTS IN THE WHITE FIELDS: How do you evaluate the product-oriented education against the traditional education? In the next course, please explain why you want to use the new or the traditional learning environment? What is your proposal for improving the efficiency of the new learning environment? You have watched a number of video clips during the course. Please write down any comments about them. Which part of the training are most relevant for your daily work? 31/34

32 YEARS OF EXPERIENCE WITH INTERNET? YEARS OF EXPERIENCE WITH COMPUTERS? HOW MANY COURSES HAVE YOU TAKEN THAT USED COMPUTER-BASED INSTRUCTION? 1-2 YEARS 3-4 YEARS 5-6 YEARS 7 OR MORE YEARS 1-2 COURSES 3-4 COURSES 5-6 COURSES 7 OR MORE COURSES 32/34

33 APPENDIX D (an option!) Questionnaires performance of welding course from CFL/Sweden How many training courses have you been given? How long (hours) was each training course? Was there a progression between the training courses? How many students participated in each training course? How many teachers participated in each training course? Describe the student group (e.g. in house learning staff, welder specialists, welding engineers ) Was the training offered according to market needs, in collaboration with accredited national bodies or certified companies? What was the training environment (e.g. classroom, workplace, home ) Describe in what contexts the training courses is given. Describe in what contexts the simulator tool was used in the training courses. Describe the testing of Activity Based Training (ABT) methodology What was the outcome of your test? 33/34

34 What was new and innovative in your use of the simulator tool? Results and comments We are happy with project WHY?? because iqsim method of learning is really excellent Try today... 34/34