E N T R E P R E N E U R I A L S K I L L S P A S S P R O J E C T Q U A L I T Y A S S U R A N C E P L A N

Transcription

1 E N T R E P R E N E U R I A L S K I L L S P A S S P R O J E C T Q U A L I T Y A S S U R A N C E P L A N Version /05/2014

2 Entrepreneurial Skills Pass V E R S I O N H I S T O R Y Version # Date Author Remarks Draftv1.0 04/05/2014 Sannie Fisker, external evaluator Draftv2.0 08/05/2014 Veronica Mobilio, JA-YE Europe Draftv3.0 13/05/2014 Sannie Fisker, external evaluator Draftv4.0 13/05/2014 Veronica Mobilio, JA-YE Europe Draftv5.0 14/05/2014 Sannie Fisker, external evaluator Draftv6.0 24/05/2014 Sannie Fisker, external evaluator Draft version Draft version Draft version Draft version Draft version Final version Page 2 of 24

3 Entrepreneurial Skills Pass TABLE OF CONTENTS 1. INTRODUCTION... 4 Purpose of The Project Quality Assurance Plan PROJECT QUALITY ASSURANCE OVERVIEW... 4 Project scope... 4 Overall project objectives and corresponding quality metrics... 4 Project Organization and QA Responsibilities... 7 Project organization... 7 Quality Assurance Responsibilities of project partners... 8 Role of the quality manager and external evaluator QUALITY ASSURANCE PROGRESS AND OUTCOME/OUTPUT... 9 Monitoring of project progress Monitoring methodology and documentation Quality assessment criteria Evaluation of project outcome Interim and Final evaluation reports APPENDIX A: PROJECT QUALITY ASSURANCE PLAN APPROVAL APPENDIX B: INTERNAL REPORT FORM INCLUDING QUESTIONS ON QUALITY ISSUES Page 3 of 24

4 Entrepreneurial Skills Pass 1. INTRODUCTION This quality assurance plan supports the quality and evaluation activities in ESP. It forms part of Work Package 4: Quality Assurance. PURPOSE OF THE PROJECT QUALITY ASSURANCE PLAN The Project Quality Assurance Plan documents the necessary information required to effectively manage project quality from project planning to delivery. The purpose of the quality assurance plan is to ensure that project outputs meet quality expectations. The quality assurance plan will define the monitoring and evaluation methodology that will be used to assess the project (activities and outcomes) as well as the quality of the outputs. Moreover, the plan will outline the quality metrics each consortium member has to comply with. The intended audience and users of the Project Quality Assurance Plan is the project manager, project consortium, the steering committee, EACEA and the external evaluator. The plan will be put in place to make sure that the project is EFFECTIVE (doing the right things, which means achieving the goals set out and deliver products that meet the requirements) and EFFICIENT (doing things right that is to plan and monitor the project progress to have a sort of early warning system to detect issues that could become serious if left unattended). The quality assurance plan is needed to be able to answer the following questions: Is the project doing what was planned to do? If not, why not? What do users/members/beneficiaries think about the work? Is the project achieving what has been intended? 2. PROJECT QUALITY ASSURANCE OVERVIEW PROJECT SCOPE ESP is focused on vocational schools (VET) and its main goals are: 1) to provide a certification package able to improve students job prospects and act as more comprehensive proof of the skills and competences employers are looking for; 2) to train and certify more teachers in vocational schools to use the tools that lead to the certification; 3) engage and involve business and industry by having them participate in entrepreneurship education activities in schools as well as endorse the certificate by offering further opportunities for successful candidates. 4) to generate strong local stakeholder support and drive more constructive collaboration between key actors in the entrepreneurship education ecosystem. OVERALL PROJECT OBJECTIVES AND CORRESPONDING QUALITY METRICS In the long term, the project will work to improve young people s competitive advantage on the labour market (mitigate unemployment; increase entrepreneurial potential). This long term impact Page 4 of 24

5 Entrepreneurial Skills Pass cannot be measured in the lifetime of the project, but is an expected impact achieving the objectives of the project. Table 1 provides an overview of the overall objectives of the project together with the corresponding quality metrics, the targets set for each of the indicators and the source of verifying each quality metric. These are the targets that the project will be evaluated against in the final evaluation report. Table 1: Overview of objectives and corresponding quality metrics Overall objective Quality metrics Data source Quantitative To improve students job prospects and act as more comprehensive proof of the skills and competences employers are looking for Number of students who complete the exam Number of students who pass the exam (70% minimum score) compared to the number of students who took the exam Increase in the number of student taking the exam compared to the number of students who completed the Company Programme (entrepreneurial experience in school) from project start to project end Number of students taking the selfassessment Qualitative Outcomes of student self-assessments on seven competences: creativity self-confidence taking initiative teamwork self-efficacy perseverance taking responsibility Self-reporting by local partners Self-reporting by local partners Self-reporting by local partners Self-reporting by local partners Online selfassessment tool (pre-, midterm-, and post assessments) Overall objective Quality metrics Data source Quantitative Incentivize more VET educators and schools to move into entrepreneurship VET schools use ESP Teachers trained to use the ESP tool (face-toface and online training) Qualitative Self-reporting by local partners Self-reporting by local partners Page 5 of 24

6 education Entrepreneurial Skills Pass VET teacher satisfaction - after training - at the end of the school year (end of ESP) - after 1st year of full implementation VET director satisfaction - after 2nd year of full implementation Survey-based assessment forms Face-to-face interviews Survey-based assessment forms Face-to-face interviews or focus groups Overall objective Quality metrics Data source Quantitative Generate strong local stakeholder support; drive more constructive collaboration between key actors in the entrepreneurship education ecosystem National Focus Groups (NFG) established NFG meetings held Number of networking activities Number of people participating in the networking activities Additional countries that have signed up Qualitative Satisfaction with the networking activities among stakeholders in the entrepreneurship education eco-system Self-reporting by local partners Self-reporting by local partners Self-reporting by project partners Self-reporting by project partners Self-reporting by management team Satisfaction surveys at events Overall objective Quality metrics Data source To engage and involve business and industry by having them participate in entrepreneurship education activities in schools, as well as endorse the certificate by offering further opportunities for successful candidates Quantitative Number of businesses formally agree to support the certification Qualitative Satisfaction of businesses participating in ESP Self-reporting by project partners Face-to-face interviews Page 6 of 24

7 Entrepreneurial Skills Pass Variety in types of further opportunities offered to ESP students Face-to-face interviews PROJECT ORGANIZATION AND QA RESPONSIBILITIES PROJECT ORGANIZATION The project consortium has 14 partners, where FFE-YE is the overall project manager and grant administrator. JA-YE is part of the management team and is contents coordinator. Table 2: Overview of project partners and organisational structure Organisations Main role and activities FFE YE JA-YE Europe WKO BitMedia CSR Europe Local partners Project manager/grant administrator (WP1) Responsible of monitoring, evaluation and impact assessment quality assurance (WP4) Content manager/activities coordinator (WP1) Coordination of national implementation (WP3) Coordination of networking and dissemination activities (WP5) Collaboration with Hill&Knowlton Strategies on results exploitation (WP6) Responsible of ESP exam contents (WP2) Active role in national implementation, taking part in establishing the NFGs and designing the teacher training courses (WP3) Organisation of International Symposium for VET teachers 2016 (WP5) Key partner for developing contacts with national and international stakeholder groups, relevant ministries and teachers associations. Involved in involved in disseminating outcomes (WP5). Responsible of ESP exam technological implementation + content development of learning/training resources + technological support (WP2). Responsible of Skills for Jobs Business Campaign: in charge of networking and business engagement (WP7) Take part in the project management, coordinating the activities locally (WP1) Active role in national implementation working on the self-assessment tool, providing feedback on the ESP exam, selecting VET schools and training teachers, piloting the first version of the exam and evaluating the feedbacks, setting up the NFG and coordinating its activities, etc. (WP3) Active role in networking and dissemination (WP5) and results Page 7 of 24

8 H&K exploitation (WP6) Entrepreneurial Skills Pass Responsible of results exploitation (WP6) QUALITY ASSURANCE RESPONSIBILITIES OF PROJECT PARTNERS The QA management workflow is based on specific tools and methodologies, including a QA plan and strategies for the evaluation and validation of all deliverables. The project has a designated quality manager (QM), which is a representative of FFE-YE, and funds are budgeted for the subcontracting of an external evaluator. However, all project partners and associated partners will contribute to the continuous process of quality monitoring and assurance within the consortium, and will provide on-going feedback for the quality manager and evaluator. Table 3 provides an overview of the key actors and their responsibilities in relation to quality assurance. Table 3: Quality assurance responsibilities Name Role Quality Responsibility FFE-YE Administrative Project Manager Lead on the quality assurance work package Appoint quality manager Quality manager Coordinate the evaluation quality assurance plan collecting reports and ensuring that the consortium will use the set of quality metrics defined Inform the project partners about the timing of data collection for monitoring and evaluation Develop financial and reporting guidelines in correlation with the general EACEA guidelines for LLP Ensure the financial targets are in line with projections JA-YE Content coordinator Monitor the activities implementation and the contents quality Steering Committee Local project partners Overall steering of project Project implementors Approve the quality assurance plan Implement the project assessment Ensure that all stakeholders involved will fill the assessment forms Provide the lead partners with all materials Ensure that the quality metrics are met Report on the impact the project had on students, teachers and business volunteers Sannie Fisker External evaluator Design the ESP quality assurance plan Support midterm evaluation and monitoring after Page 8 of 24

9 Entrepreneurial Skills Pass each school term Contribute to Interim report Draft final evaluation report ROLE OF THE QUALITY MANAGER AND EXTERNAL EVALUATOR FFE-YE is responsible for the nomination of a quality manager (QM). The QM is responsible for the administration and implementation of the Quality Assurance Plan, and has the authority to identify problems identified during monitoring activities and to initiate actions, resulting in complete solutions to them. All problems are raised within steering consortium meetings, and the minutes should also record the agreed solution and the time bound action to be taken. There is a requirement to provide evidence that the problem has been solved. The QM will attend all management and consortium meetings, networking and dissemination events at European level (i.e. not all national events). During in-between and following these, s/he will feedback observations and suggestions to the project management team in order to assist the efficiency of the processes which drive the project. The QM will also be in charge of collecting reports from project partners and deliver all relevant information and data to the external evaluator. The external evaluation is central to assure that all the activities related to the project are carried out according to the project scope and objectives. To guarantee independence and transparency, an external evaluator will undertake the external evaluation. The external evaluator (EE) will contribute to the interim report and produce a final evaluation report as per EU requirement with a focus on the key elements of the Quality European Project (Relevance, Efficiency, Effectiveness, Impact and Sustainability). The final report will comprise analyses of questionnaires and assessment forms as well as face-to-face interviews with teachers and business volunteers as supplied by the project partners. The final evaluation will assess the project as a whole and will analyse the future plans and sustainability of the project. The EE will also support the school term evaluations and present findings at project consortium meeting(s). 3. QUALITY ASSURANCE PROGRESS AND OUTCOME/OUTPUT The quality of ESP will be monitored throughout the project through various means of pre-defined methods for ensuring quality as well as a system of evaluation. Quality will be assured on two dimensions monitoring of project progress and evaluation of project outcome/output. In terms of progress, various monitoring and review activities will be conducted to continuously make sure that the project is on track and steps can be taken in case amendments are needed. The quality criteria are related to whether the project is effective and well-managed. Quality assurance in relation to outcome/output will evaluate project results against overall objectives and expected impact. The focus will be on the key elements of the Quality European Project (Relevance, Efficiency, Effectiveness, Impact and Sustainability) _en.pdf Page 9 of 24

10 Entrepreneurial Skills Pass MONITORING OF PROJECT PROGRESS With regards to progress, monitoring will be a collaborative responsibility of the quality manager as appointed by FFE-YE as coordinator of the quality assurance work package, and of each work package leader and participating project partners. On an overall note, work package leaders will be responsible for ensuring that the agreed deadlines for submitting the deliverables for each work package are met and for sending in collected data in relation to quality assurance and evaluation purposes to the coordinator of WP4 Quality Assurance (FFE-YE). MONITORING METHODOLOGY AND DOCUMENTATION The monitoring will be undertaken via a number of instruments, which are described in the following. STEERING COMMITTEE MEETINGS AND CALLS Quality assurance is mandatory for all work packages. In case of issues or differences in opinions the quality manager will consult the steering committee which was approved by all participating organisations. The quality manager will make sure that all major deliverables will go through a Quality Review prior to its final submission in order to ensure that project deliverables are of high quality, professional standard, state-of-the-art and meeting the requirements set to each deliverable. The quality manager will make sure that the deliverable will be discussed and approved by the consortium at the monthly calls of the Steering Committee or face-to-face meetings depending on the timing. In case the delivered products match the required quality standards, the Steering Committee will approve the deliverable. In case the delivered products do not match the required quality standards the Steering Committee/quality manager will point out the discrepancies and ask the partner organisation responsible for the deliverable to adjust it according to the requirements. MANAGEMENT TEAM MEETINGS The quality manager will take part in the monthly management team meetings and make sure that any pertaining quality assurance issues are discussed at the meetings. These can be issues raised in the quality questions in the Internal Report Forms or in the online working environment. BI-ANNUAL ACTIVITY REPORTS Two annual activity reports about the project s progress and plans for the upcoming year will be produced by FFE-YE based on input from the project partners, as well as one final project report. They will be distributed to the EU, the Partners, the National Focus Groups, the selected schools and teachers and others as appropriate. PROJECT SELF-REVIEW - QUALITY QUESTIONS Quality questions have been integrated into the bi-annual Internal Report Forms to monitor the progress in work packages (appendix B). An electronic version of the internal report form will be sent out to all project partners by the quality manager. In the course of the project all operating partners have to check their work package progress on the base of the internal report form. As Page 10 of 24

11 Entrepreneurial Skills Pass such, the project partners must every six months fill in the report form and send it to the quality manager. INTERIM REPORTS FROM PROJECT PARTNERS To ensure the financial quality of the project, FEE-YE will twice a year collect interim reports from the partners and work with an external accountant. ONLINE WORKING ENVIRONMENT As part of the project management an online working environment is set up where the project partners can connect. This environment can be used to raise quality assurance issues to be discussed between project partners including the management team. Also, the management team can provide updates on quality assurance issues to the project partners, e.g. based on discussions in the monthly management team meetings and steering committee meetings. QUALITY ASSESSMENT CRITERIA Monitoring of project progress will have a particular attention on whether the project delivers the anticipated results and is being well-managed. Based on the documentation collected through the monitoring process as described above, the quality manager will check progress against the following quality assessment criteria as part of drafting the bi-annual activity reports. The filled-in checklist will form part of the bi-annual activity report. Table 4: Checklist for quality manager to assess if the project is EFFECTIVE and WELL MANAGED Quality assessment criteria Check The project remains relevant and feasible Yes No The project remains consistent with and supportive of current EU policy and Erasmus+ priorities The project strategy and objectives remain relevant to the needs of the target groups (students, VET schools, VET teachers, businesses) and ultimate beneficiaries Project objectives are being achieved Yes No Results are being delivered as planned, are of good quality and the project s target groups find them relevant to their needs The results being delivered are contributing effectively to the achievement of the project purpose The project is likely to contribute to the overall objective, and there is evidence that the project s ultimate beneficiaries will indeed benefit from the project The project is being well managed by those directly responsible for implementation Yes No Inputs are being provided on time and within budget Activities are being implemented on time Relevant information on project achievements/results is being collected and used, and is accessible to stakeholders in an appropriate format and language Operational plans and budgets are reviewed and updated on a regular basis and reflect lessons learned from experience Transparency and accountability systems (including financial management systems) are adequate and effective Decision based on quality assessment Page 11 of 24

12 Continue implementing as planned Entrepreneurial Skills Pass Revise forward plans If revisions are needed, describe which plans (budgets, resources, activities, possibly results) will be revised and supply documentation of the revisions: Source: Adapted from EC, Project Cycle Guidelines, March EVALUATION OF PROJECT OUTCOME An overview of the evaluation methodology, documentation and responsibility of tasks is provided in the following tables organized according to the project s overall objectives. Table 5: Evaluation methodology, objective 1 OBJECTIVE 1: TO IMPROVE STUDENTS JOB PROSPECTS AND ACT AS MORE COMPREHENSIVE PROOF OF THE SKILLS AND COMPETENCES EMPLOYERS ARE LOOKING FOR Indicator Target Instrument Responsibility Schedule Number of students who complete the exam By halfway point: students Self-reporting Template By project end: students team drafts and sends out reporting template Each national project partner provides management team with numbers Halfway point: Sep.-Oct Project end: Sep.-Nov Number of students who pass the exam (70% minimum score) compared to the number of students who took the exam By halfway point: 50% By project end: 50% Self-reporting Template Quality manager supplies external evaluator with the relevant data team drafts and sends out reporting template Each national project partner provides management team with numbers Halfway point: Sep.-Oct Project end: Sep.-Nov Page 12 of 24

13 Increase in the number of student taking the exam compared to the number of students who completed the Company Programme (entrepreneurial experience in school) from project start to project end Number of students taking the online assessment By project end: 50% increase By halfway point: students By project end: students Entrepreneurial Skills Pass Self-reporting Template Self-reporting Template Quality manager supplies external evaluator with the relevant data team drafts and sends out reporting template Each national project partner provides management team with numbers Quality manager supplies external evaluator with the relevant data team drafts and sends out reporting template Each national project partner provides management team with numbers Project end: Sep.-Nov Halfway point: Sep.-Oct Project end: Sep.-Nov Improvement in seven competences: creativity of self- Outcomes student assessments selfconfidence taking initiative teamwork self-efficacy perseverance taking Online selfassessment tool (pre-, midterm-, and post assessments) Quality manager supplies external evaluator with the relevant data Local partners administers online assessment tool and collect data The Quality manager collects the data from all local partners, prepare one excel-file with data (cleaned) and analyses data 2015 & 2016: Tool administered three times through the CP September: Pre-assessment January: Midterm assessment Page 13 of 24

14 responsibility Target depends on baseline Entrepreneurial Skills Pass if needed The external evaluator analyses data (cleaned excelfile) for end school term 2015 and 2016, interim report and final report June: Post assessment Flexible timetable (it can change from country to country) Concrete Deliverables Quality criteria Quality standard Responsibility Schedule Draft the learning outcomes of the online exam The deliverable contains the content expected from the deliverable description Learning outcomes accepted by project consortium JA-YE Europe Complete by Jan Draft the syllabus of the online exam Online selfassessment tool ESP online system tool The deliverable contains the content expected from the deliverable description The deliverable contains the content expected from the deliverable description The deliverable is structured and written/produced in a way that facilitates its use by the target group The deliverable contains the content expected from the deliverable description Contents of the online exam accepted by project consortium and integrated in the learning resources developed Online assessment tool approved by project consortium Online assessment tool is operational with no errors Online exam system approved by project consortium Online exam JA-YE Europe + WKO JA-YE Europe Complete by Feb rd questionnaire ready by Apr (pilot) Full package ready by Sep (full year of implementation) WKO + Bit Media Pilot-test: June 2014 Complete by Aug.-Sep Page 14 of 24

15 Table 6: Evaluation methodology, objective 2 Entrepreneurial Skills Pass system operational with no errors OBJECTIVE 2: INCENTIVIZE MORE VET EDUCATORS AND SCHOOLS TO MOVE INTO ENTREPRENEURSHIP EDUCATION Indicator Target Instrument Responsibility Schedule Number of VET By halfway point: Self-reporting schools using ESP 70 schools By project end: 200 schools Template team draft and sends out reporting template Each local partner provides management team with numbers Halfway point: Sep.-Oct Project end: Sep.-Nov Number of teachers trained to use the ESP tool By halfway point: 70 teachers trained By project end: 200 teachers trained Self-reporting Template Quality manager supplies external evaluator with the relevant data team drafts and sends out reporting template Each local partner provides management team with numbers Halfway point: Sep.-Oct Project end: Sep.-Nov VET teacher satisfaction VET director satisfaction Majority of teachers satisfied with the training they have received and they will recommend it to other VET teachers Majority of Survey-based assessment forms Face-to-face interviews Quality manager supplies external evaluator with the relevant data team/quality manager drafts assessmentforms and interview guides Local partners administers surveys to teachers and Teachers are asked to do the satisfaction survey after they have been trained (ongoing) Each local partner interview 1-2 Page 15 of 24

16 teachers satisfied with the certification package and its usability Qualitative feedback on participation in the ESP project by VET directors Entrepreneurial Skills Pass conduct face-toface interviews Quality manager collects the data from all local partners, prepare one excel-file with data (cleaned) + a file with relevant qualitative data and analyses data if needed External evaluator analyses data (cleaned excelfile) for interim report and final report teachers on the satisfaction of using the ESP tool after the 1 st year implementation (Jun-Sep. 2015) In countries with contacts to VET directors, 1-2 directors will be interviewed on their satisfaction with the project to be complete 2 nd year of implementation (Jun-Sep 2016) Concrete Deliverables Teachers support tool-kit Face to face and online teacher training Quality criteria The deliverable contains the content expected from the deliverable description The deliverable is structured and written/produced in a way that facilitates its use by the target group The deliverable contains the content expected from the deliverable Quality standard Support tool-kit approved by project consortium Support tool-kit is operational Training (faceto-face and online) are approved by project consortium and Where relevant external evaluator incorporate qualitative data in interim report and final report Responsibility JA-YE + WKO Local partners Schedule Complete by May 2014 Start September 2014, ongoing throughout project Page 16 of 24

17 description The deliverable is structured and written/produced in a way that facilitates its use by the target group Entrepreneurial Skills Pass receiving teachers Table 7: Evaluation methodology, objective 3 OBJECTIVE 3: GENERATE STRONG LOCAL STAKEHOLDER SUPPORT; DRIVE MORE CONSTRUCTIVE COLLABORATION BETWEEN KEY ACTORS IN THE ENTREPRENEURSHIP EDUCATION ECOSYSTEM Indicator Target Instrument Responsibility Schedule Number of people participating in the networking activities and their satisfaction with the networking activities among stakeholders in the entrepreneurship education ecosystem Majority of participants in networking activities are satisfied with the events Questions on satisfaction with the project will be on the agenda of the NFG meetings once a year Satisfaction surveys at events Page 17 of 24 Host organisations distributes participation sheets at the events for participants to sign Host organization of event draft satisfaction survey and ensure collection of data at event team draft questions for NFG meetings Quality manager collects data from participation sheets and satisfaction surveys, prepare one excel-file with data (cleaned) and analyses data if needed External evaluator Ongoing

18 Mainstreaming and project reach Concrete Deliverables Nine National Focus Groups (NFG) established 9 additional countries have signed up Entrepreneurial Skills Pass Self-reporting by management team analyses data (cleaned excelfile) for interim report and final report team Project end: Sep.-Nov team supply external evaluator with information on mainstreaming and project reach Quality criteria Quality standard Responsibility Schedule The deliverable contains the content expected from the deliverable description NFG established and representation of members in NFGs approved by Steering Committee/manag ement team Local partners in charge of setting up NFG Complete by Feb NFG meetings per year (54 NFG meetings held) Networking activities: 3 Consortium Meetings 3 International Events: 1 Launch event 1 stakeholder event 1 International Symposium The deliverable contains the content expected from the deliverable description The deliverables contain the content expected from the deliverable description Members of the NFGs are satisfied with the outcomes of the meetings Events take place as planned according to project description Majority of participants in networking activities are satisfied with the events Local partners in charge of NFG meetings Minutes from meetings are supplied to the team Responsibility of events as set out in management plan/project description Ongoing according to ESP time schedule Ongoing according to ESP time schedule Page 18 of 24

19 for VET Teachers Entrepreneurial Skills Pass 5 face-to-face meetings or online webinars with companies and CSR Europe members 1 Business Summit Table 8: Evaluation methodology, objective 4 OBJECTIVE 4: TO ENGAGE AND INVOLVE BUSINESS AND INDUSTRY BY HAVING THEM PARTICIPATE IN ENTREPRENEURSHIP EDUCATION ACTIVITIES IN SCHOOLS, AS WELL AS ENDORSE THE CERTIFICATE BY OFFERING FURTHER OPPORTUNITIES FOR SUCCESSFUL CANDIDATES Indicator Target Instrument Responsibility Schedule Number of businesses formally agree to support the certification Satisfaction of businesses participating in ESP Examples of further opportunities offered Halfway point: 70 businesses Project end: 200 businesses Majority of business volunteers are satisfied with their participation in ESP and would recommend it to their peers Qualitative data on further opportunities offered by the businesses Self-reporting by project partners Face-to-face interviews Page 19 of 24 team draft and sends out reporting template Each local partner provides management team with numbers team/quality manager drafts interview guides Local partners conduct face-toface interviews Quality manager collects the data from all local partners, sends relevant data to external evaluator and make own analyses if needed Where relevant external evaluator incorporate Halfway point: Sep.- Oct Project end: Sep.-Nov Halfway point: Sep.- Oct Project end: Sep.-Nov. 2016

20 Entrepreneurial Skills Pass qualitative data in final report INTERIM AND FINAL EVALUATION REPORTS The overall project evaluation report describes the evaluation of the project as a whole. This report will be written at the end of the project by the external evaluator and include all the findings of the different partners and the target groups as described in the above tables. The final evaluation report is to be completed by November After completion of 50% of the project an interim report will be written, where the external evaluator will contribute with a section on evaluation based on the findings of the different partners and the target groups as described in the above tables. The interim report is to be completed by April The final and interim evaluation will focus on assessing the efficiency, effectiveness, impact, relevance and sustainability of the project. APPENDIX A: PROJECT QUALITY ASSURANCE PLAN APPROVAL The undersigned acknowledge they have reviewed the ESP Project Quality Assurance Plan and agree with the approach it presents. Changes to this Project Quality Assurance Plan will be coordinated with and approved by the undersigned or their designated representatives. Signature: Date: Print Name: Title: Role: Signature: Date: Print Name: Title: Role: Signature: Date: Print Name: Title: Role: Page 20 of 24

21 Entrepreneurial Skills Pass APPENDIX B: INTERNAL REPORT FORM INCLUDING QUESTIONS ON QUALITY ISSUES 1. Identification Internal Report Form Project Partner institution Contact person Reporting period The Entrepreneurial Skills Pass 2. Activities implemented Work Package 1: project management Start date (dd/mm/yyyy) End date (dd/mm/yyyy) Description of specific tasks undertaken and outcomes Evaluation of outcomes Describe and justify any changes to or variations from the original work plan Impact on the project or changes to the work plan Please add extra sheets if necessary Work Package 2: ESP Exam Start date (dd/mm/yyyy) End date (dd/mm/yyyy) Description of specific tasks undertaken and outcomes Evaluation of outcomes Describe and justify any changes to or variations from the original work plan Impact on the project or changes to the work plan Please add extra sheets if necessary Work Package 3: national implementation Start date (dd/mm/yyyy) End date (dd/mm/yyyy) Description of specific tasks undertaken and Page 21 of 24

22 outcomes Evaluation of outcomes Entrepreneurial Skills Pass Describe and justify any changes to or variations from the original work plan Impact on the project or changes to the work plan Please add extra sheets if necessary Work Package 4: Monitoring, evaluation and impact assessment Start date (dd/mm/yyyy) End date (dd/mm/yyyy) Description of specific tasks undertaken and outcomes Evaluation of outcomes Describe and justify any changes to or variations from the original work plan Impact on the project or changes to the work plan Please add extra sheets if necessary Work Package 7: Skills for Jobs Business Campaign Start date (dd/mm/yyyy) End date (dd/mm/yyyy) Description of specific tasks undertaken and outcomes Evaluation of outcomes Describe and justify any changes to or variations from the original work plan Impact on the project or changes to the work plan Please add extra sheets if necessary 3. Dissemination activities and results exploitation activities (WP5 WP6 )Brief description of dissemination activities implemented and related targeted audiences Page 22 of 24

23 Entrepreneurial Skills Pass Media outreach: total number of clippings Date (DD/MM/YY) Media channel / Place Title Link Clipping Please add extra sheets if necessary Communication channels Country channel (Annual report, newsletter etc.) Link Clipping/ screenshot Please add extra sheets if necessary Policy outreach Forum - Conference Date (DD/MM/YY) Presenter - Speaker Please add extra sheets if necessary 4. Quality assurance Is there any slippage anticipated for milestones and deliverables in the next period? Yes No If yes, which milestones/deliverables are concerned and how will any slippage be corrected so that the agreed project timeline and expenditure profiles are not affected? Is continuous and efficient communication among project partners assured with appropriate tools? No need for improvement Some scope for improvement Significant room for improvement Strong improvement needed Please specify if you rated significant or strong improvement needed and, if possible, provide suggestions for improvement. Page 23 of 24

24 Entrepreneurial Skills Pass We (me and, if applicable, my colleagues in my organisation) have access to all information relevant for project implementation No need for improvement Some scope for improvement Significant room for improvement Strong improvement needed Please specify if you rated significant or strong improvement needed and, if possible, provide suggestions for improvement. We (me and, if applicable, my colleagues in my organisation) have a coherent understanding of the project, its methodical approach and terminology used No need for improvement Some scope for improvement Significant room for improvement Strong improvement needed Please specify if you rated significant or strong improvement needed and, if possible, provide suggestions for improvement. Our (my organisation s) interests and needs are continuously considered and integrated into the projects implementation No need for improvement Some scope for improvement Significant room for improvement Strong improvement needed Please specify if you rated significant or strong improvement needed and, if possible, provide suggestions for improvement. 5. Impact of the project, spin-offs, and any other comments Page 24 of 24