EVALUATION REPORT 3. Research by. February 2011

Transcription

1 EVALUATION REPORT 3 3 rd Transnational Meeting and Phase 3 4 th - 5 th November 2010, Porto, PT Research by February 2011 Funded by the European Commission Education, Audiovisual and Culture Executive Agency, Lifelong Learning Programme: Leonardo da Vinci Transfer of Innovation LLP-LDV-TOI-09-AT-0004

2 CONTENT 0. Introduction General Aspects Were you satisfied with the accommodation and facilities? Were you satisfied with the social programme? Project Meeting Were you satisfied with the preparation work for the meeting in Porto? Were you satisfied with the agenda of the meeting? Were you satisfied with the general working atmosphere during the meeting? Were you satisfied with the way the meeting was managed? Do you think the meeting was generally successful? Do you think the members of the project group were able to make some progress and to achieve relevant results? Project Phase 3 (03/10-10/10) Were you aware of the main developments in the ISO QUAM project in the last project phase? Are you satisfied with the quantity and quality of achievements made so far in this project? Are you still happy to be member of the ISO QUAM project group? Are you satisfied with the partner contributions to the project? If you look ahead to the next project phase, are you fully aware of your role in this phase? Do you know what will be expected from you? If you look ahead to the next steps to the project, do you feel the project will make positive or negative developments? Other If there is anything else you want to express in regard to the plenary meeting in Porto, please use the space below: Summary and Overall Evaluation Annex: Evaluation Questionnaire ISO QUAM/Porto Meeting & Phase 3 Auxilium

3 0. Introduction The present evaluation report was prepared by Auxilum for ISO QUAM - ISO 17024:2003 certification for qualified metal worker, a Leonardo da Vinci Transfer of Innovation project, proposed by SystemCert. Apart from SystemCert P0, the following institutions participate in the project: P1 Chamber of Commerce and Industry Dobrich, BG P2 FONDO FORMACION EUSKADI S.L.L., ES P3 Porin Aikuiskoulutuskeskus (PAKK), FI P4 Development Association of Aetoloakarnania, EL P5 Fondazione Aldini Valeriani per lo sviluppo della cultura tecnica (FAV), IT P6 Centro de Formacao Profissional da Industria Metalurgica e Metalomecanica (CENFIM), PT The report is based on a survey conducted by Auxilium an Austrian institution assigned with the Quality Management & Evaluation Plan of the project. The 3rd Evaluation Progress Report aims at providing valid feedback and information on the development of the 3rd Transnational Meeting held in Porto, PT, on 4th 5th November In order to obtain the information requested, the partners were asked to complete a questionnaire designed by Auxilium. The questionnaire comprised 13 questions on the third phase of the ISOQUAM project as well as on the group meeting in Porto. The questionnaires were distributed by shortly after the meeting. Auxilium received feedback from five participating institutions in the period from November 2010 to February So a total of 5 questionnaires were collected. Thanks to the active cooperation of the organisations, we were able to gather valuable feedback. The results obtained will support SystemCert as well as the entire partnership in their further work and management strategy. Daniela Maresch, MMA ISO QUAM/Porto Meeting & Phase 3 Auxilium

4 1. General Aspects 1.1. Were you satisfied with the accommodation and facilities? Tab. 1: Scores for Question 1.1 Comments by partners The meeting room and the equipment for the meeting were still ok. The four star hotel was at the maximum a three star hotel. The hotel was very well situated. Very good hotel. Long far a way to Trofa. Transition take a little time. My TV not working, but anyway I can t understand Portuguese talking. The organization has been great, especially because of the difficulties tied with the trip from and to the hotel. All in all, the partners were very satisfied with the accommodation provided, which was well situated and good, even if one partner would have judged it as only a three star hotel instead of four and if there was one TV that did not work. Also the meeting room and the equipment for the meeting were all right. The only problem with the accommodation was the fact that transition took too much time. So the partners submitted an average score of satisfaction of 3.80 points. ISO QUAM/Porto Meeting & Phase 3 Auxilium

5 1.2. Were you satisfied with the social programme? Tab. 2: Scores for Question 1.2 Comments by partners The programme itself was phantastic the time we needed to go from one place to the other was too long. We were travelling all the time. I would prefer more compact programme. I appreciate the effort of the host partner to try a comfortable stay for all of us and to show his place. Excellent programme. Good and tasty dinners and interesting Wine Cellar visiting. The Portuguese partner has planned a very interesting social programme. The partners were happy with the social programme organised at the meeting in Porto and expressed this opinion by an average score of satisfaction of 4.20 points. They especially pointed out the tasty dinners and the interesting Wine Cellar visiting. The only disadvantage of the social programme was the very long distances that prevented the social programme from being perfect. ISO QUAM/Porto Meeting & Phase 3 Auxilium

6 2. Project Meeting 2.1. Were you satisfied with the preparation work for the meeting in Porto? Tab. 3: Scores for Question 2.1 Comments by partners The preliminary communication was good and we received the most important information in advance. Maybe I would like more information flow among partners from meeting to meeting. It should be a little bit more and earlier information before meeting e.g. agenda. The coordinator gave us all the important communication concerned with the meeting. In regard to the preparation work for the Porto meeting, the majority of the partners submitted 4.00 point scores and one partner even a 5.00 score, which resulted in an average score of 4.20 points. The partners agreed that all relevant information was given before the meeting, even if some of them suggested that it would have been better to receive information earlier. ISO QUAM/Porto Meeting & Phase 3 Auxilium

7 2.2. Were you satisfied with the agenda of the meeting? Tab. 4: Scores for Question 2.2 Comments by partners Yes, well structured, good discussion, partners were fully involved. Totally!! Both the structure and time were adequate, from my point of view. The meeting was very well distributed: the work time, when everybody could say his/her opinion about the main issues of the work, and the social time, when we can enjoy and consolidate the relationships for future projects. Lunch breaks take a long time, because it was long far a way to restaurants. The agenda were really well studied and carried on with success by all the partners. Concerning the meeting agenda, the excellent average score of 4.80 points was achieved. In general, the partners stated that the agenda was well structured and offered enough time for discussions and work as well as for social time used to consolidate the relationship between the partners. Once again only the long distance this time concerning the way to go for lunch was criticized. ISO QUAM/Porto Meeting & Phase 3 Auxilium

8 2.3. Were you satisfied with the general working atmosphere during the meeting? Tab. 5: Scores for Question 2.3 Comments by partners All partners did a very good job concentrated and constructive. The working atmosphere was excellent, each opinion has been respected and each partner contributed to the discussions. Absolutely! Atmosphere was pleasant and gentile. Every partner felt free to express his opinion and every opinion has been constructively discussed by all the partners. Regarding the working atmosphere, the highest average score possible of 5.00 points was obtained. The institutions participating in the present survey were more than satisfied with the working atmosphere and stated that each opinion was respected and each partner contributed to the discussions. All those aspects therefore created a very pleasant a gentile working atmosphere. ISO QUAM/Porto Meeting & Phase 3 Auxilium

9 2.4. Were you satisfied with the way the meeting was managed? Tab. 6: Scores for Question 2.4 Comments by partners The meeting was managed very well in every aspect. Managed was professional and flexible. Again, the coordinator has done a great job! When asked to rate the management of the meeting, the feedback provided by the partners was excellent and can also be seen in the very good average score of 4.80 points. Statements made to this question spoke of a professional and flexible management where the coordinator did a great job. ISO QUAM/Porto Meeting & Phase 3 Auxilium

10 2.5 Do you think the meeting was generally successful? Do you think the members of the project group were able to make some progress and to achieve relevant results? Tab. 7: Scores for Question 2.5 Comments by partners There were a lot of agreements relating to finished results and a lot of new deadlines relating to the future workpackages. The meeting was very successful. Yes, I think everybody did his/her best! Piloting phase are very challenging. We start the latest WP having clear what to do and the deadlines to respect. We certainly can do a good work. The average score of satisfaction of 4.60 points show that the meeting was considered very successful. There were a lot of agreements achieved and some new deadlines fixed for the future workpackages. It was also stated by one partner that piloting phase are very challenging. ISO QUAM/Porto Meeting & Phase 3 Auxilium

11 3. Project Phase 3 (03/10-10/10) 3.1. Were you aware of the main developments in the ISO QUAM project in the last project phase? Tab. 8: Scores for Question 3.1 Comments by partners I am fully aware. As I said before, the only thing I miss is a more fluent communication among all of us, and of course, from the coordinator (eg, after the reception of each ). We entrust so. We recovered the lost time and we came back in row with the project agenda. Concerning the developments of the third project phase, four of five partners submitted 5.00 points ratings and one partner a 4.00 points rating leading to an excellent average score of 4.80 points. All partners therefore seem fully aware of the main developments of the project and are happy for having recovered the lost time and for coming back in row with the project agenda. One partner stated that he/she misses a more fluent communication among the partners and from the coordinator when answering to this question. ISO QUAM/Porto Meeting & Phase 3 Auxilium

12 3.2. Are you satisfied with the quantity and quality of achievements made so far in this project? Are you still happy to be member of the ISO QUAM project group? Tab. 9: Scores for Question 3.2 Comments by partners I am happy with the achieved so far and believe that now we have the most exiting phase of the project the trainings and exams at place. I like the project and enjoy being part of it. Yes, I think every partner makes his/her best in order to achieve the project aims. Everything goes as what is written in the proposal. Communication are not active. FAV is really satisfied with the work done in this project and is absolutely happy to be a partner in this project. With an average score of 4.80 points, the partnership seems to be very happy with the achievements made in the project so far. One partner especially highlighted to look very much forward to the next, probably most exiting phase of the project: the trainings and exams at place. ISO QUAM/Porto Meeting & Phase 3 Auxilium

13 3.3. Are you satisfied with the partner contributions to the project? Tab. 10: Scores for Question 3.3 Comments by partners Everything is ok. Yes, partners have the necessary background and competences. Certainly. All partners do their best for the success of the project. Concerning the satisfaction with the partner s contribution to the project two of the five respondents submitted scores of 5.00 points and three of them submitted 4.00 points score. The excellent result therefore is of an average score of 4.40 points. No negative comment was stated. ISO QUAM/Porto Meeting & Phase 3 Auxilium

14 3.4. If you look ahead to the next project phase, are you fully aware of your role in this phase? Do you know what will be expected from you? Tab. 10: Scores for Question 3.4 Comments by partners I am fully aware with my next tasks and find the next project phase really exiting. Yes, but I would like the support of the coordinator in case there are any doubts or problems. Yes, I do. I know what to do and the deadlines to do that, so I can certainly do a good job! The average score of satisfaction of 4.80 points clearly indicates that the partners are fully aware of their role in this phase and of what will be expected from them. The partners know their next tasks and deadlines and are looking forward to the next project phase. Only one partner stated that he sometimes misses the support of the coordinator in case there are any doubts of problems. ISO QUAM/Porto Meeting & Phase 3 Auxilium

15 3.5. If you look ahead to the next steps to the project, do you feel the project will make positive or negative developments? Comments by partners What do you expect to be positive? Everything will be positive because we are working therefore. The tests at place will have very positive influence. I feel the project will make positive developments, but the next phase (the testing of the materials) can be a little complicated. I don t consider it as something negative, only a little more difficult than the previous tasks, because we depend on more people. Anyway, we will do our best! Positive, of course. The final results of the project. What do you expect to be negative? Every country can t do for fifteen pilots. We only have to be careful with the testing phase. The evaluation of the statements coming from the partners when they were asked for positive and negative developments showed that all concerns regarding the future are referring to the testing phase (testing of materials) which seem very challenging to the partnership as more people will be involved in it. Nevertheless a very positive influence of this phase is expected. As one partner also stated, another problem to be expected will be the difficulty for some countries to organize fifteen pilots. ISO QUAM/Porto Meeting & Phase 3 Auxilium

16 4. Other 4.1. If there is anything else you want to express in regard to the plenary meeting in Porto, please use the space below: No supplementary free comment was made on the Porto meeting. ISO QUAM/Porto Meeting & Phase 3 Auxilium

17 5. Summary and Overall Evaluation The evaluation report compiled after the plenary meeting in Porto, PT provides mainly positive feedback to the evaluator and to the project coordinator. From the evaluator s point of view, no major concerns could be detected at the end of the firth phase: very high average scores ranging from 3.80 to 5.00 could be obtained in the present survey. The ISO QUAM partnership provided positive feedback on the previous project phase. Particularly, the following aspects were described as very satisfactory: Working atmosphere A very positive sign for the prosperous development of a project is a good working atmosphere, which seems to be perfect in this project as every single partner submitted the highest score possible when answering to this question. This perfect cooperation will surely help to ensure a perfect progress of the next challenging project phase. Agenda and management of the meeting The agenda as well as the management of the meeting received very high ratings from all participants. The partners pointed out that they were very satisfied with the efficient and way the meeting was managed and that especially the coordinator did a very good work. Ir regard to the agenda it was highlighted that due to the well structured way the agenda was dressed every partner had enough time for discussions and work as well as for social relationship. Achievements of past phase and awareness of next phase It is very pleasant for the evaluator to see that the partnership is fully satisfied with the achievements made in this third phase and that at the same time everybody is very much looking forward to the next testing phase. Therefore very high scores were achieved when answering to these questions. ISO QUAM/Porto Meeting & Phase 3 Auxilium

18 Although no major problems occurred at the meeting in Portugal as well as in the previous project phase, there are still some aspects that leave room for improvement. Based on the feedback obtained from the questionnaires, the following recommendations can be made: Opting for short distances There was only one thing to be criticized by the partnership but the critic expressed by the partners was recurrent and referred to the very long distances the partners had to cover for reaching the meeting room when leaving the hotel as well as for going out for lunch when leaving the meeting room. Partner communication could be more efficient As in the previous surveys, it was also stated this time that the communication between the partners and the coordinator should be improved in order to maintain a high quality of the project outputs. So even if it seems that progress has been made in this regard as only one partner criticized this point every single partner is requested to take this advice. Furthermore the coordinator is invited to give prompt support in case of doubts or problems that might come up by the partnership. Testing phase and pilot Even if everybody is looking forward to the next testing and pilot phase our present survey also revealed that the partners have some kind of respect concerning this phase as the good development will depend on more people and as it will be difficult for some countries to organise fifteen pilots. Therefore the evaluator strongly advises to take care that communication will be kept high and that all problems arising will be dealt without delay in order to prevent problems in advance. ISO QUAM/Porto Meeting & Phase 3 Auxilium

19 6. Annex: Evaluation Questionnaire Dear ISO QUAM Partners, This questionnaire should give you the opportunity to express some feedback on the transnational meeting in Porto, Portugal, as well as on the third phase of the project. Your opinion is very valuable for the promoter as well as for the whole project group in order to successfully continue with this project. Of course, we are aware that completing questionnaires is not always a pleasure only, nevertheless, it is necessary for improving the quality of the project and its products - and as such this evaluation is an integrated part of the project work plan. Please be so kind as to answer all questions by ticking the appropriate score box and by providing some written text; if a question is not relevant, please simply tick the box with NA (not applicable). Submitting one questionnaire per partner organisation should be sufficient; however, it is up to you to return more questionnaires if more representatives of your organisation attended the meeting. Please return the completed questionnaires no later than December 6 th to christina.pusswald@auxilium.co.at. In case of any questions please do not hesitate to contact me. Thank you very much for your co-operation and your support! Christina ISO QUAM/Porto Meeting & Phase 3 Auxilium

20 Evaluation of Plenary Meeting & Project Progress 1. General Aspects 1.1 Were you satisfied with the accommodation and facilities? (E.g. location, rooms, service, food, seminar room, equipment)? NA Please comment on your decision: 1.2 Were you satisfied with the social programme? NA Please comment on your decision: 2. Project Meeting 2.1 Were you satisfied with the preparation work for the meeting in Porto? (E.g. quantity and quality of information flow before the meeting; communication management of promoter/hosting organisation) NA Please comment on your decision: ISO QUAM/Porto Meeting & Phase 3 Auxilium

21 2.2 Were you satisfied with the agenda of the meeting? (E.g. structure, time, involvement of partners, discussion points) NA Please comment on your decision: 2.3 Were you satisfied with the general working atmosphere during the meeting? (E.g. Did all partners have the opportunity to contribute to the project meeting? Was everybody s opinion heard and respected?) NA If you have any questions concerning these issues, please use the space below: 2.4 Were you satisfied with the way the meeting was managed? (E.g. management, social and communication competences; time management; conflict management; quality and quantity of input provided by the promoter?) NA Please comment on your decision: ISO QUAM/Porto Meeting & Phase 3 Auxilium

22 2.5 Do you think the meeting was generally successful? Do you think the members of the project group were able to make some progress and to achieve relevant results? NA Please comment on your decision: 3. Project Phase 3 (03/10-10/10) 3.1 Were you aware of the main developments in the ISO QUAM project in the last project phase? (E.g. finalisation of competence matrix, adaptation of materials) NA Please comment on your decision: 3.2 Are you satisfied with the quantity and quality of achievements made so far in this project? Are you still happy to be a member of the ISO QUAM project group? NA Please comment on your decision: ISO QUAM/Porto Meeting & Phase 3 Auxilium

23 3.3 Are you satisfied with the partner contributions to the project? (E.g. professional competences, quantity and quality of input; communication and social skills; time/crises/conflict competences) NA Please comment on your decision: 3.4 If you look ahead to the next project phase, are you fully aware of your role in this phase? Do you know what will be expected from you? (E.g. testing phase, dissemination activities) NA Please comment on your decision: 3.5 If you look ahead to the next steps to the project, do you feel the project will make positive or negative developments? (E.g. risks, threats, problems, opportunities) What do you expect to be positive: What do you expect to be negative: ISO QUAM/Porto Meeting & Phase 3 Auxilium

24 4. Other If there is anything else you want to express in regard to the plenary meeting in Porto (things you really liked, things you did not like at all, things you missed, things that could be improved next time etc.), please use the space below: Thank you very much for your cooperation! ISO QUAM/Porto Meeting & Phase 3 Auxilium