evolution of the Pilot Test

Transcription

1 Pilot test ROP ERDF Marche Bruxelles, 28 September 2011 Alessandro Valenza (evaluator ) Lucio Pesetti (Managing Authority)

2 Outline Evolution of the Indicator system ROP Strategy Revision of indicators Key findings of the Pilot test Pilot test in Priority 1 Concluding remarks

3 Evolution of the indicator system Indicators already provide a picture of the context Increase of the number of indicators and statistical sources Tight correlation between the context and the impact/outcome to achieve back Source: Analysis of Indicator between the period and

4 Outline Evolution of the Indicator system ROP Strategy Revision of indicators Key findings of the Pilot test Pilot test in Priority 1 Concluding remarks

5 ROP Strategy Financial Allocation per priority 15% 17% 43% Priorities Innovation 13% ICT 12% Energy Accessibility territorial development (total budget 282 Meuro) back Source: Annual Execution Report ROP ERDF

6 Outline Evolution of the Indicator system ROP Strategy Revision of indicators Key findings of the Pilot test Pilot test in Priority 1 Concluding remarks

7 Revision of indicators: guiding criteria New definition of result adopting the formualtion of Draft Paper DG REGIO and High Level Group Paper (1) Re-use logic and attention to costs and feaseability Policy-indicator clear connection: link theory of change - OP priority to expected result indicator back (1) Draft Paper DG REGIO corresponds to A Concepts and Ideas. Monitoring and Evaluation in the practice of European Cohesion Policy European Regional Development Fund and Cohesion Fund. High Level Group Paper corresponds to Outcome indicators and targets Towards a new system of monitoring and evaluation in the Eu Cohesion Policy (June, 2011)

8 Outline Evolution of the Indicator system ROP Strategy Revision of indicators Key findings of the Pilot test Pilot test in Priority 1 Concluding remarks

9 Key findings of the Pilot test Result indicators: all priorities (from 36 to 18) reduction of 50% Totally new indicators: 9 All the new indicator are for the priority 1 and 5

10 Key findings of the Pilot test Output indicators: all priorities - From 52 to 42 reduction of 19% - Totally new indicators: 13

11 Outline Evolution of the Indicator system ROP Strategy Revision of indicators Key findings of the Pilot test Pilot test in Priority 1 Concluding remarks

12 Focusing on Priority 1: Financial priority relevance: it is the main priority in terms of financial allocation (43%) Policy priority relevance: it is a relevant priority because of the centrality of innovation and research (Lisbon Strategy and Eu 2020) High level of innovation in the pilot test at the level of: Strategic articulation of the priority (as for Priority 5). Our approach identifies 3 objectives under Priority 1 corresponding to 3 theories of change Innovation of output and result indicators

13 Priority 1: present situation The priority 1 has several goals: innovation, R&S and credit assistance Objective Result (impact) indicators Output indicators Priority 1 R&D employees per 1000 inhabitants (impact) Firms R&D expenditure (impact) Firms created in research spin-off Firms included in R&D activities Investment amount Firms receiving guarantee funds.. N. of technological transfer projects N. of product innovation projects. N. of R&D projects N. of R&D projects involving networks of firms.. Number of projects adopting new financial tools N. of Projects related to the regional collateral system.

14 New strategic articulation: Existing indicator fit in the new 3 priorities Objective Result (impact) indicator s Output indicators 1)Enhance the technological transfer to SME R&D employees per 1000 inhabitants (impact) Firms R&D expenditure (impact) 2)Promote R&D Firms created in research spin-off Firms included in R&D activities N. of technological transfer projects N. of product innovation projects N. of R&D projects N. of R&D projects involving networks of firms 3) Promote accessibility to credit Investment amount Firms receiving guarantee funds.. Number of projects adopting new financial tools N. of Projects related to the regional collateral system

15 Polishing the set Reallocation of indicator output and outcome Objective Impact/ Outcome indicator Outputs 1)Enhance the the technological transfer to SME 2)Promote R&D 3) Promote accessibility to credit R&D employees per 1000 inhabitants (impact) Firms R&D expenditure (impact) Firms created in research spin-off N. of technological transfer projects N. of product innovation projects. ms.. N. of R&D projects N. of R&D projects involving networks of firms Firms included in R&D activities Investment amount Firms receiving guarantee funds Number of projects adopting new financial tools

16 Focusing on result indicator Adopting a theory of change approach Theories of changes Objective Result indicators 1)Enhance the technological transfer to SME % regional firms introducing product and process innovations (new) Level of innovation within the SME beyond R&D 2)Promote R&D N. academic regional spin off Firms R&D expenditure (% GDP) Regional employment rate of graduated The System capacity: University + SME + Public Actor 3) Promote accessibility to credit Credit intensity Financing capacity SME negotiating capacity wth Bank system back

17 Output indicator From project to SME Objective 1)Enhance the technological transfer to SME 2)Promote R&D 3) Promote accessibility to credit Outputs indicators N. of financed firms for technological transfer Total expenditure for technological transfer (Rop Erdf+ privat contributions) Number of Spin-off N of technical graduates N. of financed firms in R&D projects Total expenditure for R&D (Rop Erdf+ privat contributions) Total grant funds investments Total grants funds N. of granted firms

18 Pilot test in Priority 1: New indicators and new strategic articulation Objective Result indicators Outputs indicators 1)Enhance the technological transfer to SME 2)Promote R&D % regional firms introducing product and process innovations (new) N. academic regional spin off Firms R&D expenditure (% GDP) Regional employment rate of graduated N. of financed firms for technological transfer Total expenditure for technological transfer (Rop Erdf+ privat contributions) Number of Spin-off N of technical graduates N. of financed firms in R&D projects Total expenditure for R&D (Rop Erdf+ privat contributions) 3) Promote accessibility to credit Regional credit intensity Financing capacity Total grant funds investments Total grants funds N. of granted firms

19 Outline Evolution of the Indicator system ROP Strategy Revision of indicators Key findings of the Pilot test Pilot test in Priority 1 Concluding remarks

20 Conclusions The present indicator system has already evolved in triggering results and context (evolution not revolution). The most important innovation was the re shape of priority s ariticulation for achieving a sharper connection between indicator and policy change To desing. More concentration and more simplification of indicators

21 Thank you!