Intervention logic Explaining the result orientation of 2014-2020 Training to Managing Authorities, summer 2014, Brussels Trainer: Marie-Jose Zondag, Ecorys Netherlands
Content 1. Result orientation 2. Specific objectives 3. Defining indicators, baselines and targets 2
What is result oriented approach Example: To increase competitiveness and the business environment What do you think? Is this a specific objective with a result oriented approach? 3
Effectiveness is overall principle Art.4 CPR (1303/2013): Commission and Member States shall ensure the effectiveness of the European Structural Investment Funds, in particular through monitoring, reporting and evaluation. Four building blocks for result orientation: 1. Result orientation of programmes 2. Monitoring through indicators 3. Performance framework, review and reserve 4. Evaluation and Reporting Objective is the same but some technical details vary by Fund due to the scope of the Funds. 4
Structure of Operational Programme EU2020, policies, Partnership Agreement Analysis Strategy Thematic objectives Priority Axis Investment priority 1 Investment priority 2 Specific objective 1 Specific objective 2 Specific objective 1 Specific objective 2 indicators indicators indicators indicators Operations 5
Intervention logic 6
A tool for result orientation Problem tree High unemployment Objective tree Lower unemployment Weak SME sector Strengthened SME sector Lack of business services.. Is caused by.. Lack of entrepreneurs Poor entrepreneurial skills Increase in business services.. Will lead to... More start ups entreprises Better skilled entrepreneurs 7
Intervention logic for each priority axis Specific objectives: Investment priorities what the MS wants to achieve, taking into account national and regional challenges, needs and potentials Result indicators Actions: needed to achieve the specific objectives Categories of intervention Output Indicators 8
Output and result indicators Output indicator Linked to activities of operations Common & programme specific indicators (Included in annexes to the fund specific Regulations and Definitions in Guidance Documents, developed in consultation with the Member States over last 3 years) Result indicator Relates to specific objectives Captures the expected change For ESF also common & programme specific result indicators 9
Result Indicators for ERDF/ESF/CF focus on change ERDF/CF Result indicator reflects specific objective and policy Result indicator shows change in and benefit to the region or target group ERDF/CF does not have common result indicators Baseline defined on basis of situation before the programme Evaluation to disentangle the contribution of the policy to change from the influence of other factors (impact); and do not represent the EC's official position ESF Result indicator reflects supported actions Result indicator shows change to beneficiaries (directly supported people or entities ESF has common result indicators Baseline defined on basis of previous experience Evaluation to assess net result (impact) or to assess broader effects e.g. on employment rate of a certain target group. 10
Examples of result indicators Specific objective: Improve the accessibility of a region, Increase the employment of young people. Example of result indicator: Reduction in travelling time; Young people in employment 6 months after training 11
Intervention logic in OP Section 1 Table 2 in OP: Overview of investment strategy Prior ity Axis Fund Union support in Proportio n of total Union support for the OP Thematic objective Investment priority Specific objective related to IP (Common and) programme-specific result indicators for which a target has been set PA1 ERDF 50,000, 000 25% TO1 SME Development To increase number of start-ups in high tech sector Number of start-ups in the defined target group. % of such start-ups surviving after 2 years. etc Source: http://ec.europa.eu/regional_policy/sources/docgener/informat/2014/guidance_op_140314.pdf 12
Intervention logic in OP Section 2A5 - Results ID Specific objective Expected results IP1 To increase the number of start-ups in high tech sector Increased number of start-ups in high tech sector Table 3 Programme specific result indicators ID Result indicator Measur ement unit IP1 IP1 Number of startups in the defined target group. % of such startups surviving after 2 years. number Category of region Less developed region % Less developed region Baselin e value Baselin e year Target value Source of data Frequency of reporting 150 000 2013 160 000 Statistics Once a year 50% 2012 60% Statistics Once a year 13
Intervention logic in OP Section 2A5 - Results ID Specific objective Expected results IP1 Increase employment and employability especially of long-term, low-skilled, older and disabled unemployed 1.1 Increased employment of long-term, low-skilled, older and disabled unemployed 1.2 Increased qualification of long-term, low-skilled, older and disabled unemployed Table 4 (Common and) programme specific result indicators ID Result indicator Category of region Measurem ent unit Common output indicator as basis for target Baseli ne value Base line year Target value Source of data Repo rting IP1 C3d. Participants in employment, incl. selfemployment, upon leaving Less developed regions Number of participants C1a. Unemployed, incl. long-term unemployed 35.000 2013 38.000 Monitorin g reports Quart erly IP1 Sxy. Long-term unemployed in employment, incl. selfemployment, upon leaving Less developed regions Number of participants N/A 20.000 2013 26.000 Monitorin g reports Quart erly IP1 C3c. Participants gaining a qualification upon leaving Less developed regions Number of participants C1a. Unemployed, incl. long-term unemployed 55.500 2013 56.000 Monitorin g reports Quart erly Table 4a YEI result indicators and programme specific result indicators (only YEI) 14
Output indicators for ERDF/ESF/CF linked to activities Output indicators capture what the resources are spent on Common output indicators relate to most frequently implemented actions Output indicators provide aggregate information for analysis & communication purposes Annex of fund regulation contains common output indicators No baselines, targets are cumulative 15
Intervention logic in OP Section 2A6 - Outputs Section 2A61 Description of type of actions Table 5 Common and programme specific output D Output indicator Measur indicators ement unit IP1 IP2 Number of enterprises receiving support Number of people trained Fund Category of region Number ERDF Less developed region Target value Source of data 160 000 Progress reports Number ESF Not applicable 100 000 Progress reports Frequency of reporting Once a year Once a year 16
Categories of intervention ERDF/ESF/CF Annex Implementing regulation 215/2014 In OP Section 2A9: 1. Intervention field 2. Form of finance 3. Territory type 4. Territorial delivery mechanism 5. Thematic objective 6. Secondary theme (ESF) 7. Economic activity 8. Location Used for calculating support to climate change objectives Used for statistics of EU Table 7-11 Fund Category of region Dimension Priority Axis Code Amount (euro) PA1 e.g.102 e.g.100 000 PA1 etc 17
Example of intervention logic overview Priority Axis 1 / Thematic objective 1: Research and innovation Investment Priority: Improve development of high-tech sector Specific objective Expected result Result indicator Possible activities Common output indicator Type of beneficia ries To increase the number of start-ups in hightech Increased number of start-ups in hightech Number of start-ups in target group established Business incubation (including technology and know-how transfer centres) Business support services (mentoring, counselling, vouchers for start-ups, etc) CO01 Number enterprises receiving support of which: CO03 CO04 CO05 Business support organisati ons SMEs etc 18
Calculating targets: tool from experts Indicators Euro per unit % of PA budget CO01: Number of enterprises receiving support 100% 350 CO03: Number SMEs receiving grants 100 000 50% 50 CO04: Number SMEs receiving non-financial support Target 15 000 30% 200 CO05: Number of new enterprises supported 20 000 20% 100 Budget of Priority Axis 10 million Euro 19
ESF: Joint Action Plan (JAP) art. 104-109 CPR JAP a new result-oriented instrument for Cohesion policy Possibility to combine resources from 1 or more operational programmes under the responsibility of a single beneficiary (public law body) Shifts focus from inputs to outputs and results through strong intervention logic and the use of SCOs Payments take the form of unit costs and lump sums and depend on level of achievement JAP SCOs are also applicable to public contracts 20
Summary of programme s intervention logic Strategy If we DO Result then we get Implementation Change Inputs Actions Outputs RESULTS for supported entities Policy results MS, region, sector, target group Delivery mechanisms Mechanisms of change Needs - Context Other factors and do not represent the EC's official position 21
Relevant articles and guidance on result oriented approach Article 4 + 96(2) EU Common Provision Regulation 1303/2013 Annex 1 EU Implementing regulation 288/2014 Template OP Article 19(3) EU regulation 1304/2013 YEI indicators Annex 1 EU Regulation 1301/2013 Common output indicators ERDF Annex 1 EU Regulation 1300/2013 Common output indicators CF Annex 1 EU Regulation 1304/2013 Common output and result indicators ESF Guidance documents: http://ec.europa.eu/regional_policy/sources/docoffic/2014/working/ wd_2014_en.pdf http://ec.europa.eu/regional_policy/information/evaluations/guidan ce_en.cfm#1 22