1

Monitoring and evaluation after 2013 – some first ideas,

mainly for ERDF / CF

Evaluation network DG REGIO 14th October 2010

2

Guiding ideas• Shift to performance orientation –

development of evaluation culture plus some well targeted obligations– More focus in programm design– More precise rules for monitoring, – Few rules but strive for best methods in

evaluation• More exchange of knowledge across MS,

facilitated by Commission

• No discussion of conditionalities today

3

Monitoring• Monitoring for each individual intervention

done by• Custom indicators – as to date

plus• Obligatory core indicators (recommended

to date)– No. of projects across the board– Outputs– Definitions– Linked to categories of expenditure– Condition for payments

4

Monitoring II

• Commission could recommend some result indicators („what is going to be changed?“)– Idea: collapse „results“ and „impacts“ into

„outcomes“ (or „results“?)??

• Commission to suggest a link between Europe 2020 and selected outcome indicators (in some cases output and input indicators – e.g. 3% for RTD)

5

Sidestep on terminology• REGIO considers the idea of changing the

terminology for monitoring data (observables):

Inputs – outputs – results (results including intermediate + final results)

orInputs – outputs – outcomes (outcomes including results and impacts)

6

Evaluation

• Ex ante evaluation MS• On going evaluation MS, Commission• Ex post evaluation Commission, MS

• Obligatory evaluation plan?• Summary evaluation by MS towards the

end of the period (preparing ex post by Commission)? Mid-term evaluation??

7

Tasks for Evaluation I• To support the programming

– To support the strategy development and optimal split of funding by intervention,

– To check the intervention logic, – To support target setting for outputs, – To refine definition of outcome indicators – no targets– To check final target groups– To improve the delivery system

– To check methods + data requirements for future evaluations

– To spot opportunities for impact evaluations

When: ex ante evaluations for all programmes

8

Tasks for Evaluation II

• To support the programme implementation and to refine strategies - according to needs– To revisit selected issues looked at by ex ante

evaluation,– To deal with new situations and new questions – By themes, priorities, across programmes…

When: On going evaluations as stated in evaluation plans

9

Tasks for Evaluation III• To capture the Effects / impact of

interventions– Counterfactual methods– Integration of counterfactual and qualitative

methods

• It is new and demanding: no application across the board, best brains needed

When: On going and ex post evaluations by MS and Commission

10

Evaluation methods

• Mix of methods: qualitative and quantitative• Reviews, surveys, interviews, case studies, …• Impact evaluation (counterfactual approaches)• Macroeconomic and sectoral models• Project level - cost benefit analysis, …

• Guidance by Commission (for REGIO: EVALSED)

11

Exchange of knowledge• Initiatives organised between MS

DG REGIO• Network with MS: informal exchange COM-MS-MS

on political and practical issues• EVALSED: guidance on methods• Library of evaluations done in MS

– As part of EVALSED– Building up a quality review

• Training, e.g. summer school 2011• Biannual conferences