![Page 1: Climate policy databases and their suitability for policy ... · instruments or policy portfolio of a country. Conclusions and recommendations 2/2 • Underreporting of quantitative](https://reader033.vdocuments.site/reader033/viewer/2022042811/5fa24eadfefc1c3c5c3071eb/html5/thumbnails/1.jpg)
Tom Dauwe _ EEEN FORUM _ 15-16 September 2016
Climate policy databases and their suitability for policy
evaluations
![Page 2: Climate policy databases and their suitability for policy ... · instruments or policy portfolio of a country. Conclusions and recommendations 2/2 • Underreporting of quantitative](https://reader033.vdocuments.site/reader033/viewer/2022042811/5fa24eadfefc1c3c5c3071eb/html5/thumbnails/2.jpg)
• There are several policy databases and information sources that aggregate information on climate change mitigation actions.
• These show overlaps, but important information gaps remain.
• The EEA PaMs database is one of the most comprehensive on national actions.
• But while information on the nature of the PaMs is readily available, quantitative information to support policy evaluation is largely missing.
Key message:
![Page 3: Climate policy databases and their suitability for policy ... · instruments or policy portfolio of a country. Conclusions and recommendations 2/2 • Underreporting of quantitative](https://reader033.vdocuments.site/reader033/viewer/2022042811/5fa24eadfefc1c3c5c3071eb/html5/thumbnails/3.jpg)
Introduction
• The European Topic Centre on Air pollution and Climate change Mitigation
• Consortium of 14 organisations across Europe
• Assist the European Environment Agency in:
– support to EU policy on air pollution, noise and climate change mitigation;
– report progress of EU policy;
– thematic and cross-cutting assessments;
– support harmonising European monitoring networks and reporting obligations.
![Page 4: Climate policy databases and their suitability for policy ... · instruments or policy portfolio of a country. Conclusions and recommendations 2/2 • Underreporting of quantitative](https://reader033.vdocuments.site/reader033/viewer/2022042811/5fa24eadfefc1c3c5c3071eb/html5/thumbnails/4.jpg)
Introduction
• Presentation today combines results from:
– reporting on PaMs by countries for the Monitoring Mechanism Regulation(MMR);
– benchmark study of different PaMs databases;
– assessment of databases as tool in policy evaluation.
![Page 5: Climate policy databases and their suitability for policy ... · instruments or policy portfolio of a country. Conclusions and recommendations 2/2 • Underreporting of quantitative](https://reader033.vdocuments.site/reader033/viewer/2022042811/5fa24eadfefc1c3c5c3071eb/html5/thumbnails/5.jpg)
Setting the scene
• Climate/energy agenda in the EU is important with short and long term objectives to reduce GHG emissions and to ensure the transition to a low carbon society
1. Analysing the system
2. Envisioning
3. Developing Roadmaps
4. Experimenting 5. Assessing 6. Anchoring
• Long term perspective requires not only a vision of the future, but also analysing thesystem, experimenting and assessing.
• Policies are and will be of key importance, but what is implemented?
• … and does it work?
![Page 6: Climate policy databases and their suitability for policy ... · instruments or policy portfolio of a country. Conclusions and recommendations 2/2 • Underreporting of quantitative](https://reader033.vdocuments.site/reader033/viewer/2022042811/5fa24eadfefc1c3c5c3071eb/html5/thumbnails/6.jpg)
Actions taken by MS
• PaMs databases could be important instruments to show the actions taken bycountries.
• EU Member States have several reporting obligations on their mitigation PaMs:– EU: climate, renewable energy and energy efficiency policies
– UNFCCC: National Report / Biennial Report, Paris Agreement
– Input into IEA, OECD, … policy databases
• For the MMR, Member States have to report biennially on their climate mitigation PaMs
• Aggregated by the EEA in a PaMs database and viewer
![Page 7: Climate policy databases and their suitability for policy ... · instruments or policy portfolio of a country. Conclusions and recommendations 2/2 • Underreporting of quantitative](https://reader033.vdocuments.site/reader033/viewer/2022042811/5fa24eadfefc1c3c5c3071eb/html5/thumbnails/7.jpg)
Policies per sector
http://www.eea.europa.eu/publ ications/overview-of-reported-national -pol icies
![Page 8: Climate policy databases and their suitability for policy ... · instruments or policy portfolio of a country. Conclusions and recommendations 2/2 • Underreporting of quantitative](https://reader033.vdocuments.site/reader033/viewer/2022042811/5fa24eadfefc1c3c5c3071eb/html5/thumbnails/8.jpg)
Policy instrument types
http://www.eea.europa.eu/publ ications/overview-of-reported-national -pol icies
![Page 9: Climate policy databases and their suitability for policy ... · instruments or policy portfolio of a country. Conclusions and recommendations 2/2 • Underreporting of quantitative](https://reader033.vdocuments.site/reader033/viewer/2022042811/5fa24eadfefc1c3c5c3071eb/html5/thumbnails/9.jpg)
Implementation start year
http://www.eea.europa.eu/publ ications/overview-of-reported-national -pol icies
![Page 10: Climate policy databases and their suitability for policy ... · instruments or policy portfolio of a country. Conclusions and recommendations 2/2 • Underreporting of quantitative](https://reader033.vdocuments.site/reader033/viewer/2022042811/5fa24eadfefc1c3c5c3071eb/html5/thumbnails/10.jpg)
What is the effect of these actions?
• Databases, such as EEA PaMs database, provide detailed information about(national) climate mitigation PaMs.
• Useful to monitor climate action across the EU
• But: – Are they still relevant?
– What is the effect on GHG emissions?
– How efficient are PaMs?
– Are the PaMs coherent with EU and other national policies?
• Can these questions be answered by policy databases?
![Page 11: Climate policy databases and their suitability for policy ... · instruments or policy portfolio of a country. Conclusions and recommendations 2/2 • Underreporting of quantitative](https://reader033.vdocuments.site/reader033/viewer/2022042811/5fa24eadfefc1c3c5c3071eb/html5/thumbnails/11.jpg)
Evaluation of policies
• The MMR: ex-post and ex-ante impact on GHG emissions, indicators and costsand benefits of PaMs shall be reported, if available.
http://www.eea.europa.eu/publ ications/overview-of-reported-national -pol icies
![Page 12: Climate policy databases and their suitability for policy ... · instruments or policy portfolio of a country. Conclusions and recommendations 2/2 • Underreporting of quantitative](https://reader033.vdocuments.site/reader033/viewer/2022042811/5fa24eadfefc1c3c5c3071eb/html5/thumbnails/12.jpg)
Reporting is incomplete
• But reporting on quantitative information is very incomplete by Member States.
• Because:– information is not available (on time);
– sensitive information, especially on costs;
– methodological guidance is missing;
– …
• So how does EEA PaMs database compare to other databases?
• Is information readily available in other databases to support policy evaluation?
![Page 13: Climate policy databases and their suitability for policy ... · instruments or policy portfolio of a country. Conclusions and recommendations 2/2 • Underreporting of quantitative](https://reader033.vdocuments.site/reader033/viewer/2022042811/5fa24eadfefc1c3c5c3071eb/html5/thumbnails/13.jpg)
Benchmark study
• ETC/ACM performed a benchmark study for EEA on 14 policy databases and information sources
• Focus on information sources that covered EU countries
• Criteria:
o Coverage/scopeo Completenesso Reliabilityo Timelinesso Accessibility
o Evaluate:• Effectiveness• Efficiency• Relevance• Coherence
PaM information sources:
• EEA PaM database
• NEEAP
• NREAP
• CoM
• IEA
• OECD
• Odyssee/MURE
• NEC
• EURLex
• FAOLex
• Eur’ObservER
• RES-legal
• MMR LCDS
• NC and BR
![Page 14: Climate policy databases and their suitability for policy ... · instruments or policy portfolio of a country. Conclusions and recommendations 2/2 • Underreporting of quantitative](https://reader033.vdocuments.site/reader033/viewer/2022042811/5fa24eadfefc1c3c5c3071eb/html5/thumbnails/14.jpg)
Benchmark study - results
• ETC/ACM performed a benchmark study for EEA on 14 policy databases and information sources
• Focus on information sources that covered EU countries
• Criteria:
o Coverage/scopeo Completenesso Reliabilityo Timelinesso Accessibility
o Evaluate:• Effectiveness• Efficiency• Relevance• Coherence
![Page 15: Climate policy databases and their suitability for policy ... · instruments or policy portfolio of a country. Conclusions and recommendations 2/2 • Underreporting of quantitative](https://reader033.vdocuments.site/reader033/viewer/2022042811/5fa24eadfefc1c3c5c3071eb/html5/thumbnails/15.jpg)
Policy evaluations
• But how far can you go based on information from policy databases in policy evaluation?
• Evaluation of 11 national PaMs in theEEA PaMs database.
• Based on information from MMR reporting, otherdatabases/information sources and wider literaturesearch, and interview with one country expert.
• Effectiveness – Efficiency – Relevance – Coherence
![Page 16: Climate policy databases and their suitability for policy ... · instruments or policy portfolio of a country. Conclusions and recommendations 2/2 • Underreporting of quantitative](https://reader033.vdocuments.site/reader033/viewer/2022042811/5fa24eadfefc1c3c5c3071eb/html5/thumbnails/16.jpg)
Intervention logic
• Intervention logic model as framework to link needs, objectives, actions, results and impacts.
![Page 17: Climate policy databases and their suitability for policy ... · instruments or policy portfolio of a country. Conclusions and recommendations 2/2 • Underreporting of quantitative](https://reader033.vdocuments.site/reader033/viewer/2022042811/5fa24eadfefc1c3c5c3071eb/html5/thumbnails/17.jpg)
Policy evaluations
Pro
mo
tio
n o
f c
ar-
po
olin
g
Su
pp
ort
to
fu
nd
ho
usin
g
mo
de
rniz
ati
on
usin
g t
he
bu
ild
ing
sa
vin
g
En
erg
y e
ffic
ien
cy
imp
rove
me
nt
in p
ub
lic
bu
ild
ing
s
Ta
x o
n H
FC
s, P
FC
s a
nd
SF
6 -
eq
uiv
ale
nt
to t
he
CO
2ta
x
Carb
on
tax
La
nd
fill
ae
ria
tio
n
Hea
t F
un
d
Co
ve
na
nt
Cle
an
& E
ffic
ien
t
Ag
ro-s
ec
tors
En
erg
y E
ffic
ien
cy
Ag
ree
me
nts
20
08
-2016
Cu
rso
sd
e c
on
du
cc
ión
efi
cie
nte
en
el
tran
sp
ort
e
po
rc
arr
ete
ra
En
erg
y c
om
pa
ny
ob
lig
ati
on
& D
om
es
tic
Gre
en
Dea
l
BE CZ EE DK IE DE FR NL FI ES UK
Effectiveness
Coherence
Effectiveness
Relevance
Effectiveness,
Efficiency
Effectiveness,
Efficiency
Relevance
Relevance Efficiency Effectiveness,
Efficiency
Relevance Coherence Effectiveness
Coherence
Effectiveness
EEA PaM database X X X X X X X X X X X
OECD X 0 0 X 0 0 0 0 0 0 0
IEA policy databases 0 0 0 0 X 0 X 0 X X X
EurObserv’ER 0 0 0 0 0 0 X 0 0 0 0
NREAP 0 0 0 0 0 0 X X X 0 0
NEEAP X X X 0 X 0 X X X X X
RES legal 0 0 0 0 0 0 X 0 0 0 0
Odyssee/MURE 0 X X 0 0 0 X X X X X
NC6 and BR2 X X X X X X X X X X X
LCDS 0 0 0 0 0 0 0 X X 0 0
![Page 18: Climate policy databases and their suitability for policy ... · instruments or policy portfolio of a country. Conclusions and recommendations 2/2 • Underreporting of quantitative](https://reader033.vdocuments.site/reader033/viewer/2022042811/5fa24eadfefc1c3c5c3071eb/html5/thumbnails/18.jpg)
Conclusions and recommendations 1/2
• The objective of the MMR reporting on PaMs is not to provide exhaustiveinformation for evaluation, yet relevant information is available in thedatabase and additional technical reports.
• The EEA PaMs database is a useful resource for evaluation of single policy instruments or policy portfolio of a country.
![Page 19: Climate policy databases and their suitability for policy ... · instruments or policy portfolio of a country. Conclusions and recommendations 2/2 • Underreporting of quantitative](https://reader033.vdocuments.site/reader033/viewer/2022042811/5fa24eadfefc1c3c5c3071eb/html5/thumbnails/19.jpg)
Conclusions and recommendations 2/2
• Underreporting of quantitative data however means that this potential is notfully met.
• For some PaMs there is information available relevant to policy evaluation, but this information is not captured in the EEA PaM database.
• Further harmonisation of reporting, e.g. in the context of the Energy Union, could improve data availability and quality on climate mitigation PaMs.
![Page 20: Climate policy databases and their suitability for policy ... · instruments or policy portfolio of a country. Conclusions and recommendations 2/2 • Underreporting of quantitative](https://reader033.vdocuments.site/reader033/viewer/2022042811/5fa24eadfefc1c3c5c3071eb/html5/thumbnails/20.jpg)
Thank you for your attent ion!
Tom Dauwe (VITO)
tom.dauwe@vi to .be
E l i sabeth Kampe l (UBA-V) F ranço i s De jean (EEA) Johannes Sch i l l i ng (EEA)Jus t i n Goodwin (Ae ther )Kat r i na Young (Aether ) Kr i s t i en Aernouts (VITO)Magda lena Jozw i cka (EEA)M i chae la T i t z (UBA-V)
![Page 21: Climate policy databases and their suitability for policy ... · instruments or policy portfolio of a country. Conclusions and recommendations 2/2 • Underreporting of quantitative](https://reader033.vdocuments.site/reader033/viewer/2022042811/5fa24eadfefc1c3c5c3071eb/html5/thumbnails/21.jpg)
Assess the effect
F-gas tax in Denmark:
-
EE improvement in public buildings in Estonia:
![Page 22: Climate policy databases and their suitability for policy ... · instruments or policy portfolio of a country. Conclusions and recommendations 2/2 • Underreporting of quantitative](https://reader033.vdocuments.site/reader033/viewer/2022042811/5fa24eadfefc1c3c5c3071eb/html5/thumbnails/22.jpg)
Benchmark study
• ETC/ACM performed a benchmark study for EEA on 14 policy databases and information sources
• Focus on information sources that covered EU countries
• Criteria:
o Coverage/scopeo Completenesso Reliabilityo Timelinesso Accessibility
o Evaluate:• Effectiveness• Efficiency• Relevance• Coherence