Download - Europa.eu

Greening
Development
Meeting the implementation
challenge – indicators – module 9
1
Mainstreaming backbone
Policy
Budget
Action
Monitoring
2
Monitoring
Not all that can be counted...
counts
Not call that counts…
can be counted
Albert Einstein
3
Good intentions on M&E
4
Objectives and related indicators/
milestones – not sure I would start with this slide. I liked the slide on page 5 of
O
u
t
c
o
m
e
s
P
r
o
c
e
s
s
Hierarchy of
objectives
Progress
measurement
Overall objective(s)
Impact indicators
Specific objective(s)
Outcome indicators
Intermediate results
Output indicators
Milestones
Inputs
Input indicators
Milestones
Adapted from: EC (2004), OECD (2002)
budgeting and would be good to refer back to this and thten address how one monitors each of
these…. (what is message from this slide anyway..)
5
What should be monitored, and why?
– the case for monitoring as it were…. Perhaps have this slide on page 5, then the slide 5 from
budgeting…
Aspect to monitor
Rationale for monitoring
State of the environment – natural
resources and environmental
pollution
•Make well informed decisions
Climate variability and change,
impacts and vulnerabilities
•Make well informed decisions
•Support adaptive management
Policy and institutional change
•Promote the institutionalisation of
climate change mainstreaming
•Enhance the transparency and
accountability of the mainstreaming
process
Policy/Strategy implementation
and outcomes
•Strengthen commitment to the
objectives set in policies and strategies
•Stimulate the achievement of tangible
outcomes
6
Environment and Climate change in
the national monitoring system
– good
messages here – again perhaps just 1 or 2 slides earlier..GE….
• Environment and climate monitoring should be integrated into
wider national and specific development monitoring systems
Strengthen and adapt existing monitoring systems (incl.
statistical systems) to integrate climate change and
environment
• Build on existing institutions and sources of
information...
• ... but adapt where necessary statistical systems and
data sources
7
Levels at which to measure environment
and climate-related performance
• Indicators and milestones related to climate change and the
associated response can be included in the PAFs (*) of climate
change strategies and actions plans, but also in:
• national and sectoral development strategies and
programmes
• sub-national (e.g. regional, local) development plans
• individual projects (logical framework)
Ultimate objective
of integration!
(*) Performance assessment frameworks
8
Monitoring climate change
Meteorology,
climate variability
• Data collection,
management and
dissemination
• Strengthening of
meteorological
information & systems
Climate change
Integration
New patterns
• Emerging trends
• Projections, scenarios
• Tools for assessing
impacts, vulnerabilities
& risks
•
Is the integration process
based on reliable
information?
9
Monitoring environment
State of the
environment
• Data collection,
management and
dissemination
• Strengthening of
environmental information
& systems
Environmental
performance
Integration
• Institutional performance
& collaboration
• Effectiveness of
intervention strategies
Is the integration process
based on reliable
information?
10
Monitoring policy and institutional
change
Policy change
• Integration of
adaptation/mitigation
considerations in
national & sector
policies/strategies
• Development of
adaptation- &
mitigation-oriented
policies & plans (e.g.
DRR, REDD
strategy)
Institutional change
Integration
Is integration getting
institutionalised at all
levels?
• Political leadership
• Inst’l commitment
• Coordination &
participatory
mechanisms
•Procedures
• Systems
•Tools
•Capacity building
programmes
11
Monitoring policy implementation
and outcomes
Implementation
(inputs, outputs)
Outcomes, impacts
Integration
• Increased allocation of
resources
• (Inclusion of)
adaptation/mitigation
(measures in)
programmes/projects
• Implementation &
enforcement of
adaptation/mitigation
measures &
regulations
Does the integration
• Increased resilience of
vulnerable groups
(women, children,
farmers, coastal
communities, ...)
• Increased resilience of
key sectors
• Green growth,
green jobs
• Climate-resilient, lowemission development
process produce results
and impacts?
12
Role of PAFs in relation to General
and Sector budget support
• Progress measured against the PAF’s criteria and targets provides
opportunities for policy dialogue in the context of budget support
• Increasingly, the PAF associated with development and
poverty reduction strategies is likely to include indicators
and targets associated with climate change adaptation,
disaster risk reduction, energy efficiency, green economy
etc.
• In the case of EC budget support, performance against a chosen
sub-set of criteria and targets also determines the final amount of
disbursements
13
Illustration: Seychelles Climate
Change Support Programme (1)
• Overall objective:
• ‘Enhance the sustainability of Seychelles development
and economic reforms through mitigation policies and building
resilience for adaptation to climate change impacts’
• Expected results:
• effective mainstreaming of climate change in national development
policies and in key sector strategies and action plans
• a solid institutional and legal framework in the energy sector
integrating the Clean Development Mechanism
• EU support provided under GCCA framework in addition to existing
GBS
14
Illustration: Seychelles Climate
Change Support Programme (2)
The EUmonitoring
disburses its
second
tranche
under the three-yearPerformance
and
criteria
for disbursement:
long Climate Change Support Programme (SCCSP).
Tranche The
Criteria
approval was made against the backdrop of
significant
undertaken
by the government
in 2011
in
2010
•Approval steps
by Cabinet
of the National
Climate Change
Strategy.
the•Approval
implementation
of the
National
by Cabinet
of the
EnergyClimate
Policy. Change Strategy
2011
2012
including mainstreaming of the Climate Change Strategy
•Climate
change mainstreamed
in of
at key
leastsector
3 keystrategies
sectors of EMPS.
through
development
and adoption
•Approval
by Cabinet
of Energy of
Billthe
allowing
for CDM
projects.
and
action plans
and formulation
Seychelles
Energy
Bill
which
is scheduled
to be enacted this
•Climate
change mainstreamed
into year.
all sectors of EMPS.
•Amendments to the Town and Country Planning Act and Environment
Alessandro Mariani, head of delegation and ambassador,
Protectionhis
Actsatisfaction
coherent withwith
the SNCCS,
approved
by Cabinet.
expressed
Seychelles’
capacity
to
•Enactment
of
the
Energy
act.
mainstream sustainable development in the economic reform
agenda.
EMPS = Seychelles Environment
Management Plan
The Seychelles
Nation newspaper 20.0702012
SNCCS = Seychelles National Climate Change Strategy
15
The big picture - accountability
Ministry of
Finance
Line / Sector
Ministries
Cabinet
Front Line
Service Providers
Donor
Parliament
Client/Citizen
16
Responding to problems in performance
•
•
•
•
How do we measure performance?
– indicators, qualitative review, overall dialogue, behavioural
aspects, direction of change....
Depends on the support modality
Differs from donor to donor - Joint donor response?
Under Budget Support modality:
– Selecting indicators (‘triggers’)
– Setting target values
– Assess cause and effect
Dialogue not punishment – policing comes from within
17
Monitoring for accountability
Monitoring for Accountability
In support
of:
Domestic
accountability
Mutual accountability
Data
answers:
Has government
honoured its promises
to the constituency?
Has government
delivered goods and
services as pr policy?
Are donor aid disbursements
reliable and on time? Does
government meet agreed
(sector) performance
targets?
Data
Public debate, press,
informs the: media, parliament
Government-donor
negotiations
Government Less intensive; Focus
-DP
on stakeholder
interaction: consultation
Focused on aid disbursement
based on conditionality
(‘triggers’)
18
Hints and tips for selecting indicators
•
SMART indicators (!) (we need examples and references)
•
Avoid indicators that are: Susceptible to external factors;
Difficult, time-consuming and costly to measure
•
Link indicators also to intermediate steps’ in achieving policy
objectives
•
Explore ‘second best’ options
•
Avoid high correlation between sets of indicators
•
Avoid tracking indicators whose margin of error is higher then
expected changes
•
Take data quality seriously in choosing indicators
•
Be aware that improvements in measurement may affect
indicator value
•
Not too many!!
19
The missing middle
(not sure i understand this slide)
•
Linking inputs to outcomes
– CC/ENR difficult to measure (Green Economy)
– Externalities are great
– Need to understand cause and effect before judging
•
Public goods delivery
– Key function of government
– Socially desireable and equitable outcomes
•
Progress in the enabling environment
– Framework conditions for the market to work
– Regulation and intervention when required
20
Ten step process for results based M&E
– probably need to comment about theory vs practice
Plan
Implement
Source: http://www.oecd.org/dataoecd/23/27/35281194.pdf
21
Key Messages (?) on M&E systems
• Keep it simple: Only when working for 3 years it can be made more
sophisticated [also important for management to understand that this takes time]
• Improve rather than replace existing systems and data sources
• Consider to select indicators where there is quality data
• Ensure cost effectiveness: M&E needs to be in proportion
• Strengthen accountability: Allocate responsibilities
• Ensure that systems are nationally coherent with minimum standards
locally
• Systems should be independent to enhance credibility
• Focus on the end use
22
Inclusive monitoring
• Securing inclusive performance monitoring
– Role of civil society
– Influence of power relations on monitoring
– Incentives to measure and feedback
– Strengthening accountability from below
• Supporting joint monitoring
– Reduces transaction costs
– Allows inter-sectoral coordination
23
Hints and tips on accountability
•
Mainstreaming accountability from below is not only about
stakeholder consultation and participatory evaluation
•
When it concerns satisfaction with service provision, people
‘vote’ most effectively with their wallets
•
Programmes should take account of innovative solutions
that allow users/clients to hold service providers to account
24
Assessment questions
•
•
•
•
•
•
Is there clarity over the objectives for sector performance
monitoring?
Have the links between sector inputs and outputs, outcomes and
impacts been mapped?
What is the involvement of non-state actors in performance
monitoring of the sector?
What can be learned from existing monitoring and evaluation
systems?
What feedback loops exist between performance monitoring and
sector performance?
Is the performance monitoring framework producing information
sector actors are calling for?
25
Rio markers
(more of/for donor perspective)
Since 1998 OCED/DAC has monitored committments to supporting
the 3 Rio conventions : Biodiversity; Desertification; Climate
All aid activity is marked as either (i) targeting the Conventions as a
'principal objective' or a 'significant objective', or (ii) not targeting
the objective. A key concern is that the measurement should not
inadvertantly work against integration/ mainstreaming by
encouraging standalone activities. (please say in comments that
all projects/programmes should mark these in CRIS!)
Principal = UNFCCC objectives are stated and the activities would
not otherwise have been undertaken. Significant = have other
prime objectives, but they have been formulated or adjusted to help
meet climate concerns.
more
Handbook on climate markers: http://www.oecd.org/dataoecd/56/18/48785310.pdf
26
Activity 1 – Implementation phase
Mainstreaming environment and climate change in the implementation
phase
In small groups around a particular country/ sector:
Task 1 - What have been implementation phase challenges in
practice?
Task 2 –What have been the advances gained (expected or
unexpected)?
Task 3 –What action can still be taken to further integrate
environment and climate change into the
implementation phase?
27
Module 9 - recap
•
Setting indicators and monitoring is one of the main tools
for mainstreaming environment and climate change in the
implementation phase
•
Monitoring reveals the difference between words (plans)
and actions
•
•
•
•
What to monitor
Use of systematic Performance Assessment Frameworks
Monitoring as an accountability instrument – the big picture
Rio markers
28
Action plan – from words to actions
Action plan – turning words to actions
Reflection
Are there indicators in your sector that are relevant
for environment and climate change?
If not, should there be?
Action
 Give 3 actions that could be taken on the M&E
side to improve implementation (by improving
integration of environment and climate change)
29
29
Resources
– hmmm looks like needs a bit of work
NAPAs
UNFCC – information on national communications on climate change
http://unfccc.int/national_reports/napa/items/2719.php
NAPA Database – here you can see the NAPAs submitted by different countries
http://unfccc.int/cooperation_support/least_developed_countries_portal/napa_priorities_database/i
tems/4583.php
PEERs
An example of a PEER – Rwanda August 2010
http://www.unpei.org/PDF/Rwanda_PEER_finalreport.pdf
Profiles, tools and tactics for mainstreaming – PEERS
http://www.environmental-mainstreaming.org/documents/EM%20Profile%20No%2012%20%20PEER%20(5%20Oct%2009)%20(2).pdf
Tool Kit for policy and implementation options –
OECD/AFDB/WB - http://www.oecd.org/dataoecd/44/52/50645114.pdf
Environmental Fiscal Reform
OECD manual 2005 – gives sector outlines for forestry, fisheries, energy, water and pollution control
http://www.oecd.org/dataoecd/14/25/34996292.pdf
30
Optional slides on Rio Markers
31
Trends in aid to climate change
Source: OECD Nov 2011
32
Definitions of Rio markers adaptation
An activity should be
classified as adaptation
related
(score Principal or
Significant) if:
CRITERIA
FOR ELIGIBILITY
An activity is eligible for
the climate change
adaptation
marker if:
• It intends to reduce the vulnerability of human or
natural systems to the impacts of climate change and
climate-related risks, by maintaining or increasing
adaptive capacity and resilience.
• e.g. information, capacity development, planning and
the implementation of climate change adaptation
actions.
a) the climate change adaptation objective is explicitly
indicated in the activity documentation;
And
b) the activity contains specific measures targeting the
definition above.
Carrying out a climate change adaptation analysis, either
separately or as an integral part of agencies’ standard
procedures, facilitates this approach.
Source: Oecd CRS directives February 2010
33
Definitions of Rio markers - mitigation
An activity should be
classified as mitigation
related
(score Principal or
Significant) if:
CRITERIA
FOR ELIGIBILITY
An activity is eligible for
the
climate change mitigation
marker if:
It contributes to the objective of stabilisation of
greenhouse gas (GHG) concentrations in the atmosphere
at a level that would prevent dangerous anthropogenic
interference with the climate system by promoting
efforts to reduce or limit GHG emissions or to enhance
GHG sequestration.
The activity contributes to (one or more) :
a) the mitigation of climate change by limiting
anthropogenic emissions of GHGs, including gases
regulated by the Montreal Protocol; or
b) the protection and/or enhancement of GHG sinks and
reservoirs; or
c) the integration of climate change concerns with the
recipient countries’ development objectives through
institution building, capacity development,
strengthening the regulatory and policy framework, or
research; or
d) developing countries’ efforts to meet their obligations
under the Convention.
34
Source: Oecd CRS directives February 2010
Examples of what counts
Examples of activities that qualify for score “principal” under the
climate change adaptation marker
Enabling activities
• Improving weather and climate information systems.
• Supporting climate change adaptation-specific policies, programmes & plans.
Policy and legislation
• Strengthening the capacity of national institutions, including Finance and
Planning Ministries, responsible for coordinating and planning adaptation
activities and the integration of adaptation into planning and budget processes.
• Making Disaster Risk Reduction (DRR) information and tools more accessible
for climate change adaptation negotiators and managers – promoting the role
of DRR in climate change adaptation policies, strategies and programmes.
• Encouraging systematic dialogue, information exchange and joint working
between climate change and disaster reduction bodies, focal points and
experts, in collaboration with policy makers and development practitioners.
35
Examples of what counts (2)
Agriculture
Water and
Sanitation
Fisheries
Health
Forestry
Energy
36
Examples of what counts
Agriculture
• Promoting diversified agricultural production to reduce climate risk
(e.g. growing a mix of different crops and different varieties of
each crop).
• Soil and water management to increase water availability in areas
experiencing increased water stress due to climate change.
Water and sanitation
• Monitoring and management of hydrological and meteorological
data for decision making on impacts of climate change (possible
synergy for early warning systems or agro-meteorological
information systems).
• Strengthening capacity for integrated planning and management of
water resources, in response to climate change, including supply,
demand and water quality issues.
• Promoting water conservation and rainwater harvesting in areas
where enhanced water stress due to climate change is anticipated.
37
Examples of what counts
Fisheries
• Mapping changes in the range of fish species and strengthening
the monitoring of fish stocks to determine the impacts of climate
change.
Forestry
• Restoration of former forest areas utilising natural seed banks and
existing plants, in order to reduce vulnerability to the impacts of
climate change.
• Securing local and indigenous people’s rights and systems for a
sustainable and long-term utilisation of the forest in order to
increase resilience to climate change.
• Promoting sustainable forest management and adopting
harvesting techniques that reduce soil erosion and exposure to
wildfires, and promote the conservation of biodiversity in order to
safeguard forest ecosystems from the impacts of climate change.
38
Examples of what counts
Health
• Developing or enhancing systems for monitoring drinking water,
food and air quality, in areas affected by higher temperatures,
floods and rising sea level.
• Strengthening food safety regulations, notably in terms on
microbiological quality, avoidance of contact with pest species,
conservation duration and conservation temperatures, in areas
affected by higher temperatures.
Energy
• Strengthening of energy transmission and distribution
infrastructure to cope with the impacts of climate change.
• Design and construction of measures to protect critical energy
infrastructure from the impacts of floods and storms.
39