Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
MELIA Kick-off Meeting 3-7 September 2006, Sevilla, Spain MONITORING MELIA: THE ATTEMPT TO DEFINE PROJECT PERFORMANCE INDICATORS Claudio Bogliotti CIHEAM-IAMB General problems when dealing with indicators Indicators are often given without a clear link to an objective or specific target, and well frame into a logic of intervention Certain items are given more in the form of a goal or target, without a clear link to performance / measurement perspectives Indicators are often complex, too technical and difficult to be understood by experts of other sectors or disciplines or stakeholders Missing the meaning of water management indicator in term of real contribution to sustainable development or explicit link to sustainability criteria Indicators in MELIA Four levels of indicators 1. Project indicators to measure objectives Immediate objectives (results), medium- long term objectives (LogFrame) 2. Project performance indicators regarding summary activities of LogFrame. Useful to assess overall project operation 3. Task indicators (Work Package level) 4. Partner operation or inputs (man/months used, money spent for travel, etc……) LogFrame Improvement of effective regional water management to promote sustainable development in the Mediterranean region Technical, socio-economic and political exploitation of the multi-stake dialogue to build-up and share a common knowledge and awareness Long term achievement Short-Medium term achievement End of project Result 1 Result 2 Result 3 Result 4 Performance indicators Result 5 Result 6 Result 7 Result 8 Result 9 Cluster of main activities achieved during the projects Result 10 Result 11 Activity – Tasks relationships Result 1 Result 2 Result 3 Result 4 Result 5 Result 6 Result 7 Example: building common knowledge in multi-stake Workshops Performance indicators Result 8 Result 9 Result 10 Result 11 Example: dissemination activities Cluster of tasks Example: printing and mailing leaflets Example: preparation of conceptual frame and game for working group animation INTERVENTION LOGIC VERIFIABLE INDICATORS SOURCE OF VERIFICATION ASSUMPTIONS MAIN OBJECTIVE Improvement of effective regional water management to promote sustainable development in the Mediterranean region - Water quality and quantity indexes (int. standards) - rate of employment / water productivity - system income / water yields available - Rate biodiversity / good water volumes - Rate of citizens and gender in water related co-decision - Allocation efficiency Annual book of statistics Publications Specialised Magazines (i.e.: The Economist) PROJECT PURPOSE Technical, socio-economic and political exploitation of the multi-stake dialogue to build-up and share a common knowledge and awareness Regional rate of exchange (N. common publications) Publications Political willingness RESULTS R1. Shared knowledge on Water Culture R2. Shared knowledge for an assessment of Technological Perspectives R3. Shared knowledge on Rational Use of Water Resources R4. Shared knowledge on Water Value R5. Common conceptual frame of Water Policy R6. Shared frame of Prevention and Mitigation of Water Conflicts R7. Shared frame of Water Participatory Management Water Governance R8. Accessible common and integrated knowledge on water management in the Mediterranean R9. Effective sharing of knowledge built during the project R10. Recommendation on the application of the WFD and exploratory benchmarking exercise R11. Performance, social and sustainability indicators R1–R7: N. of published monographs;. N. of socially-politically accepted indicators for assessment and design R8-R9: N. of accesses from society and science downloading knowledge. N. of external inputs N. of participants in Forum Degree of citizen, youths, researchers satisfaction regarding knowledgebase and dissemination events R10: N. of commonly acceptedpublished parameters for benchmarking. N. of published recommendations R11: Rate of agreement. N. of published information-reports Project Annual Reports Project Proceedings Project minutes Project WEB Capacity and capability of partners RESULTS R1. Shared knowledge on Water Culture R2. Shared knowledge for an assessment of Technological Perspectives R3. Shared knowledge on Rational Use of Water Resources R4. Shared knowledge on Water Value R5. Common conceptual frame of Water Policy R6. Shared frame of Prevention and Mitigation of Water Conflicts R7. Shared frame of Water Participatory Management Water Governance R8. Accessible common and integrated knowledge on water management in the Mediterranean R9. Effective sharing of knowledge built during the project R10. Recommendation on the application of the WFD and exploratory benchmarking exercise R11. Performance, social and sustainability indicators R1–R7: N. of published monography;. N. of socially-politically accepted indicators for assessment and design R8-R9: N. of accesses from society and science downloading knowledge. N. of external inputs N. of participants in Forum Degree of citizen, youths, researchers satisfaction regarding knowledgebase and dissemination events R10: N. of commonly accepted-published parameters for benchmarking. N. of published recommendations R11: Rate of agreement. N. of published information-report Project Annual Reports Project Proceedings Project minutes Project WEB Capacity and capability of partners SUMMARY OF ACTIVITIES R1,2,3,4,5,6,7,11: Four workshops and construction on common knowledge in working groups. Animation of working groups. R9: One training seminar for knowledge share and transfer R1-R11: One International Conference R10-11: The analysis of output from implemented dialogue with external players and “citizens” and the analysis of natural water scarcity and policy indicators. Group analysis of the WFD. Identification of common variables and parameters for benchmarking, identification of possible way for benchmarking in accordance with societal and policy perspectives. Group Meetings. R8: The construction of an internet-based integrateddynamic knowledgebase R1-R11: Activity of dissemination and dialogue facilitation - N. of accesses to Internet - N. of participants and rate of stake diversity in Workshops and Conference. - N. and diversity of participants in training seminars - N. of “ women” related issues tackled in the project. - N. of women in events. - N. of recommendations produced. - N. and quality of scientific contributions in proceedings and peer magazines - N. of mailed proceedings - N. of mailed brochures and leaflets . N. of external politics and citizens involved in dialogue on indicators, assessing WFD and benchmarking - N. and quality of thematic monographs - N. of relevant indicators agreed by all partners - N. of printed and mailed Videos, Leaflets, CD-ROMs, newsletters. INPUT for Funds: partner m/m efforts Availability of partner institutions Willingness of partners Availability and willingness of external stakeholder to be involved OVERVIEW.doc Preconditions: available funds Work Packages 1 to 6 Tasks • • • • • • • • Information retrieval and preparation of two videos (water culture and women in water) Research review Identify priority issues-agenda for thematic debate Preparation of Workshop n.1 Workshop n.1 Prepare Workshop proceedings and dedicated CD-rom, and other dissemination materials Compile definitive conceptual (rationale) frame Dedicated leaflet Performance indicator • • • 5. 6. 7. 8. N. of retrieved information /partner (500/year), N. videos 1 report (WP Leader) 1 scheme or booklet for debate animation (WP Leader) and number of WP partners involved in preparation N. of new participants brought by partner Number of proceedings (250) CD roms (100) and dissemination leaflets (250) / WP Leader Number of WP partners effectively involved in draft preparation Number of prints (250) Work Package 7 – Water Participatory Management and Water Governance 1. 2. 3. 4. 5. Research review on integrated participatory management in water (IPMW) in the Mediterranean Compile conceptual frame of IPMW and use of IPWM in water management Research review on water Governance in the Mediterranean Compile conceptual frame of water Governance and use of water Governance in water management Prepare dedicated leaflets and CD-Rom on water Governance and IPWM and other dissemination materials 1. One regional report / WP Leader and N. of WP partners involved (all partners) 2. One Vision Document prepared by WP Leader and N. of WP partners effectively involved 3. One regional report / WP Leader and N. of WP partners involved (all partners) 4. One Vision Document prepared by WP Leader and N. of WP partners effectively involved 5. N. of CD-rom (150), leaflets (250 +250) Work Package 8 – Building knowledge 1. 2. 3. 4. 5. Short-term Seminar link to Kick-Off Meeting, on Knowledgebase and Project Information System Management Review on knowledge extraction and knowledge indicators Compile methodology for knowledge extraction Organise and harmonise extraction of knowledge for WPs’1-6 Compile integrated knowledgebase (WPs’ 1÷7) 1 N. of presentations by coordinator and experts 2 Number of knowledge assessment and design indicators (WP Leader) and N. WP partners involved. Number of external stakes involved. 3 Availability of methodology according to time frame 4 N. of information adapted for extractions by WP Leader (250 inputs / partners a year) 5 N. of knowledgebase titles and items (WP Leader) Work Package 9 – Knowledge share 1. Create methodologicalconceptual frame of knowledge transfer within project 2. Organisation and implementation of Seminar on Capacity Building on Integrated Water Management 1. One frame prepared by WP Leader. N. of WP partners involved (all partners). 2. One handbook on CB and one handbook in IWM / WP Leader. N. of WP partners involved in handbook preparation. N. of hours training / WP partner Work Package N. 10 - Performance, social and sustainability indicators 1. Start dialogue with citizens and retrieve responses (using FORUM in WP1) 2. Analysis of citizens' responses and prepare results to feed Forum 3. Re-framing and reconceptualisation of water scarcity and policy indicators 1. Number of citizens involved in the process and inputs (1500 / 4 years) 2. One report by WP Leader. N. of WP partners involved (all) 3. One report by WP Leader. N. of WP partners involved (all) Work Package N. 11 - Exploratory benchmarking and recommendation on WFD 1. 2. 3. 4. 5. 6. 7. 8. Information retrieval and review for knowledgebase Review monitoring experience in Mediterranean countries and issues related to the implementation of the WFD Preparation of Workshop n.4 Workshop n.4 Prepare post-consensus (after WSH4) list of indicators for benchmarking Prepare Workshop proceedings and dedicated CD-Rom and other dissemination materials Compile recommendation for benchmarking in the Mediterranean and areas identification Prepare draft of guidelinesrecommendation to seek consensus in the Int. Conference (WP1), on the application of the WFD in the Med. 1. N. of retrieved information /partner (500/year), 2. 1 report (WP Leader) 4. N. of new participants brought by partner • N. of indicators agreed and one report by WP Leader. N. of MELIA partners involved (all) • Number of proceedings (250) CD roms (100) and dissemination leaflets (250) / WP Leader • Number of WP partners effectively involved in draft of recommendations • Number of prints distributed in International Conference (250) IndicatorsWorkshopMalta