Much of the discussion regarding the monitoring and evaluation (M&E) of adaptation has thus far focused on the development of frameworks and indicator systems at the project and programme level. Relatively little research has been done at higher, or more aggregated, scales – portfolio, national, regional, and international – where institutional contexts, processes, and content combine to create more complex systems for analysis. This meta-analysis of strategies and progress in the M&E of adaption, produced by the Federal Ministry for Economic Cooperation and Development (BMZ), provides an introduction to the different approaches and experiences in designing and implementing M&E systems for adaptation at these aggregated levels. Information for this analysis was sourced through a combination of document analysis and stakeholder interviews with key actors.
The study comprises an in-depth comparative study of ten aggregated M&E systems, featuring countries (France, Germany, Kenya, Morocco, Nepal, Norway, Philippines, and the UK), the trans-national Mekong River Commission (MRC), and the fund-level Pilot Program for Climate Resilience (PPCR), which operates projects in 18 countries. Each aggregate M&E system is evaluated using a framework that focuses on the context, processes, and content involved. Analysis of context examines the policy framework environment, the purpose of the M&E system, the scale of application, and the breakdown of aggregation involved. Processes looks at the institutions involved, establishment process (legal, etc), implementation process, and resources. Finally, content focuses on approach and emphasis, data and information, and outputs and reporting. Each section provides a clear, concise comparative table, and extensive analysis.
There follows a segment which reflects on the lessons learned regarding key challenges, for instance ambiguity about the definition of successful adaptation, resource and capacity constraints, and challenges associated with data and information collection. Enabling factors are then summarised, such as political will and leadership, multi-stakeholder participation, and the importance of integrating evolving structures to save resources in the long-term. Recommendations for setting up aggregate-level M&E systems conclude the document, including: the need to adequately prepare by building understanding; aligning the M&E of adaptation with decision-making processes; being aware of potential trade-offs; limiting and contextualising indicators; investing in participation; remembering that quality of data is key; and exploring synergies between mitigation and adaptation.