Evaluation of the Paris Declaration Phase 2

1

• Evaluation of the Paris Declaration Phase 2
• DAC Evaluation Network
• 15 June 2009
• Niels Dabelstein

2
Phase II Architecture

• Again based on the principles of the Paris
• Declaration a joint evaluation comprising
• Country level evaluations assessing
  results/outcomes
• Additional donor/agency HQ studies
• Supplementary studies with focus on results
• Synthesis report to be presented to 4th HLF

3
Phase II Evaluation Model

• Two complementary foci
• Implementation focus (expanded Phase I)
• More diverse set of countries wider range of
  stakeholders
• More attention to capacity building and assess
  donor support to analytic advisory activities
• HQ level studies by donors not included in Phase
  I
• Results focus
• Identify PD influence on development
  effectiveness (outcomes results)

4
Methodological Issues

• Challenges to evaluate the results
• Brief time span since PD endorsed (March 2005)
• External influences make attribution difficult
• Demanding data requirements
• Complementary methodologies required
• To handle these challenges the evaluation should
• Have a balanced sufficient sample of countries
• Have sufficient coverage of sectors and themes
• Produce information of good quality
• Offer possibility of explanation and attribution

5
Methodological Issues

• Therefore methods should include
• Synthesis of existing evaluations, research and
  indicators
• Comparative in-depth case studies chosen to
  contain a good cross-section of common
  themes/sectors
• Longitudinal studies backward looking to track
  PD-like (longer established) policies and
  possibly forward looking (theory-based to map
  plausible directions of travel)
• Targeted comparative studies to supplement
  country-based evaluations

6
Overseeing the evaluation

• International Reference Group, co-chaired by Sri
  Lanka
• and the Netherlands
• Members of the DAC Network on Development
  Evaluation (who actively support)
• Partner countries who conduct country-level
  evaluations
• Multilaterals and CSOs
• Tasks
• Endorse overall Evaluation Framework and ToRs for
  component supplementary studies
• Review draft reports for quality, credibility
  clarity

7
Participants in Int. Ref. Group

• Afghanistan
• Bangladesh
• Benin
• Bolivia
• Cambodia
• Cameroun
• Columbia
• DRC
• Indonesia
• Ghana
• Kyrgyz Republic
• Malawi
• Mali
• Mozambique
• Papua New Guinea
• Samoa
• Senegal
• South Africa
• Sri Lanka

• Australia
• Austria
• Belgium
• Canada
• Denmark
• Finland
• France
• Germany
• Global Fund/GAVI
• Ireland
• Japan
• The Netherlands
• New Zealand
• Norway
• Spain
• Sweden
• Switzerland
• United Kingdom
• USA

8
Managing the evaluation

• Management Group responsible for
• Developing the overall evaluation framework
  and ToR Core Evaluation Team
• Coordinating and managing the evaluation
  process
• Guiding the component studies
• Developing and managing supplementary studies
  and synthesis of findings and recommendations.
• Evaluation Secretariat at Danish Institute for
  International Studies

9
Managing the evaluation

• National Reference Groups
• Established in-country and with key government,
  development partners and NGO stakeholders
• Approve detailed design of country study
• Serve as resource for country evaluation teams
• Review draft evaluation products for quality,
  credibility and clarity

10
BUDGET
11
Contributions
12
Schedule of Events 2009

• 11 13 Feb. 1st Meeting of the Reference Group
  for PD Evaluation Phase 2 Kick-off
  workshop - 1st draft Approach paper.
• 15 May Approach Paper and TOR for Core Team
  approved.
• 3 June Tender process initiated w. three
  bidders. (one has withdrawn)
• 5 August Team Selection
• 7 September Core Team operational
• 1 October Draft Report on Untying of Aid to IRG
  for comments (by 11
• October)
• 26 28 Oct. Asia Pacific Regional Workshop in
  Cambodia
• 1 November Final Report on Untying of Aid
• 3 5 Nov. Latin America Regional Workshop in
  Colombia
• 10 12 Nov. Anglophone Africa Regional Workshop
  in Malawi
• 18 20 Nov. Francophone Africa Regional Workshop
  in Benin
• 20 November Untying of Aid Report discussed in
  DAC
• 30 November 2nd Meeting of the Reference Group
  for PD Evaluation Phase 2.
• 1 December Country Level TOR Work plan for 2010
• 2 3 Dec. WP-EFF, presentation of progress
  report and Untying of Aid Study