Dissertation Defenses

Doctoral Dissertation Announcement

---

Candidate: Thomaz K. Chianca

Degree of: Doctor of Philosophy

Department: The Evaluation Center

Title: International Aid Evaluation: An Analysis and Policy Proposals

Committee:
Dr. Michael Scriven, Chair
Dr. Paul Clements
Dr. Jim Rugh

Date: Wednesday, November 21, 2007 2:00 p.m. – 4:00 p.m.
Ellsworth Hall, Room 4410

Abstract:
Evaluation has been intertwined with international aid work since its inception in the late 40's and early 50's, but it is still an area with considerable room for improvement. If, as is often alleged, evaluations of international development efforts are methodologically weak, they are misleading international agencies about the real impact of the sizable amount of resources being spent. This research conducted a study with a sample of 50 US-based international non-profit organizations (INGOs) illustrates the serious situation of the structure and practice of evaluation in those agencies. A number of efforts to improve this situation have been put in place. Some of them have greater focus on methodological solutions and push for the development of more rigorous impact evaluations using experimental or quasi-experimental designs. Other efforts, while maintaining perspective on the importance of adopting more rigorous evaluation methods, have instead prioritized the establishment of principles and standards to guide and improve evaluation practice. Studies involving thorough analysis of the main efforts to improve international aid evaluation and of the most prominent evaluation standards proposed to the development field are scarce. This dissertation is a contribution to the field in several ways: (1) it provides a general synthesis of the current movements to improve aid evaluation; (2) it describes and assesses some of the most prominent standards for aid evaluation; (3) in particular, it presents a thorough assessment of the most widely adopted set of evaluation criteria worldwide, the five OECD/DAC evaluation criteria, with specific suggestions for improving them; (4) it discusses results of a survey of INGOs on their evaluation principles and practice, and their feedback on the evaluation standards recently proposed by InterAction (the largest coalition of US-based INGOs); and (5) in the light of the preceding, it provides InterAction and other aid agencies with concrete suggestions to improve future revisions of their evaluation standards and guidelines.