Analyst learns the strengths and weaknesses of the main methods of ex post impact evaluation. Martin ravallion is director of the world banks development research group. He also identifies some drawbacks of impact evaluation, many of which are experienced by practitioners, such as the ethical issues with randomised implementation of development programs. Impact evaluation provides a measure of aid effectiveness, that is how good. Martin ravallion emanuela galasso teodoro lazo ernesto philipp abstract we propose a method for estimating the mean impact of an assigned social program when it is not feasible to do a preintervention baseline survey but it is feasible to track exparticipants. Is that right, or is the true impact being hidden somehow.
In contrast to outcome monitoring, which examines whether. Martin ravallion many more impact evaluations could be done, and at lower unit cost, if evaluators could avoid the need for baseline data using objective socioeconomic surveys and rely instead on retrospective subjective questions on how outcomes have changed, asked postintervention. The article takes the form of a short story about a fictional characters. Matching impact evaluation design to the nature of the. What can exparticipants reveal about a program s impact. This article provides an introduction to the concepts and methods of impact evaluation. See footnote 4 in the main text on likely undercounting of nonrandomized ies in earlier years. Impact evaluation assesses the changes that can be attributed to a particular intervention, such as a project, program or policy, both the intended ones, as well as ideally the unintended ones. The article takes the form of a short story about a fictional characters on. The authors also benefited from the discussion in a meeting of the poverty reduction board held on december 16, 1998. This entertaining introduction to the concepts and methods of impact evaluation as seen through the eyes of ms. Tool kit chapter 5 assessing the poverty impact of an assigned program ravallion tool kit chapter 5 page 5 1 chapter 5 assessing the poverty impact of an assigned program martin ravallion 5. The author provides an intuitive explanation in the context of a concrete application.
Thoroughly synthesizes the economics at play in poverty. The mystery of the vanishing benefits an introduction to impact evaluation authorseditors. The economics of poverty history, measurement, and policy martin ravallion. Is a household survey necessary, and is it a reliable guide. Outline of principles of impact evalation discussion dra. The discussion then turns to the generic evaluation problem and how it is addressed in practice. Finally, the chapter discusses the ethical concerns about evaluation. Martin ravallion, the mystery of the vanishing benefits. That assumption must be deemed highly implausible in this setting. An introduction to impact evaluation martin ravallion this article provides an introduction to the concepts and methods of impact evaluation.
Chronic poverty and pervasive risks poverty is pervasive. Estimating the benefit incidence of an antipoverty program by propensity score matching jyotsna jalan and martin ravallion 1 indian statistical institute and world bank 1 address for correspondence. Ms speedy analysts introduction to evaluation, world bank policy. Speedy analysts introduction to evaluation july 1999. See all articles by martin ravallion martin ravallion. The economics of poverty paperback martin ravallion. Explains poverty in a way that is interesting to people with or without a background in economics. Standard methods of impact evaluation often leave significant gaps between what we know about development effectiveness. Fitted lines are nearest neighbor smoothed scatter plots. If we are serious about assessing development impact then we will have to be more interventionist about what gets evaluated and more pragmatic and eclectic in how that is done. Villani chair in economics, georgetown university, washington dc this book offers a timely and most needed contribution to the field of evaluation.
We thank daniel lederman, martin ravallion, and participants at the december 2010 workshop on. In contrast to outcome monitoring, which examines whether targets have been achieved, impact evaluation is structured to answer the question. Session 1 impact evaluation methodologies impact evaluation workshop, lilongwe, dec. Martin ravallion is with the development economics research group at the world bank. Randomized impact evaluations o ther n o a dmiz s c o u n t o f p u b l i s h e d i m p a c t e v a l u a t i o n s note.
Learning about the effectiveness of what is done to reduce poverty is not easy, and mistakes are made, both rejecting good efforts and accepting bad ones. You are cordially invited to the 2016 wider annual lecture by martin ravallion. Ravallion discusses the challenges of household surveys as the dominant source of poverty data and the limitations of householdlevel data. Martin ravallion and will martin, was critical for developing the lgaf. The developing worlds bulging but vulnerable middle class, policy research working paper series 4816, the world bank. Ravallion, martin 1999 the mystery of the vanishing benefits. Martin ravallion has spent over 30 years working on poverty, with his career as the leading expert on the topic at the world bank more recently augmented by his more recent position as a professor at georgetown which has involved teaching an undergraduate class on the topic. Estimating the benefit incidence of an antipoverty program. Imagine how much more we could learn about development impact if we did not need baseline data.
Expost evaluation of an antipoverty program policy research working paper series, the world bank view citations 2 household welfare impacts of chinas accession to the world trade organization policy research working paper series, the world bank view citations 6 in measuring aggregatesocial efficiency. Martin ravallion department of economics, georgetown university, washington dc, usa. This note will be a part section 2 of a position paper on impact evaluation under preparation. Evaluating antipoverty programs world bank documents. Ifad and afdb impact evaluation guidelines strongly espouse a theorybased approach. Impact evaluation is an assessment of the impact of an intervention on final. For helpful comments the author is grateful to sabina alkire, kathleen beegle, rui manuel coutinho. The paper assumes that readers are familiar with basic statistics up to regression analysis as would be covered. There has been an expansion of analytic effort by economists and others to improve knowledge about the effectiveness of both specific antipoverty policies and the distributional implications of a broader range of policies. Recent developments in the econometrics of impact evaluation imbens and wooldrige.
Evaluating antipoverty programs by martin ravallion ssrn. Poverty assessments are typically clouded in conceptual and methodological uncertainties. Martin ravallion direct interventions against poverty in. Further reproduction prohibited without permission. Ravallion, martin, the mystery of the vanishing benefits. Staff of the international initiative for impact evaluation kindly provided an update to their database on published impact evaluations and helped with the authors questions. An impact evaluation assesses a programs performance in attaining wellde. An impact evaluation assesses a programs performance in attaining welldefined objectives against an.
Overview of impact evaluation page 2 an impact evaluation should only be undertaken when its intended use can be clearly identified and when it is likely to be able to produce useful findings, taking into account the availability of resources and the timing of decisions about the programme or policy under investigation. Martin ravallion direct interventions in poor places. Direct interventions against poverty in poor places martin ravallion wider annual lecture 20 wider. Evaluation in the practice of development citeseerx. Chapter 5 assessing the poverty impact of an assigned. A primer martin ravallion development research group, world bank. Where should the poverty line be drawn, and does the choice. Ravallion, martin, evaluating antipoverty programs june 1, 2005. Ravallion and chen 2003 equals the ordinary rate of growth times a. The article takes the form of a short story about a fictional characters onthejob training in evaluation. Ms speedy analysts introduction to evaluation martin ravallion world bank this paper aims to provide an introduction to the concepts and methods of impact evaluation. It will also feed into the handbook on impact evaluation under preparation, jointly with lacpr. Next, some broader issues about learning from evaluations are examined, and what other methods might be needed as a complement to standard methods in practice.
Evaluation in the practice of development by martin ravallion ssrn. The authors find that impact estimates are quite sensitive to the choice of. There are 2 versions of this paper evaluating antipoverty programs. Should the randomistas continue to rule cgd working paper 492. Ravallion and chen 2005 studied the impacts of the swp over the disbursement period, 19952000, using survey data for. Second, while standard methods of impact evaluation are useful, they often leave. Development research group, world bank 1818 h street nw, washington dc, 20433, usa.
1133 64 1165 899 504 896 111 1063 746 640 523 197 1048 615 1094 1193 1416 299 750 520 539 348 623 365 1028 496 623 1463 1200 796 132 308 1203 489 585 1224 914 513 259 1001 430 167 937