Download or read book Challenges in Impact Evaluation of Development Interventions written by Jos Vaessen and published by . This book was released on 2010 with total page 38 pages. Available in PDF, EPUB and Kindle. Book excerpt: In recent years debates on as well as funding of impact evaluations of development interventions have flourished. Unfortunately, controversy regarding the promotion and application of randomized experiments (RE) has led to a sense of polarization in the development policy and evaluation community. As some proponents claim epistemological supremacy of REs (with respect to attribution) the counter reaction among others has been rejection. Needless to say, such extreme positions are counterproductive to reaching a goal that is commonly endorsed: to learn more about what works and why in development. This paper discusses the prospects and limitations of REs from the perspective of three categories of challenges in impact evaluation: delimitation and scope, attribution versus explanation, and implementation challenges. The implicit lesson is twofold. First of all, the question 'to randomize or not to randomize' is overrated in the current debate. Limitations in scope, applicability as well as implementation will necessarily restrict the use of REs in development impact evaluation. There is a risk that the current popularity of REs in certain research and policy circles might lead to a backlash as too high expectations of REs may quicken its demise. More importantly, given the nature and scope of the challenges discussed in the paper, more energy should be devoted to developing and testing 'rigorous' mixed method approaches within a framework of theory-driven evaluation.

Download or read book Impact Evaluation of Development Interventions written by Howard White and published by Asian Development Bank. This book was released on 2017-12-01 with total page 177 pages. Available in PDF, EPUB and Kindle. Book excerpt: Impact evaluation is an empirical approach to estimating the causal effects of interventions, in terms of both magnitude and statistical significance. Expanded use of impact evaluation techniques is critical to rigorously derive knowledge from development operations and for development investments and policies to become more evidence-based and effective. To help backstop more use of impact evaluation approaches, this book introduces core concepts, methods, and considerations for planning, designing, managing, and implementing impact evaluation, supplemented by examples. The topics covered range from impact evaluation purposes to basic principles, specific methodologies, and guidance on field implementation. It has materials for a range of audiences, from those who are interested in understanding evidence on "what works" in development, to those who will contribute to expanding the evidence base as applied researchers.

Download or read book Impact Evaluation in Practice Second Edition written by Paul J. Gertler and published by World Bank Publications. This book was released on 2016-09-12 with total page 444 pages. Available in PDF, EPUB and Kindle. Book excerpt: The second edition of the Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. First published in 2011, it has been used widely across the development and academic communities. The book incorporates real-world examples to present practical guidelines for designing and implementing impact evaluations. Readers will gain an understanding of impact evaluations and the best ways to use them to design evidence-based policies and programs. The updated version covers the newest techniques for evaluating programs and includes state-of-the-art implementation advice, as well as an expanded set of examples and case studies that draw on recent development challenges. It also includes new material on research ethics and partnerships to conduct impact evaluation. The handbook is divided into four sections: Part One discusses what to evaluate and why; Part Two presents the main impact evaluation methods; Part Three addresses how to manage impact evaluations; Part Four reviews impact evaluation sampling and data collection. Case studies illustrate different applications of impact evaluations. The book links to complementary instructional material available online, including an applied case as well as questions and answers. The updated second edition will be a valuable resource for the international development community, universities, and policy makers looking to build better evidence around what works in development.

Download or read book A Review of Recent Developments in Impact Evaluation written by Asian Development Bank and published by Asian Development Bank. This book was released on 2011-02-01 with total page 206 pages. Available in PDF, EPUB and Kindle. Book excerpt: Impact evaluation aims to answer whether and to what extent a development intervention has delivered its intended effects, thus enabling evidence-based policy making. The desire for more hard evidence of the effectiveness of development interventions has fueled a growing interest in rigorous impact evaluation in the international development community. This report discusses the fundamental challenge of impact evaluation, which is to credibly attribute the impact, if any, to the intervention concerned. It then discusses the merits and limitations of various impact evaluation methods. It also presents a survey of recent applications of impact evaluation, focusing on the typical evaluation problems looked at, methods used, and key findings. The report includes six case studies and outlines practical steps in implementing an impact evaluation.

Download or read book The Goldilocks Challenge written by Mary Kay Gugerty and published by Oxford University Press. This book was released on 2018-04-02 with total page 313 pages. Available in PDF, EPUB and Kindle. Book excerpt: The social sector provides services to a wide range of people throughout the world with the aim of creating social value. While doing good is great, doing it well is even better. These organizations, whether nonprofit, for-profit, or public, increasingly need to demonstrate that their efforts are making a positive impact on the world, especially as competition for funding and other scarce resources increases. This heightened focus on impact is positive: learning whether we are making a difference enhances our ability to address pressing social problems effectively and is critical to wise stewardship of resources. Yet demonstrating efficacy remains a big hurdle for most organizations. The Goldilocks Challenge provides a parsimonious framework for measuring the strategies and impact of social sector organizations. A good data strategy starts first with a sound theory of change that helps organizations decide what elements they should monitor and measure. With a theory of change providing solid underpinning, the Goldilocks framework then puts forward four key principles, the CART principles: Credible data that are high quality and analyzed appropriately, Actionable data will actually influence future decisions; Responsible data create more benefits than costs; and Transportable data build knowledge that can be used in the future and by others. Mary Kay Gugerty and Dean Karlan combine their extensive experience working with nonprofits, for-profits and government with their understanding of measuring effectiveness in this insightful guide to thinking about and implementing evidence-based change. This book is an invaluable asset for nonprofit, social enterprise and government leaders, managers, and funders-including anyone considering making a charitable contribution to a nonprofit-to ensure that these organizations get it "just right" by knowing what data to collect, how to collect it, how it can be analyzed, and drawing implications from the analysis. Everyone who wants to make positive change should focus on the top priority: using data to learn, innovate, and improve program implementation over time. Gugerty and Karlan show how.

Download or read book Handbook on Impact Evaluation written by Shahidur R. Khandker and published by World Bank Publications. This book was released on 2009-10-13 with total page 262 pages. Available in PDF, EPUB and Kindle. Book excerpt: Public programs are designed to reach certain goals and beneficiaries. Methods to understand whether such programs actually work, as well as the level and nature of impacts on intended beneficiaries, are main themes of this book.

Download or read book Improving the proof Evolution of and emerging trends in impact assessment methods and approaches in agricultural development written by Mywish K. Maredia and published by Intl Food Policy Res Inst. This book was released on with total page 48 pages. Available in PDF, EPUB and Kindle. Book excerpt: Assessing impacts of public investments has long captured the interest and attention of the development community. This paper presents the evolution of different methods and approaches used for ex ante appraisal, monitoring, project evaluation, and impact assessment over the last five decades. Among these tools, impact assessment (IA) conducted retrospectively comes closest to providing the proof of development effectiveness. It is defined as the systematic analysis of the significant or lasting changes in people's lives brought about by a given action or series of actions in relation to a counterfactual. There are three basic types of retrospective IAs: macro-level IAs that focus on the contribution of developmental efforts to an impact goal aggregated at a sector or a system level; micro-level impact evaluations (IEs) concerned with estimating the average effect of an intervention on outcomes at the beneficiary level; and micro-level ex post impact analysis concerned with total effects of a development effort after the outputs are scaled-up. Ex post IAs have evolved and expanded over the decades in both breadth and depth of analysis in response to evolving development themes and methodological advancements. The increased emphasis on learning from evaluations has also seen responses from both quantitative and qualitative camps of the evaluation community. The paper argues that generation of robust knowledge that feeds into making developmental policies and investment decisions requires a hierarchical and cumulative approach to "improving the proof" through rigorous and a variety of impact assessment methods applied incrementally at the project, program and system level. Subjecting as many development interventions as resources allow to rigorous impact assessment based on a common framework can help build a critical body of evidence on impacts of development interventions, which can then be subjected to meta-analyses to help assimilate results across different studies and build a knowledge base on what works and what does not.

Download or read book Impact Evaluation of Energy Interventions written by David A. Raitzer and published by Asian Development Bank. This book was released on 2019-04-01 with total page 121 pages. Available in PDF, EPUB and Kindle. Book excerpt: This report aims to support impact evaluation in the energy sector by assessing what has been produced against what might be possible. It reviews 85 impact evaluations of energy interventions in developing countries, summarizes findings on outcomes, identifies evidence gaps, and proposes ways forward. A majority of studies has so far focused on rural electrification and improved cookstoves, while most investments are in power generation and transmission. After considering the body of evidence available, directions and approaches are proposed for future impact evaluations to best contribute new evidence regarding the sector.

Download or read book Economic Evaluation of Sustainable Development written by Vinod Thomas and published by Springer. This book was released on 2019-04-16 with total page 145 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book is open access under a CC BY 4.0 license. This book presents methods to evaluate sustainable development using economic tools. The focus on sustainable development takes the reader beyond economic growth to encompass inclusion, environmental stewardship and good governance. Sustainable Development Goals (SDGs) provide a framework for outcomes. In illustrating the SDGs, the book employs three evaluation approaches: impact evaluation, cost-benefit analysis and objectives-based evaluation. The innovation lies in connecting evaluation tools with economics. Inclusion, environmental care and good governance, thought of as “wicked problems”, are given centre stage. The book uses case studies to show the application of evaluation tools. It offers guidance to evaluation practitioners, students of development and policymakers. The basic message is that evaluation comes to life when its links with socio-economic, environmental, and governance policies are capitalized on.

Download or read book Developmental Evaluation written by Michael Quinn Patton and published by Guilford Press. This book was released on 2010-06-14 with total page 401 pages. Available in PDF, EPUB and Kindle. Book excerpt: Developmental evaluation (DE) offers a powerful approach to monitoring and supporting social innovations by working in partnership with program decision makers. In this book, eminent authority Michael Quinn Patton shows how to conduct evaluations within a DE framework. Patton draws on insights about complex dynamic systems, uncertainty, nonlinearity, and emergence. He illustrates how DE can be used for a range of purposes: ongoing program development, adapting effective principles of practice to local contexts, generating innovations and taking them to scale, and facilitating rapid response in crisis situations. Students and practicing evaluators will appreciate the book's extensive case examples and stories, cartoons, clear writing style, "closer look" sidebars, and summary tables. Provided is essential guidance for making evaluations useful, practical, and credible in support of social change.

Download or read book Impact Evaluation in International Development written by Paul Glewwe and published by World Bank Publications. This book was released on 2022-01-25 with total page 544 pages. Available in PDF, EPUB and Kindle. Book excerpt: Impact evaluations are studies that attempt to measure the causal impact of a project, program or policy on one or more outcomes of. This book provides a comprehensive exposition of how to conduct impact evaluations. Part I provides an overview of impact evaluations and comprises five chapters which are accessible to readers who have few or none of the technical (statistical and econometric) skills that are needed to conduct impact evaluations. Parts II and III make use of statistical and econometric methods and are at a level similar to a graduate-student course but written to make them accessible to the ambitious reader whose skills are not at that level. Part II presents, in Chapters 6-10, a comprehensive discussion of the use of randomized controlled trials (RCTs) to conduct impact evaluations, including a general discussion of the ethical issues involved in conducting impact evaluations. Part III presents the main non-experimental methods that are used to implement impact evaluations when RCTs are not feasible or not recommended for other reasons. Chapters 11 and 12 present regression methods, including difference-in-differences estimation. Matching methods are described in Chapter 13, after which regression discontinuity methods are covered in Chapter 14. Instrumental variable methods, including the estimation of local average treatment effects (LATE), are discussed in detail in Chapter 15. Chapters 16 and 17 cover more advanced topics: quantile treatment effects and control function methods, respectively. Part IV then considers more practical issues when conducting impact evaluations, including designing questionnaires (Chapter 18), data collection methods and survey management (Chapters 19 and 20), and disseminating results to policymakers (Chapter 21). Finally, Part V addresses two topics in impact evaluation: qualitative methods for conducting impact evaluations (Chapter 22), and cost-benefit and cost-effectiveness analysis (Chapter 23).

Download or read book Dealing With Complexity in Development Evaluation written by Michael Bamberger and published by SAGE Publications. This book was released on 2015-10-16 with total page 587 pages. Available in PDF, EPUB and Kindle. Book excerpt: Recognizing that complexity calls for innovative, conceptual, and methodological solutions, Dealing with Complexity in Development Evaluation by Michael Bamberger, Jos Vaessen, and Estelle Raimondo offers practical guidance to policymakers, managers, and evaluation practitioners on how to design and implement complexity-responsive evaluations that can be undertaken in the real world of time, budget, data, and political constraints. Introductory chapters present comprehensive, non-technical overviews of the most common evaluation tools and methodologies, and additional content addresses more cutting-edge material. The book also includes six case study chapters to illustrate examples of various evaluation contexts from around the world.

Download or read book Impact Evaluation of Transport Interventions written by David A. Raitzer and published by Asian Development Bank. This book was released on 2019-04-01 with total page 127 pages. Available in PDF, EPUB and Kindle. Book excerpt: This publication aims to support impact evaluation in the transport sector by assessing what has been produced against what might be possible. It reviews 91 impact evaluations of transport interventions in developing countries, summarizes findings on outcomes, identifies evidence gaps, and proposes ways forward. Most of the studies reviewed find significant effects on at least one of the outcomes investigated. However, impact evaluation has given relatively little coverage to major areas of investment, such as urban and sustainable transportation, transport corridors, and efficiency enhancing measures. New methods and increasing openness of geospatial data provide scope to generate more innovative impact studies.

Download or read book Handbook of Ethics in Quantitative Methodology written by A. T. Panter and published by Routledge. This book was released on 2011-03-01 with total page 508 pages. Available in PDF, EPUB and Kindle. Book excerpt: This comprehensive Handbook is the first to provide a practical, interdisciplinary review of ethical issues as they relate to quantitative methodology including how to present evidence for reliability and validity, what comprises an adequate tested population, and what constitutes scientific knowledge for eliminating biases. The book uses an ethical framework that emphasizes the human cost of quantitative decision making to help researchers understand the specific implications of their choices. The order of the Handbook chapters parallels the chronology of the research process: determining the research design and data collection; data analysis; and communicating findings. Each chapter: Explores the ethics of a particular topic Identifies prevailing methodological issues Reviews strategies and approaches for handling such issues and their ethical implications Provides one or more case examples Outlines plausible approaches to the issue including best-practice solutions. Part 1 presents ethical frameworks that cross-cut design, analysis, and modeling in the behavioral sciences. Part 2 focuses on ideas for disseminating ethical training in statistics courses. Part 3 considers the ethical aspects of selecting measurement instruments and sample size planning and explores issues related to high stakes testing, the defensibility of experimental vs. quasi-experimental research designs, and ethics in program evaluation. Decision points that shape a researchers’ approach to data analysis are examined in Part 4 – when and why analysts need to account for how the sample was selected, how to evaluate tradeoffs of hypothesis-testing vs. estimation, and how to handle missing data. Ethical issues that arise when using techniques such as factor analysis or multilevel modeling and when making causal inferences are also explored. The book concludes with ethical aspects of reporting meta-analyses, of cross-disciplinary statistical reform, and of the publication process. This Handbook appeals to researchers and practitioners in psychology, human development, family studies, health, education, sociology, social work, political science, and business/marketing. This book is also a valuable supplement for quantitative methods courses required of all graduate students in these fields.

Download or read book Methodological and Conceptual Challenges of Evaluating the Impact of Development Interventions written by Jos Vaessen and published by . This book was released on 2010 with total page 175 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Impact Evaluation for International Development written by Maren Duvendack and published by Routledge. This book was released on 2014-12-31 with total page 360 pages. Available in PDF, EPUB and Kindle. Book excerpt: Impact evaluation is an important tool in research and policy making, as policymakers and donor agencies are under increasing pressure to justify public spending on social and economic interventions. This book will guide the reader through both the basic and more advanced methods of impact evaluation, with a particular focus on impact evaluation within evidence-based policy making and in international development. It will address the design, commissioning, and management of impact evaluations, data management, statistical econometric analyses, and theory-based approaches to impact evaluation. It will also cover other components of evidence-based policy making such as systematic reviews, replication, and ethics in impact evaluation research and practice. The book is organized in four parts, each part divided into stand-alone chapters. The chapters provide a theoretical discussion of the various topics related to impact evaluation, complemented with exercises, case studies and worked examples drawn from the international development literature. Iconic impact evaluation studies will be used to exemplify the challenges of development impact evaluations. The authors have all successfully conducted impact evaluations in developing countries for many years, and the book builds on their experience in in teaching, research, and consulting on development issues. It will be of interest to students of development studies, development economics, political science, public health and other areas in the social sciences, as well as to development professionals and policymakers.

Download or read book What Can We Learn from Nutrition Impact Evaluations written by The World Bank and published by World Bank Publications. This book was released on 2010-08-27 with total page 102 pages. Available in PDF, EPUB and Kindle. Book excerpt: Evaluation Summary What Can We Learn from Nutrition Impact Evaluations? High levels of child malnutrition in developing countries contribute to mortality and have long-term consequences for children s cognitive development and earnings as adults. Recent impact evaluations show that many different interventions have had an impact on children s anthropometric outcomes (height, weight, and birth weight), but there is no simple answer to the question What works? to address the problem. Similar interventions have widely different results in different settings, owing to differences in local context, the causes and severity of malnutrition, and the capacity for program implementation. Impact evaluations of programs supported by the Bank, which are generally large-scale, complex inter-ventions in low-capacity settings, show equally variable results. The findings confirm that it should not be assumed that an intervention found effective in a randomized medical setting will have the same effects when implemented under field conditions. There are many robust experimental and quasi-experimental methods for assessing impact under difficult circumstances often found in field settings. The relevance and impact of nutrition impact evaluations could be enhanced by collecting data on service delivery, demand-side behavioral outcomes, and implementation processes to better understand the causal chain and what part of the chain is weak, in parallel with impact evaluations. It is also important to understand better the distribution of impacts, particularly among the poor, and to document better the costs and effectiveness of interventions. High levels of child malnutrition in developing countries are contributing to mortality and present long-term consequences for the survivors. An estimated 178 million children under age 5 in developing countries are stunted (low height for age) and 55 million are wasted (low weight for height). Malnutrition makes children more susceptible to illness and strongly affects child mortality. Beyond the mortality risk in the short run, the developmental delays caused by undernutrition affect children s cognitive outcomes and productive potential as adults. Micronutrient deficiencies vitamin A, iron, zinc, iodine, for example are also common and have significant consequences. Progress in reducing malnutrition has been slow: More than half of countries are not on track to achieve the Millennium Development Goal of halving the share of children who are malnou-rished (low weight for age) by 2015. The food price and financial crises are making achievement of this goal even more elusive. The World Bank has recently taken steps to ex-pand its support for nutrition in response to the underlying need and the increased urgency due to the crises. WHAT DO WE KNOW ABOUT REDUCING MALNUTRITION? The increased interest and resources focused on the problem of high and potentially increasing rates of undernutrition raises the question, what do we know about the causes of malnutrition and the in-terventions most likely to reduce it? The medical literature points to the need to inter-vene during gestation and the first two years of life to prevent child malnutrition and its consequences. It suggests that investments in interventions during this window of opportunity among children under 2 are likely to have the greatest benefits. Recently published meta-analyses of the impact evaluation literature point to several interventions found effective for reducing undernutrition in spe-cific settings. However, there are limitations to the generalizability of those reviews findings, particularly in the context of large-scale government programs most likely to be supported by the World Bank. The reviews tend to disproportionately draw on the findings of smaller, controlled experiments; there are few examples of evaluations of large-scale programs, over which there is less control in implementation. In reviewing a large number of studies, interventions, and outcomes, they tend to focus on average impacts. They generally do not explain the magnitude or variability of impacts across or within studies. Very few address the programmatic reasons why some interventions work or don t work, nor do they assess the cost-effectiveness of interventions. Objectives of the Review This paper reviews recent impact evaluations of interventions and programs to improve child anth-ropometric outcomes height, weight, and birth weight with an emphasis on both the findings and limitations of the literature and on understanding what might happen in a non-research setting. It further reviews in greater detail the experience and lessons from evaluations of the impact of World Bank-supported programs on nutrition outcomes. Specifically, the review addresses four questions. First, what can be said about the impact of different interventions on children s anthropometric outcomes? Second, how do these findings vary across settings and within target groups, and what accounts for this variability? Third, what is the evidence of the cost-effectiveness of these interventions? Finally, what have been the lessons from implementing impact evaluations of Bank-supported programs with anthropometric impacts? While there are different dimensions of child nutri-tion that could be explored, the report focuses on child anthropometric outcomes -- weight, height, and birth weight. These are the most common nutrition outcome indicators in the literature and the most frequently monitored by national nutrition programs supported by the World Bank. Low weight for age (underweight) is also the indicator for one of the MDGs. Methodology and Scope Forty-six nutrition impact evaluations published since 2000 were systematically reviewed. These evaluations assessed the impact of diverse interven-tions community nutrition programs, conditional and unconditional cash transfers, early child devel-opment programs, food aid, integrated health and nutrition services, and de-worming. All of the evaluations used research designs that compared the outcomes among those affected by the project to the counterfactual that is, what would have happened to a similar group of people in the absence of the intervention. About half used randomized assignment to create treatment and control groups, while the remainder used matching and various econometric techniques to construct a counterfactual. Among the 46 evaluations, twelve assessed the im-pact of World Bank-supported programs on nutri-tion outcomes in eight countries. While the broader review relies on the analysis of the published impact evaluations as the main source of data, for these twelve evaluations project documents and research outputs were reviewed and World Bank staff, country officials and the evaluators and re-searchers who conducted the studies were interviewed. Findings A wide range of interventions had a positive impact on indicators related to height, weight, wasting, and low birth weight. There were a total of 10 different outcome indica-tors for the four main anthropometric outcomes. A little more than half of the evaluations addressing a height-related indicator found program impacts on at least one group of children, and this was true for about the same share of interventions aimed at improving weight-related and wasting (low weight for height)-related indicators. About three-quarters of the 11 evaluations of interventions that aimed at improving birth weight indicators registered an impact in at least one specification, including five out of seven micronutrient interven-tions. There was no clear pattern of impacts across interventions in every intervention group there were examples of programs that did and did not have an impact on a given indicator, and with varying magnitude. Evaluations of the nutritional impact of programs supported by the World Bank, which are generally large-scale, complex, and implemented in low-capacity settings, show equally variable results. Even controlling for the specific outcome indicator, studies often targeted children of different age groups that might be more or less susceptible to the interventions. It is thus difficult to point to inter-ventions that are systematically more effective than others in reducing malnutrition across diverse set-tings and age groups. Differences in local context, variation in the age of the children studied, the length of exposure to the intervention, and differing methodologies of the studies account for much of the variability in results. Context includes factors like the level and local determinants of malnutrition, differences in the characteristics of beneficiaries (including their age), the availability of service infrastructure, and the implementation capacity of government. Outside of a research setting in the context of a large government program there are many things that can go wrong in either service delivery or the demand response that can compromise impact. Beyond this, there are social factors like the status of women or the presence of civil unrest that can affect outcomes. These findings underscore the conclusion that it should not be assumed that an intervention found effective in a randomized controlled trial in a re-search setting will have the same effects when im-plemented under field conditions in a different set-ting. They also point to the need to understand the prevailing underlying causes of malnutrition in a given setting and the age groups most likely to benefit in selecting an intervention. Further, impact evaluations need to supplement data measuring impact with data on service delivery and demand-side behavioral outcomes to demonstrate the plausibility of the findings, to understand what part of a program works, and to address weak links in the results chain to improve performance. There is scant evidence on the distribution of nutrition impacts who is benefiting and who is not or on the cost-effectiveness of interventions Just because malnutrition is more common among the poor does not mean that they will disproportio-nately benefit from an intervention, particularly if acting on new knowledge or different incentives relies on access to education or quality services. Only a third of the 46 evaluations looked at the distribution of impacts by gender, mother s education, poverty status, or availability of complementary health services. Only nine assessed the impacts on nutritional outcomes of the poor compared with the non-poor. Among the evaluations that did examine variation in results, several found that the children of more educated mothers or in better-off communities are be-nefitting the most. Bank-supported cash transfers, community nutrition, and early child development programs in six of eight countries had some impact on child anthropometric outcomes. Of the 12 impact evaluations of Bank support, all but one were of large-scale government programs with multiple interventions and a long results chain. Three-quarters found a positive impact on anthro-pometric outcomes of children in at least one age group, although the magnitude was in some cases not large or applied to a narrow age group. Most of the impact evaluations involved assessment of completely new programs and involved World Bank researchers. Most used quasi-experimental evaluation designs and two-thirds assessed impact after at most 3 years of program implementation. Only half of the evaluations documented the distribution of impacts and only a third presented information on the costs of the intervention (falling short of cost-effectiveness analysis). In two of the countries (Colombia and the Philippines) the evaluations likely had an impact on government policy or programs. Lessons A number of lessons for development practi-tioners and evaluators arose from the review of impact evaluations of World Bank nutrition support. For task managers: Impact evaluations of interventions that are clearly beyond the means of the government to sustain are of limited relevance. The complexity, costs, and fiscal sustainability of the intervention should figure into the decision as to whether an impact evaluation is warranted. Impact evaluations are often launched for the purpose of evaluating completely new pro-grams, but they may be equally or even more useful in improving the effectiveness of ongo-ing programs. There are methods for obtaining reliable impact evaluation results when randomized assignment of interventions is not possible for political, ethical, or practical reasons. For evaluators: In light of the challenges of evaluating large-scale programs with a long results chain, it is well worth the effort to assess the risks to disruption of the impact evaluation ahead of time and identify mitigation measures. The design and analysis of nutrition impact evaluations need to take into account the likely sensitivity of children of different ages to the intervention. For the purposes of correctly gauging im-pact, it is important to know exactly when delivery of an intervention took place in the field (as opposed to the official start of the program). Evaluations need to be designed to provide evidence for timely decision-making, but with sufficient elapsed time for a plausible impact to have occurred. The relevance of impact evaluations for po-licymakers would be greatly enhanced if im-pact evaluations were to document both the