Download or read book Evidence Building and Evaluation in Government written by Kathryn Newcomer and published by SAGE Publications. This book was released on 2021-11-26 with total page 158 pages. Available in PDF, EPUB and Kindle. Book excerpt: Public managers, contractors, and grantees conducting evaluations for government operate in complex environment where policymakers and commissioners of evaluation expect different types of “evidence” and simultaneously employ different criteria in judging the quality of that evidence. This text provides a road map for evaluators doing business within or for government, and public managers who are expected to assess and use evidence generated by a large variety of evaluation approaches. The book provides checklists and how-to guidance to help students and other readers develop skills in important activities such as: assessing the quality of evidence claims; developing theories of change to guide the design and evaluation of programs and policies; developing learning agendas to bridge the gap between evidence producers and potential evidence users; and increasing the support of public leaders and executives in the generation and use of evidence to inform their decision-making. The authors include end-of-chapter exercises for readers to test their ability to apply the skills described.
Download or read book Informing Federal Policies on Evaluation Methodology Building the Evidence Base for Method Choice in Government Sponsored Evaluations written by George Julnes and published by Jossey-Bass. This book was released on 2007-04-20 with total page 168 pages. Available in PDF, EPUB and Kindle. Book excerpt: One of the most divisive issues in the evaluation community has been the debate over which methodologies are to be considered adequate or commendable in addressing different evaluation questions in different settings. One form of this debate involved opposing camps of proponents of qualitative versus quantitative methods. A decade ago, there was some hope that the two sides of this debate, referred to as the paradigm war, were learning to respect each other. More recently, however, a federal agency priority for funding random assignment experimental studies has reignited the debate. This volume provides a space for a productive dialogue that, by identifying areas of agreement but also fundamental differences, will promote a more durable working consensus on the circumstances in which some methods are to be preferred over others. The chapter authors and discussants make clear that there are different types of evidence with which to inform this dialogue, including empirical findings of the impact of method choice on evaluation outcomes, the evidence contained in the wisdom of practice, and the results of critical analyses of the broader social impacts of method choice. The editors build on these contributions to suggest pragmatic policies for federal agencies, promoting both context-appropriate method choice and the importance of managing portfolios of evaluative research that maintain desired distributions of methodologies. This is the 113th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, a publication of Jossey-Bass and the American Evaluation Association.
Download or read book Informing Federal Policies on Evaluation Methodology written by George Julnes and published by . This book was released on 2007 with total page 154 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Building Better Policies written by Gladys Lopez-Acevedo and published by World Bank Publications. This book was released on 2012-04-01 with total page 253 pages. Available in PDF, EPUB and Kindle. Book excerpt: Monitoring and Evaluation Systems are a critical component of evidence-based policymaking. This book aims to help governments and civil society organizations design, implement and use M and E information drawing from best practice experiences.
Download or read book Handbook of EHealth Evaluation written by Francis Yin Yee Lau and published by . This book was released on 2016-11 with total page 487 pages. Available in PDF, EPUB and Kindle. Book excerpt: To order please visit https://onlineacademiccommunity.uvic.ca/press/books/ordering/
Download or read book The Goldilocks Challenge written by Mary Kay Gugerty and published by Oxford University Press. This book was released on 2018-04-02 with total page 313 pages. Available in PDF, EPUB and Kindle. Book excerpt: The social sector provides services to a wide range of people throughout the world with the aim of creating social value. While doing good is great, doing it well is even better. These organizations, whether nonprofit, for-profit, or public, increasingly need to demonstrate that their efforts are making a positive impact on the world, especially as competition for funding and other scarce resources increases. This heightened focus on impact is positive: learning whether we are making a difference enhances our ability to address pressing social problems effectively and is critical to wise stewardship of resources. Yet demonstrating efficacy remains a big hurdle for most organizations. The Goldilocks Challenge provides a parsimonious framework for measuring the strategies and impact of social sector organizations. A good data strategy starts first with a sound theory of change that helps organizations decide what elements they should monitor and measure. With a theory of change providing solid underpinning, the Goldilocks framework then puts forward four key principles, the CART principles: Credible data that are high quality and analyzed appropriately, Actionable data will actually influence future decisions; Responsible data create more benefits than costs; and Transportable data build knowledge that can be used in the future and by others. Mary Kay Gugerty and Dean Karlan combine their extensive experience working with nonprofits, for-profits and government with their understanding of measuring effectiveness in this insightful guide to thinking about and implementing evidence-based change. This book is an invaluable asset for nonprofit, social enterprise and government leaders, managers, and funders-including anyone considering making a charitable contribution to a nonprofit-to ensure that these organizations get it "just right" by knowing what data to collect, how to collect it, how it can be analyzed, and drawing implications from the analysis. Everyone who wants to make positive change should focus on the top priority: using data to learn, innovate, and improve program implementation over time. Gugerty and Karlan show how.
Download or read book OECD Public Governance Reviews Building Capacity for Evidence Informed Policy Making Lessons from Country Experiences written by OECD and published by OECD Publishing. This book was released on 2020-09-08 with total page 80 pages. Available in PDF, EPUB and Kindle. Book excerpt: This report analyses the skills and capacities governments need to strengthen evidence-informed policy-making (EIPM) and identifies a range of possible interventions that are available to foster greater uptake of evidence. Increasing governments’ capacity for evidence-informed is a critical part of good public governance. However, an effective connection between the supply and the demand for evidence in the policy-making process remains elusive. This report offers concrete tools and a set of good practices for how the public sector can support senior officials, experts and advisors working at the political/administrative interface. This support entails investing in capability, opportunity and motivation and through behavioral changes. The report identifies a core skillset for EIPM at the individual level, including the capacity for understanding, obtaining, assessing, using, engaging with stakeholders, and applying evidence, which wasdeveloped in collaboration with the European Commission Joint Research Centre. It also identifies a set of capacities at the organisational level that can be put in place across the machinery of government, throughout the role of interventions, strategies and tools to strengthen these capacities. The report concludes with a set of recommendations to assist governments in building their capacities.
Download or read book Towards Reduced Administrative Burdens written by Joel Nantais and published by . This book was released on 2022 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: This dissertation explores how existing standards for performance management and measurement through data analytics in the federal government can be leveraged to identify and measure administrative burdens with the aim of reducing their impact. This work focuses on the use of machine learning to solve implementation problems like administrative burdens, complete with the design, development, and implementation considerations that are specific to machine learning in the United States federal government. Finally, this work explores how to use the existing requirements for evidence-based policymaking and evaluation in the federal government to determine the impact of the machine learning solutions, as well as the impact of the reduced administrative burdens on the outcomes and goals of programs. This research demonstrates that administrative burdens in the federal government systems and processes can be identified and addressed without new legislation, regulation, or resources and that machine learning techniques are poised to provide solutions to public problems. This presents an opportunity for the federal government to refocus on providing performance data, administrative data, and information about existing uses of machine learning available to the public in a way that can benefit the academic research field; this lack of availability has follow-on impacts on the public sector.
Download or read book Improving Government Performance written by Joseph S. Wholey and published by John Wiley & Sons. This book was released on 1989-01-10 with total page 259 pages. Available in PDF, EPUB and Kindle. Book excerpt: An evaluation framework for more effective government Improving Government Performance takes as project management approach to government program evaluation, offering clear strategies with real-world practicability. Expert discussion details crucial guidance on planning, implementation and analysis, providing a robust framework for quick, efficient, cost-effective evaluations. Systematic evaluation of reveals weaknesses before they break, allowing timely revision and readjustment that can improve productivity, streamline operations, and promote high-quality management; this book provides essential guidance for through, effective review and analysis of any government program or agency.
Download or read book Research Handbook on Program Evaluation written by Kathryn E. Newcomer and published by Edward Elgar Publishing. This book was released on 2024-06-05 with total page 729 pages. Available in PDF, EPUB and Kindle. Book excerpt: In the Research Handbook on Program Evaluation, an impressive range of authors take stock of the history and current standing of key issues and debates in the evaluation field. Examining current literature of program evaluation, the Research Handbook assesses the field's status in a post-pandemic and social justice-oriented world, examining today’s theoretical and practical concerns and proposing how they might be resolved by future innovations. This title contains one or more Open Access chapters.
Download or read book Real World Evidence Generation and Evaluation of Therapeutics written by National Academies of Sciences, Engineering, and Medicine and published by National Academies Press. This book was released on 2017-07-05 with total page 103 pages. Available in PDF, EPUB and Kindle. Book excerpt: The volume and complexity of information about individual patients is greatly increasing with use of electronic records and personal devices. Potential effects on medical product development in the context of this wealth of real-world data could be numerous and varied, ranging from the ability to determine both large-scale and patient-specific effects of treatments to the ability to assess how therapeutics affect patients' lives through measurement of lifestyle changes. In October 2016, the National Academies of Sciences, Engineering, and Medicine held a workshop to facilitate dialogue among stakeholders about the opportunities and challenges for incorporating real-world evidence into all stages in the process for the generation and evaluation of therapeutics. Participants explored unmet stakeholder needs and opportunities to generate new kinds of evidence that meet those needs. This publication summarizes the presentations and discussions from the workshop.
Download or read book Democratic Evaluation and Democracy written by Donna Podems and published by IAP. This book was released on 2017-02-01 with total page 257 pages. Available in PDF, EPUB and Kindle. Book excerpt: Democratic evaluation brings a way of thinking about evaluation’s role in society and in particular, its role in strengthening social justice. Yet the reality of applying it, and what happens when it is applied particularly outside the West, is unclear. Set in South Africa, a newly formed democracy in Southern Africa, the book affords an in-depth journey that immerses a reader into the realities of evaluation and its relation to democracy. The book starts with the broader introductory chapters that set the scene for more detailed ones which bring thorough insights into national government, local government, and civil societies’ experience of evaluation, democratic evaluation and their understanding of how it contributes to strengthening democracy (or not). A teaching case, the book concludes by providing guiding questions that encourage reflection, discussion and learning that ultimately aims to inform practice and theory.
Download or read book The Program Evaluation Standards written by Donald B. Yarbrough and published by SAGE. This book was released on 2011 with total page 385 pages. Available in PDF, EPUB and Kindle. Book excerpt: Including a new section on evaluation accountability, this Third Edition details 30 standards which give advice to those interested in planning, implementing and using program evaluations.
Download or read book The Evidence Book written by Olaf Rieper and published by Routledge. This book was released on 2017-09-08 with total page 193 pages. Available in PDF, EPUB and Kindle. Book excerpt: Knowledge grows as ideas are tested against each other. Agreement is not resolved simply by naming concepts but in the dialectical process of thesis, antithesis, and synthesis. There are many echoes of these debates in The Evidence Book. The contributors make claims for both practitioner wisdom and the voice of experience. Against this is posed the authority of experimental science and the randomized controlled trial.The contributors are concerned, in their own ways, with collecting, ranking, and analyzing evidence and using this to deliver evaluations. As an expert group, they are aware that the concept of evidence has been increasingly important in the last decade. As with other concepts, it too often escapes precise definition. Despite this, the growing importance of evidence has been advocated with enthusiasm by supporters who see it as a way of increasing the effectiveness and quality of decisions and of professional life.The willingness to engage in evidence-based policy and the means to do so is heavily constrained by economic, political, and cultural climates. This book is a marvelously comprehensive and utterly unique treatise on evidence-based policy. It is a wide-ranging contribution to the field of evaluation.
Download or read book Credible and Actionable Evidence written by Stewart I. Donaldson and published by SAGE Publications. This book was released on 2014-09-10 with total page 377 pages. Available in PDF, EPUB and Kindle. Book excerpt: Addressing one of the most important and contentious issues challenging applied research and evaluation practice today—what constitutes credible and actionable evidence?—this volume offers a balanced and current context in which to analyze the long-debated quantitative-qualitative paradigms. In the Second Edition, the contributors, a veritable “who’s who” in evaluation, discuss the diversity and changing nature of credible and actionable evidence; offer authoritative guidance about using credible and actionable evidence; explain how to use it to provide rigorous and influential evaluations; and include lessons from their own applied research and evaluation to suggest ways to address the key issues and challenges. Reflecting the latest developments in the field and covering both experimental and non-experimental methods, the new edition includes revised and updated chapters, summaries of strengths and weaknesses across varied approaches, and contains diverse definitions of evidence. Also included are two new chapters on assessing credibility and synthesizing evidence for policy makers. This is a valuable resource for students and others interested in how to best study and evaluate programs, policies, organizations, and other initiatives designed to improve aspects of the human condition and societal well-being.
Download or read book Preparing Teachers written by National Research Council and published by National Academies Press. This book was released on 2010-07-25 with total page 234 pages. Available in PDF, EPUB and Kindle. Book excerpt: Teachers make a difference. The success of any plan for improving educational outcomes depends on the teachers who carry it out and thus on the abilities of those attracted to the field and their preparation. Yet there are many questions about how teachers are being prepared and how they ought to be prepared. Yet, teacher preparation is often treated as an afterthought in discussions of improving the public education system. Preparing Teachers addresses the issue of teacher preparation with specific attention to reading, mathematics, and science. The book evaluates the characteristics of the candidates who enter teacher preparation programs, the sorts of instruction and experiences teacher candidates receive in preparation programs, and the extent that the required instruction and experiences are consistent with converging scientific evidence. Preparing Teachers also identifies a need for a data collection model to provide valid and reliable information about the content knowledge, pedagogical competence, and effectiveness of graduates from the various kinds of teacher preparation programs. Federal and state policy makers need reliable, outcomes-based information to make sound decisions, and teacher educators need to know how best to contribute to the development of effective teachers. Clearer understanding of the content and character of effective teacher preparation is critical to improving it and to ensuring that the same critiques and questions are not being repeated 10 years from now.
Download or read book The promise of evidence based policymaking written by United States. Commission on Evidence-Based Policymaking and published by Government Printing Office. This book was released on 2017 with total page 140 pages. Available in PDF, EPUB and Kindle. Book excerpt:
