Download or read book Informing Federal Policies on Evaluation Methodology Building the Evidence Base for Method Choice in Government Sponsored Evaluations written by George Julnes and published by Jossey-Bass. This book was released on 2007-04-20 with total page 168 pages. Available in PDF, EPUB and Kindle. Book excerpt: One of the most divisive issues in the evaluation community has been the debate over which methodologies are to be considered adequate or commendable in addressing different evaluation questions in different settings. One form of this debate involved opposing camps of proponents of qualitative versus quantitative methods. A decade ago, there was some hope that the two sides of this debate, referred to as the paradigm war, were learning to respect each other. More recently, however, a federal agency priority for funding random assignment experimental studies has reignited the debate. This volume provides a space for a productive dialogue that, by identifying areas of agreement but also fundamental differences, will promote a more durable working consensus on the circumstances in which some methods are to be preferred over others. The chapter authors and discussants make clear that there are different types of evidence with which to inform this dialogue, including empirical findings of the impact of method choice on evaluation outcomes, the evidence contained in the wisdom of practice, and the results of critical analyses of the broader social impacts of method choice. The editors build on these contributions to suggest pragmatic policies for federal agencies, promoting both context-appropriate method choice and the importance of managing portfolios of evaluative research that maintain desired distributions of methodologies. This is the 113th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, a publication of Jossey-Bass and the American Evaluation Association.
Download or read book Informing Federal Policies on Evaluation Methodology written by George Julnes and published by . This book was released on 2007 with total page 154 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Credible and Actionable Evidence written by Stewart I. Donaldson and published by SAGE Publications. This book was released on 2014-09-10 with total page 296 pages. Available in PDF, EPUB and Kindle. Book excerpt: Addressing one of the most important and contentious issues challenging applied research and evaluation practice today—what constitutes credible and actionable evidence?—this volume offers a balanced and current context in which to analyze the long-debated quantitative-qualitative paradigms. In the Second Edition, the contributors, a veritable "who’s who" in evaluation, discuss the diversity and changing nature of credible and actionable evidence; offer authoritative guidance about using credible and actionable evidence; explain how to use it to provide rigorous and influential evaluations; and include lessons from their own applied research and evaluation to suggest ways to address the key issues and challenges. Reflecting the latest developments in the field and covering both experimental and non-experimental methods, the new edition includes revised and updated chapters, summaries of strengths and weaknesses across varied approaches, and contains diverse definitions of evidence. Also included are two new chapters on assessing credibility and synthesizing evidence for policy makers. This is a valuable resource for students and others interested in how to best study and evaluate programs, policies, organizations, and other initiatives designed to improve aspects of the human condition and societal well-being.
Download or read book Principles and Practices for Federal Program Evaluation written by National Academies of Sciences, Engineering, and Medicine and published by National Academies Press. This book was released on 2017-09-30 with total page 67 pages. Available in PDF, EPUB and Kindle. Book excerpt: In October 2016, the National Academies of Sciences, Engineering, and Medicine convened a 1-day public workshop on Principles and Practices for Federal Program Evaluation. The workshop was organized to consider ways to bolster the integrity and protect the objectivity of the evaluation function in federal agenciesâ€"a process that is essential for evidence-based policy making. This publication summarizes the presentations and discussions from the workshop.
Download or read book RealWorld Evaluation written by Michael Bamberger and published by SAGE. This book was released on 2011-11-29 with total page 713 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book addresses the challenges of conducting program evaluations in real-world contexts where evaluators and the agencies face budget and time constraints and where critical data is missing. The book is organized around a seven-step model developed by the authors, which has been tested and refined in workshops. Vignettes and case studies—representing evaluations from a variety of geographic regions and sectors—demonstrate adaptive possibilities for small projects with budgets of a few thousand dollars to large-scale, long-term evaluations. The text incorporates quantitative, qualitative, and mixed-method designs and this Second Edition reflects important developments in the field over the last five years.
Download or read book Advancing Validity in Outcome Evaluation Theory and Practice written by Huey T. Chen and published by John Wiley & Sons. This book was released on 2011-07-13 with total page 138 pages. Available in PDF, EPUB and Kindle. Book excerpt: Exploring the influence and application of Campbellian validity typology in the theory and practice of outcome evaluation, this volume addresses the strengths and weaknesses of this often controversial evaluation method and presents new perspectives for its use. Editors Huey T. Chen, Stewart I. Donaldson and Melvin M. Mark provide a historical overview of the Campbellian typology adoption, contributions and criticism. Contributing authors propose strategies in developing a new perspective of validity typology for advancing validity in program evaluation including Enhance External Validity Enhance Precision by Reclassifying the Campbellian Typology Expand the Scope of the Typology The volume concludes with William R. Shadish's spirited rebuttal to earlier chapters. A collaborator with Don Campbell, Shadish provides a balance to the perspective of the issue with a clarification and defense of Campbell's work. This is the 129th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.
Download or read book Utilization Focused Evaluation written by Michael Quinn Patton and published by SAGE Publications. This book was released on 2008-06-18 with total page 689 pages. Available in PDF, EPUB and Kindle. Book excerpt: The Fourth Edition of the bestselling Utilization-Focused Evaluation provides expert, detailed advice on conducting program evaluations from one of leading experts. Chock full of useful pedagogy—including a unique utilization-focused evaluation checklist—this book presents Michael Quinn Patton's distinctive opinions based on more than thirty years of experience. Key Features of the Fourth Edition Provides thoroughly updated materials including more international content; new references; new exhibits and sidebars; and new examples, stories, and cartoons Includes follow-up exercises at the end of each chapter Features a utilization-focused evaluation checklist Gives greater emphasis on mixed methods Analyzes the pluses and minuses of the increased emphasis on accountability and performance measurement in government at all levels Details the explosion of international evaluation Intended Audience Both theoretical and practical, this core text is an essential resource for students enrolled in Program Evaluation courses in a variety of disciplines—including public administration, government, social sciences, education, and management. Practitioners will also find this text invaluable.
Download or read book The SAGE Handbook of Applied Social Research Methods written by Leonard Bickman and published by SAGE. This book was released on 2009 with total page 681 pages. Available in PDF, EPUB and Kindle. Book excerpt: This Handbook addresses the methodology of social science research and the appropriate use of different methods.
Download or read book Multidisciplinary Methods in Educational Technology Research and Development written by Justus J. Randolph and published by HAMK Press/Justus Randolph. This book was released on 2008 with total page 123 pages. Available in PDF, EPUB and Kindle. Book excerpt: Over the past thirty years, there has been much dialogue, and debate, about the conduct of educational technology research and development. In this brief volume, the author helps clarify that dialogue by theoretically and empirically charting the research methods used in the field and provides much practical information on how to conduct educational technology research. Within this text, readers can expect to find answers to the following questions: (a) What are the methodological factors that need to be taken into consideration when designing and conducting educational technology research? (b) What types of research questions do educational technology researchers tend to ask? (c) How do educational technology researchers tend to conduct research? (d) What approaches do they use? What variables do they examine? What types of measures do they use? How do they report their research? (d) How can the state of educational technology research be improved? In addition to answering the questions above, the author, a research methodologist, provides practical information on how to conduct educational technology research--from formulating research questions, to collecting and analyzing data, to writing up the research reports--in each of the major quantitative and qualitative traditions. Unlike other books of this kind, the author addresses some of research approaches used less commonly in educational technology research, but which, nonetheless, have much potential for creating new insights about educational phenomena--approaches such as single-participant research, quantitative content analysis, ethnography, narrative research, phenomenology, and others. "Multidisciplinary Methods in Educational Technology Research and Development" is an excellent text for educational technology research methods courses, a useful guide for those conducting (or supervising) research, and a rich source of empirical information on the art and science of educational technology research. Key Questions in Educational Technology Methods Choice are appended. (Contains 13 figures and 13 tables.) [This publication was produced by the HAMK University of Applied Sciences.].
Download or read book The SAGE International Handbook of Educational Evaluation written by Katherine Ryan and published by SAGE Publications. This book was released on 2009-07-15 with total page 609 pages. Available in PDF, EPUB and Kindle. Book excerpt: Bringing together the expertise of top evaluation leaders from around the world, The SAGE International Handbook of Educational Evaluation addresses methods and applications in the field, particularly as they relate to policy- and decision-making in an era of globalization. The comprehensive collection of articles in the Handbook compels readers to consider globalization influences on educational evaluation within distinct genres or families of evaluation approaches. Key Features Discusses substantive issues surrounding globalization, and its implication for educational policy and practice and ultimately evaluation; Includes state-of-the-art theory chapters and method chapters within scientific, accountability-oriented, learning-oriented, and political genres of evaluation approaches; Provides real-world case exemplar chapters to illustrate core concepts within genres; Extends dialogue on controversial topics and contemporary educational evaluation tensions in the context of globalization; Summarizes, by means of an integration chapter, the issues, tensions and dilemmas confronting educational evaluators in an era of globalization. Serving as a state-of-the-art resource on educational evaluation, this volume is designed for graduate students, evaluation scholars and researchers and professional evaluation practitioners with an interest in educational program and policy evaluation.
Download or read book Evaluating and Valuing in Social Research written by Thomas A. Schwandt and published by Guilford Publications. This book was released on 2021-08-04 with total page 274 pages. Available in PDF, EPUB and Kindle. Book excerpt: Much applied research takes place as if complex social problems--and evaluations of interventions to address them--can be dealt with in a purely technical way. In contrast, this groundbreaking book offers an alternative approach that incorporates sustained, systematic reflection about researchers' values, what values research promotes, how decisions about what to value are made and by whom, and how judging the value of social interventions takes place. The authors offer practical and conceptual guidance to help researchers engage meaningfully with value conflicts and refine their capacity to engage in deliberative argumentation. Pedagogical features include a detailed evaluation case, "Bridge to Practice" exercises and annotated resources in most chapters, and an end-of-book glossary. Winner (Third Place)--American Journal of Nursing Book of the Year Award, Community/Public Health Category
Download or read book Evidence based Practice Modernising the Knowledge Base of Social Work written by Hans-Uwe Otto and published by Verlag Barbara Budrich. This book was released on 2009-06-04 with total page 254 pages. Available in PDF, EPUB and Kindle. Book excerpt: The quest to create an evidence-based Social Work practice is emerging strongly in different fields of Social Work and social policy. In this volume internationally renowned proponents and opponents of this approach deliver profound analyses of the meaning and implications of an evidence based perspective which clearly challenges the nature of the knowledge base of the established Social Work practice and apparently reevaluates and reshapes the character of welfare professionalism. Aus dem Inhalt: What Knowledge? Evidence-based Practice, Profession and Users Organising, Measuring and Implementing Evidence Towards an Evidence-based Professionalism
Download or read book Context A Framework for Its Influence on Evaluation Practice written by Debra J. Rog and published by John Wiley & Sons. This book was released on 2012-09-06 with total page 140 pages. Available in PDF, EPUB and Kindle. Book excerpt: Context is a force in evaluation. It shapes our practice, influencing how we approach and design our studies, how we carry them out, and how we report our findings. Context also moderates and mediates the outcomes of the programs and policies we evaluate. This issue focuses squarely on the role that context plays in practice and illuminates its effect on the implementation and outcomes of programs. Exploring the ways in which attending to context may improve the quality of evaluation practice, the contributions span theory, methods, and practice in an effort to move to a more comprehensive conceptualization of context that can guide our work. It: Provides an historical and theoretical view of evaluators’ treatment of context Illustrates how context has influenced evaluation practice Presents a five-area framework for guiding a contextual analysis of evaluations Introduces “context assessment,” which provides a means of integrating context and its implications within the important stages of evaluation. This is the 135th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.
Download or read book Handbook of Research on Educational Communications and Technology written by J. Michael Spector and published by Springer Science & Business Media. This book was released on 2013-07-03 with total page 1005 pages. Available in PDF, EPUB and Kindle. Book excerpt: The 4th edition of the Handbook of Research on Educational Communications and Technology expands upon the previous 3 versions, providing a comprehensive update on research pertaining to new and emerging educational technologies. Chapters that are no longer pertinent have been eliminated in this edition, with most chapters being completely rewritten, expanded, and updated Additionally, new chapters pertaining to research methodologies in educational technology have been added due to expressed reader interest. Each chapter now contains an extensive literature review, documenting and explaining the most recent, outstanding research, including major findings and methodologies employed. The Handbook authors continue to be international leaders in their respective fields; the list is cross disciplinary by design and great effort was taken to invite authors outside of the traditional instructional design and technology community.
Download or read book What Counts as Credible Evidence in Applied Research and Evaluation Practice written by Stewart I. Donaldson and published by SAGE. This book was released on 2009 with total page 289 pages. Available in PDF, EPUB and Kindle. Book excerpt: "What Counts as Credible Evidence in Applied Research and Evaluation Practice? is the first book of its kind to define and place into greater perspective the meaning of evidence for evaluation professionals and applied researchers. Editors Stewart I. Donaldson, Christina A. Christie, and Melvin M. Mark provide observations about the diversity and changing nature of credible evidence, include lessons from their own applied research and evaluation practice, and suggest ways in which practitioners might address the key issues and challenges of collecting credible evidence." "This book is appropriate for a wide range of courses, including Introduction to Evaluation Research, Research Methods, Evaluation Practice, Program Evaluation, Program Development and Evaluation, and evaluation courses in Social Work, Education, Public Health, and Public Policy."--BOOK JACKET.
Download or read book Consequences of No Child Left Behind on Educational Evaluation written by Tiffany Berry and published by Jossey-Bass. This book was released on 2008-04-04 with total page 124 pages. Available in PDF, EPUB and Kindle. Book excerpt: This volume explores how key aspects of No Child Left Behind (NCLB) have transformed the landscape of educational evaluation, and ultimately how this process is redefining what evaluation is within the educational evaluation community. In their chapters, the authors examine case studies, critical commentaries, and technical information related to the nexus between evaluation and NCLB. The volume is intended to stimulate conversation around fundamental issues in the discipline of evaluation, including blurring the lines among research, evaluation, and assessment; prioritizing summative evaluations over formative; using questions to drive research design rather than the reverse; balancing accountability requirements with other stakeholder needs; exploring the role of evaluation capacity building in an institutional setting; understanding the availability and appropriate use of assessment data; and defining learning outcomes that are based on standardized test scores alone. Evaluative activities have become integrated into the fabric of NCLB primarily through two core aspects of the legislation: responding to accountability systems and implementing scientifically based research. One plausible consequence of this close integration is that the purpose, design, and practice of evaluation may actually be transformed by this legislation. This volume describes these transformative influences and then explores the potential consequences. This is the 117th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.
Download or read book Promoting Value in the Public Interest Informing Policies for Judging Value in Evaluation written by George Julnes and published by John Wiley & Sons. This book was released on 2012-03-16 with total page 146 pages. Available in PDF, EPUB and Kindle. Book excerpt: Do you make evidence-based decisions when designing and conducting evaluations, and use methods validated by experience? Because of the growing importance of evidence-based decision-making for improving programs and policies, this issue examines methods selection: Which is better? How can one be improved? Are the results of the project worth the resources expended? and how that leads to confidence in value-based conclusions. It presents a constructive dialogue on valuing in evaluation, with the goal of developing a pragmatic approach for guiding method choice and for promoting methodology policies that support multiple approaches to valuation being employed in context-appropriate ways so as to serve the public interest. This is the 133rd volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.
