Download or read book Test Fairness in the New Generation of Large Scale Assessment written by Hong Jiao and published by IAP. This book was released on 2017-06-01 with total page 239 pages. Available in PDF, EPUB and Kindle. Book excerpt: The new generation of tests is faced with new challenges. In the K?12 setting, the new learning targets are intended to assess higher?order thinking skills and prepare students to be ready for college and career and to keep American students competitive with their international peers. In addition, the new generation of state tests requires the use of technology in item delivery and embedding assessment in real?world, authentic, situations. It further requires accurate assessment of students at all ability levels. One of the most important questions is how to maintain test fairness in the new assessments with technology innovative items and technology delivered tests. In the traditional testing programs such as licensure and certification tests and college admission tests, test fairness has constantly been a key psychometric issue in test development and this continues to be the case with the national testing programs. As test fairness needs to be addressed throughout the whole process of test development, experts from state, admission, and licensure tests will address test fairness challenges in the new generation assessment. The book chapters clarify misconceptions of test fairness including the use of admission test results in cohort comparison, the use of international assessment results in trend evaluation, whether standardization and fairness necessarily mean uniformity when test?takers have different cultural backgrounds, and whether standardization can insure fairness. More technically, chapters also address issues related to how compromised items and test fairness are related to classification decisions, how accessibility in item development and accommodation could be mingled with technology, how to assess special populations with dyslexia, using Blinder?Oaxaca Decomposition for differential item functioning detection, and differential feature functioning in automated scoring. Overall, this book addresses test fairness issues in state assessment, college admission testing, international assessment, and licensure tests. Fairness is discussed in the context of culture and special populations. Further, fairness related to performance assessment and automated scoring is a focus as well. This book provides a very good source of information related to test fairness issues in test development in the new generation of assessment where technology is highly involved.

Download or read book Fairness in Educational and Psychological Testing Examining Theoretical Research Practice and Policy Implications of the 2014 Standards written by Jessica L. Jonson and published by American Educational Research Association. This book was released on 2022-06-01 with total page 466 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book examines scholarship, best practice methodologies, and examples of policy and practice from various professional fields in education and psychology to illuminate the elevated emphasis on test fairness in the 2014 Standards for Educational and Psychological Testing. Together, the chapters provide a survey of critical and current issues with a view to broadening and contextualizing the fairness guidelines for different types of tests, test takers, and testing contexts. Researchers and practitioners from school psychology, clinical/counseling psychology, industrial/organizational psychology, and education will find the content useful in thinking more acutely about fairness in testing in their work. The book also has chapters that address implications for policy makers, and, in some cases, the public. These discussions are offered as a starting point for future scholarship on the theoretical, empirical, and applied aspects of fairness in testing particularly given the ever-increasing importance of addressing equity in testing.

Download or read book High Stakes Testing in Education written by Theo J.H.M Eggen and published by Routledge. This book was released on 2015-10-14 with total page 186 pages. Available in PDF, EPUB and Kindle. Book excerpt: High-stakes educational testing is a global phenomenon which is increasing in both scale and importance. Assessments are high-stakes when there are serious consequences for one or more stakeholders. Historically, tests have largely been used for selection or for providing a ‘licence to practise’, making them high-stakes for the test takers. Testing is now also used for the purposes of improving standards of teaching and learning and of holding schools accountable for their students’ results. These tests then become high-stakes for teachers and schools, especially when they have to meet externally imposed targets. More recent has been the emergence of international comparative testing, which has become high-stakes for governments and policy makers as their education systems are judged in relation to the performances of other countries. In this book we draw on research which examines each of these uses of high-stakes testing. The articles evaluate the impact of such assessments and explore the issues of value and fairness which they raise. To underline the international appeal of high-stakes testing the studies are drawn from Australia, Africa, the Caribbean, Europe, former Soviet republics and North America. Collectively they illustrate the power of high-stakes assessment in shaping, for better or for worse, policy making and schooling. This book was originally published as a special issue of Assessment in Education: Principles, Policy & Practice.

Download or read book Classroom Assessment and Educational Measurement written by Susan M. Brookhart and published by Routledge. This book was released on 2019-07-04 with total page 297 pages. Available in PDF, EPUB and Kindle. Book excerpt: Classroom Assessment and Educational Measurement explores the ways in which the theory and practice of both educational measurement and the assessment of student learning in classroom settings mutually inform one another. Chapters by assessment and measurement experts consider the nature of classroom assessment information, from student achievement to affective and socio-emotional attributes; how teachers interpret and work with assessment results; and emerging issues in assessment such as digital technologies and diversity/inclusion. This book uniquely considers the limitations of applying large-scale educational measurement theory to classroom assessment and the adaptations necessary to make this transfer useful. Researchers, graduate students, industry professionals, and policymakers will come away with an essential understanding of how the classroom assessment context is essential to broadening contemporary educational measurement perspectives. The Open Access version of this book, available at http://www.taylorfrancis.com, has been made available under a Creative Commons Attribution-Non Commercial-No Derivatives 4.0 license.

Download or read book Handbook on Measurement Assessment and Evaluation in Higher Education written by Charles Secolsky and published by Routledge. This book was released on 2017-07-31 with total page 738 pages. Available in PDF, EPUB and Kindle. Book excerpt: In this valuable resource, well-known scholars present a detailed understanding of contemporary theories and practices in the fields of measurement, assessment, and evaluation, with guidance on how to apply these ideas for the benefit of students and institutions. Bringing together terminology, analytical perspectives, and methodological advances, this second edition facilitates informed decision-making while connecting the latest thinking in these methodological areas with actual practice in higher education. This research handbook provides higher education administrators, student affairs personnel, institutional researchers, and faculty with an integrated volume of theory, method, and application.

Download or read book Assessing Model Based Reasoning using Evidence Centered Design written by Robert J Mislevy and published by Springer. This book was released on 2017-07-25 with total page 130 pages. Available in PDF, EPUB and Kindle. Book excerpt: This Springer Brief provides theory, practical guidance, and support tools to help designers create complex, valid assessment tasks for hard-to-measure, yet crucial, science education standards. Understanding, exploring, and interacting with the world through models characterizes science in all its branches and at all levels of education. Model-based reasoning is central to science education and thus science assessment. Current interest in developing and using models has increased with the release of the Next Generation Science Standards, which identified this as one of the eight practices of science and engineering. However, the interactive, complex, and often technology-based tasks that are needed to assess model-based reasoning in its fullest forms are difficult to develop. Building on research in assessment, science education, and learning science, this Brief describes a suite of design patterns that can help assessment designers, researchers, and teachers create tasks for assessing aspects of model-based reasoning: Model Formation, Model Use, Model Elaboration, Model Articulation, Model Evaluation, Model Revision, and Model-Based Inquiry. Each design pattern lays out considerations concerning targeted knowledge and ways of capturing and evaluating students’ work. These design patterns are available at http://design-drk.padi.sri.com/padi/do/NodeAction?state=listNodes&NODE_TYPE=PARADIGM_TYPE. The ideas are illustrated with examples from existing assessments and the research literature.

Download or read book Handbook of Accessible Instruction and Testing Practices written by Stephen N. Elliott and published by Springer. This book was released on 2018-03-08 with total page 276 pages. Available in PDF, EPUB and Kindle. Book excerpt: The Second Edition of this handbook provides comprehensive coverage of the concept of accessibility and its application to the design and implementation of instruction and tests with all students. It updates and expands on its original contents and responds to the increasing demand for research-based evidence of accessible instruction and testing practices from the professional community. Chapters explore how outcomes are affected when essential features or components of instructional materials and tests are not accessible to any portion of the student population. The handbook addresses the new set of Standards for Educational and Psychological Testing that was published in 2014 as well as requirements for a high level of access for all interim and summative tests by national testing consortiums. In addition, the handbook describes how the Center for Applied Special Technology (CAST) has continued to advance Universal Design for Learning (UDL) principles in mainstream education with teachers of all types of students, not just students with disabilities. Topics featured in this text include: A summary of U.S. policies that support inclusive assessment for students with disabilities. An overview of international policies that support inclusive assessments. Designing, developing, and implementing an accessible computer-based national assessment system. Universal Design for Learning (UDL) principles and the future of assessment. Recent advancements in the accessibility of digitally delivered educational assessments. The Handbook of Accessible Instruction and Testing Practices, Second Edition is an essential reference for researchers, practitioners, and graduate students in education and allied disciplines, including child and school psychology; assessment, testing and evaluation; social work; and education policy and politics.

Download or read book Data Analytics and Psychometrics written by Hong Jiao and published by IAP. This book was released on 2018-12-01 with total page 248 pages. Available in PDF, EPUB and Kindle. Book excerpt: The general theme of this book is to encourage the use of relevant methodology in data mining which is or could be applied to the interplay of education, statistics and computer science to solve psychometric issues and challenges in the new generation of assessments. In addition to item response data, other data collected in the process of assessment and learning will be utilized to help solve psychometric challenges and facilitate learning and other educational applications. Process data include those collected or available for collection during the process of assessment and instructional phase such as responding sequence data, log files, the use of help features, the content of web searches, etc. Some book chapters present the general exploration of process data in large-scale assessment. Further, other chapters also address how to integrate psychometrics and learning analytics in assessment and survey, how to use data mining techniques for security and cheating detection, how to use more assessment results to facilitate student’s learning and guide teacher’s instructional efforts. The book includes both theoretical and methodological presentations that might guide the future in this area, as well as illustrations of efforts to implement big data analytics that might be instructive to those in the field of learning and psychometrics. The context of the effort is diverse, including K-12, higher education, financial planning, and survey utilization. It is hoped that readers can learn from different disciplines, especially those who are specialized in assessment, would be critical to expand the ideas of what we can do with data analytics for informing assessment practices.

Download or read book Sociocognitive Foundations of Educational Measurement written by Robert J. Mislevy and published by Routledge. This book was released on 2018-04-09 with total page 438 pages. Available in PDF, EPUB and Kindle. Book excerpt: Several key developments challenge the field of educational measurement today: demands for tests at larger scales with higher stakes, an improved understanding of how people develop capabilities, and new technologies for interactive digital assessments. Sociocognitive Foundations of Educational Measurement integrates new developments in educational measurement and educational psychology in order to provide researchers, testing professionals, and students with an innovative sociocognitive perspective on assessment. This comprehensive volume begins with a broad explanation of the sociocognitive perspective and the foundations of assessment, then provides a series of focused applications to major topics such as assessment arguments, validity, fairness, interactive assessment, and a conception of "measurement" in educational assessment. Classical test theory, item response theory, categorical models, mixture models, cognitive diagnosis models, and Bayesian networks are explored from the resulting perspective. Ideal for specialists in these areas, graduate students, developers, and scholars in both educational measurement and fields that contribute to a sociocognitive perspective, this book consolidates nearly a decade of research into a fresh perspective on educational measurement.

Download or read book Technology Enhanced Innovative Assessment written by Hong Jiao and published by IAP. This book was released on 2017-11-01 with total page 307 pages. Available in PDF, EPUB and Kindle. Book excerpt: Assessment innovation tied to technology is greatly needed in a wide variety of assessment applications. This book adopts an interdisciplinary perspective to learn from advances in developing technology enhanced innovative assessments from multiple fields. The book chapters address the development of virtual assessments including game?based assessment, simulation?based assessment, and narrative based assessment as well as how simulation and game based assessments serve both formative and summative purposes. Further, chapters address the critical challenge of integrating assessment directly into the learning process so that teacher effectiveness and student learning can be enhanced. Two chapters specifically address the psychometric challenges related to innovative items. One chapter talks about evaluating the psychometric properties of innovative items while the other chapter presents a new psychometric model for calibrating innovative items embedded in multiple contexts. In addition, validity issues are addressed related to technology enhanced innovative assessment. It is hoped that the book provides readers with rich and useful information about the development of several types of virtual assessments from multiple perspectives. The authors include experts from industry where innovative items have been used for many years and experts from research institutes and universities who have done pioneering work related to developing innovative items with formative applications to facilitate learning. In addition, expert advice has been provided on validating such work.

Download or read book Fairness Issues in Educational Assessment written by Hossein Karami and published by Routledge. This book was released on 2018-02-02 with total page 176 pages. Available in PDF, EPUB and Kindle. Book excerpt: Fairness and ethicality have been at the center of the debates on the appropriate use of educational tests since the 1960s. Particularly in high-stakes contexts, it is clear that fairness should be a major concern to both the test developers, and to those being tested, given that the fairness of a test is so intertwined with its validity. Fairness Issues in Educational Assessment aims to shed more light on the issue and bring to sight some of the ways in which test fairness can be addressed. The contributions, written by some of the most prominent figures in educational assessment, address both theoretical and practical aspects of test fairness. The wealth of ideas presented here will be valuable to novice researchers and help them appreciate both the joy and complexity of conducting fair educational measurement. This book was originally published as a special issue of Educational Research and Evaluation.

Download or read book Machine Learning Natural Language Processing and Psychometrics written by Hong Jiao and published by IAP. This book was released on 2024-04-01 with total page 242 pages. Available in PDF, EPUB and Kindle. Book excerpt: With the exponential increase of digital assessment, different types of data in addition to item responses become available in the measurement process. One of the salient features in digital assessment is that process data can be easily collected. This non-conventional structured or unstructured data source may bring new perspectives to better understand the assessment products or accuracy and the process how an item product was attained. The analysis of the conventional and non-conventional assessment data calls for more methodology other than the latent trait modeling. Natural language processing (NLP) methods and machine learning algorithms have been successfully applied in automated scoring. It has been explored in providing diagnostic feedback to test-takers in writing assessment. Recently, machine learning algorithms have been explored for cheating detection and cognitive diagnosis. When the measurement field promote the use of assessment data to provide feedback to improve teaching and learning, it is the right time to explore new methodology and explore the value added from other data sources. This book presents the use cases of machine learning and NLP in improving the assessment theory and practices in high-stakes summative assessment, learning, and instruction. More specifically, experts from the field addressed the topics related to automated item generations, automated scoring, automated feedback in writing, explainability of automated scoring, equating, cheating and alarming response detection, adaptive testing, and applications in science assessment. This book demonstrates the utility of machine learning and NLP in assessment design and psychometric analysis.

Download or read book Automated Essay Scoring written by Beata Beigman Klebanov and published by Springer Nature. This book was released on 2022-05-31 with total page 294 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book discusses the state of the art of automated essay scoring, its challenges and its potential. One of the earliest applications of artificial intelligence to language data (along with machine translation and speech recognition), automated essay scoring has evolved to become both a revenue-generating industry and a vast field of research, with many subfields and connections to other NLP tasks. In this book, we review the developments in this field against the backdrop of Elias Page's seminal 1966 paper titled "The Imminence of Grading Essays by Computer." Part 1 establishes what automated essay scoring is about, why it exists, where the technology stands, and what are some of the main issues. In Part 2, the book presents guided exercises to illustrate how one would go about building and evaluating a simple automated scoring system, while Part 3 offers readers a survey of the literature on different types of scoring models, the aspects of essay quality studied in prior research, and the implementation and evaluation of a scoring engine. Part 4 offers a broader view of the field inclusive of some neighboring areas, and Part \ref{part5} closes with summary and discussion. This book grew out of a week-long course on automated evaluation of language production at the North American Summer School for Logic, Language, and Information (NASSLLI), attended by advanced undergraduates and early-stage graduate students from a variety of disciplines. Teachers of natural language processing, in particular, will find that the book offers a useful foundation for a supplemental module on automated scoring. Professionals and students in linguistics, applied linguistics, educational technology, and other related disciplines will also find the material here useful.

Download or read book Handbook of Automated Scoring written by Duanli Yan and published by CRC Press. This book was released on 2020-02-26 with total page 581 pages. Available in PDF, EPUB and Kindle. Book excerpt: "Automated scoring engines [...] require a careful balancing of the contributions of technology, NLP, psychometrics, artificial intelligence, and the learning sciences. The present handbook is evidence that the theories, methodologies, and underlying technology that surround automated scoring have reached maturity, and that there is a growing acceptance of these technologies among experts and the public." From the Foreword by Alina von Davier, ACTNext Senior Vice President Handbook of Automated Scoring: Theory into Practice provides a scientifically grounded overview of the key research efforts required to move automated scoring systems into operational practice. It examines the field of automated scoring from the viewpoint of related scientific fields serving as its foundation, the latest developments of computational methodologies utilized in automated scoring, and several large-scale real-world applications of automated scoring for complex learning and assessment systems. The book is organized into three parts that cover (1) theoretical foundations, (2) operational methodologies, and (3) practical illustrations, each with a commentary. In addition, the handbook includes an introduction and synthesis chapter as well as a cross-chapter glossary.

Download or read book Encyclopedia of Educational Philosophy and Theory written by Michael A. Peters and published by Springer. This book was released on 2017-09-18 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: This encyclopaedia is a dynamic reference and study place for students, teachers, researchers and professionals in the field of education, philosophy and social sciences, offering both short and long entries on topics of theoretical and practical interest in educational theory and philosophy by authoritative world scholars representing the full ambit of education as a rapidly expanding global field of knowledge and expertise. This is an encyclopaedia that is truly global and while focused mainly on the Western tradition is also respectful and representative of other knowledge traditions. It professes to understand the globalization of knowledge. It is unique in the sense that it is based on theoretical orientations and approaches to the main concepts and theories in education, drawing on the range of disciplines in the social sciences. The encyclopaedia privileges the "theory of practice", recognizing that education as a discipline and activity is mainly a set of professional practices that inherently involves questions of power and expertise for the transmission, socialization and critical debate of competing norms and values.

Download or read book Designing Context Rich Learning by Extending Reality written by Braun, Jason and published by IGI Global. This book was released on 2023-05-03 with total page 383 pages. Available in PDF, EPUB and Kindle. Book excerpt: Simulations, games, and real or virtual apprenticeships are the kinds of context-rich learning environments that leverage the power of episodic memory, boost student motivation, and create the conditions that make learning transfer more likely. Context-rich learning embodies the answer to the question, “Why do we need to learn this?” Many students, especially those who have dyslexia or otherwise neurodivergent brains, require the kind of context that is lacking in education. Designing Context-Rich Learning by Extending Reality is a collection of research and readings on the context-rich learning approach that examines the aspects of design, delivery, and assessments. The book proposes novel approaches to designing and delivering context-rich learning across all disciplines. Covering topics such as learning experiences, sustainable development, and user experience design, this premier reference source is a valuable resource of inspiration to learning and training facilitators, instructional designers, assessment developers, instructional technologists, psychometricians, educators and administrators of both higher and K-12 education, pre-service teachers, teacher educators, researchers, and academicians.

Download or read book Developing Assessments for the Next Generation Science Standards written by National Research Council and published by National Academies Press. This book was released on 2014-05-29 with total page 288 pages. Available in PDF, EPUB and Kindle. Book excerpt: Assessments, understood as tools for tracking what and how well students have learned, play a critical role in the classroom. Developing Assessments for the Next Generation Science Standards develops an approach to science assessment to meet the vision of science education for the future as it has been elaborated in A Framework for K-12 Science Education (Framework) and Next Generation Science Standards (NGSS). These documents are brand new and the changes they call for are barely under way, but the new assessments will be needed as soon as states and districts begin the process of implementing the NGSS and changing their approach to science education. The new Framework and the NGSS are designed to guide educators in significantly altering the way K-12 science is taught. The Framework is aimed at making science education more closely resemble the way scientists actually work and think, and making instruction reflect research on learning that demonstrates the importance of building coherent understandings over time. It structures science education around three dimensions - the practices through which scientists and engineers do their work, the key crosscutting concepts that cut across disciplines, and the core ideas of the disciplines - and argues that they should be interwoven in every aspect of science education, building in sophistication as students progress through grades K-12. Developing Assessments for the Next Generation Science Standards recommends strategies for developing assessments that yield valid measures of student proficiency in science as described in the new Framework. This report reviews recent and current work in science assessment to determine which aspects of the Framework's vision can be assessed with available techniques and what additional research and development will be needed to support an assessment system that fully meets that vision. The report offers a systems approach to science assessment, in which a range of assessment strategies are designed to answer different kinds of questions with appropriate degrees of specificity and provide results that complement one another. Developing Assessments for the Next Generation Science Standards makes the case that a science assessment system that meets the Framework's vision should consist of assessments designed to support classroom instruction, assessments designed to monitor science learning on a broader scale, and indicators designed to track opportunity to learn. New standards for science education make clear that new modes of assessment designed to measure the integrated learning they promote are essential. The recommendations of this report will be key to making sure that the dramatic changes in curriculum and instruction signaled by Framework and the NGSS reduce inequities in science education and raise the level of science education for all students.