Download or read book Computerized Multistage Testing written by Duanli Yan and published by CRC Press. This book was released on 2016-04-19 with total page 532 pages. Available in PDF, EPUB and Kindle. Book excerpt: Unlike other forms of adaptive testing, multistage testing (MST) is highly suitable for testing educational achievement because it can be adapted to educational surveys and student testing. This volume provides the first unified source of information on the design, psychometrics, implementation, and operational use of MST. It shows how to apply theoretical statistical tools to testing in novel and useful ways. It also explains how to explicitly tie the assumptions made by each model to observable (or at least inferable) data conditions.
Download or read book PISA 2022 Technical Report written by OECD and published by OECD Publishing. This book was released on 2024-03-01 with total page 550 pages. Available in PDF, EPUB and Kindle. Book excerpt: This Technical Report has been prepared by those who implemented PISA during its 2022 cycle to provide transparency to these procedures and to the statistical and mathematical methods that underpin the comparability and validity of PISA 2022 results.
Download or read book Meeting the Challenges to Measurement in an Era of Accountability written by Henry Braun and published by Routledge. This book was released on 2016-01-29 with total page 437 pages. Available in PDF, EPUB and Kindle. Book excerpt: Under pressure and support from the federal government, states have increasingly turned to indicators based on student test scores to evaluate teachers and schools, as well as students themselves. The focus thus far has been on test scores in those subject areas where there is a sequence of consecutive tests, such as in mathematics or English/language arts with a focus on grades 4-8. Teachers in these subject areas, however, constitute less than thirty percent of the teacher workforce in a district. Comparatively little has been written about the measurement of achievement in the other grades and subjects. This volume seeks to remedy this imbalance by focusing on the assessment of student achievement in a broad range of grade levels and subject areas, with particular attention to their use in the evaluation of teachers and schools in all. It addresses traditional end-of-course tests, as well as alternative measures such as portfolios, exhibitions, and student learning objectives. In each case, issues related to design and development, psychometric considerations, and validity challenges are covered from both a generic and a content-specific perspective. The NCME Applications of Educational Measurement and Assessment series includes edited volumes designed to inform research-based applications of educational measurement and assessment. Edited by leading experts, these books are comprehensive and practical resources on the latest developments in the field. The Open Access version of this book, available at http://www.taylorfrancis.com, has been made available under a Creative Commons Attribution-Non Commercial-No Derivatives 4.0 license
Download or read book The SAGE Handbook of Quantitative Methodology for the Social Sciences written by David Kaplan and published by SAGE Publications. This book was released on 2004-06-21 with total page 529 pages. Available in PDF, EPUB and Kindle. Book excerpt: Click ′Additional Materials′ for downloadable samples "The 24 chapters in this Handbook span a wide range of topics, presenting the latest quantitative developments in scaling theory, measurement, categorical data analysis, multilevel models, latent variable models, and foundational issues. Each chapter reviews the historical context for the topic and then describes current work, including illustrative examples where appropriate. The level of presentation throughout the book is detailed enough to convey genuine understanding without overwhelming the reader with technical material. Ample references are given for readers who wish to pursue topics in more detail. The book will appeal to both researchers who wish to update their knowledge of specific quantitative methods, and students who wish to have an integrated survey of state-of- the-art quantitative methods." —Roger E. Millsap, Arizona State University "This handbook discusses important methodological tools and topics in quantitative methodology in easy to understand language. It is an exhaustive review of past and recent advances in each topic combined with a detailed discussion of examples and graphical illustrations. It will be an essential reference for social science researchers as an introduction to methods and quantitative concepts of great use." —Irini Moustaki, London School of Economics, U.K. "David Kaplan and SAGE Publications are to be congratulated on the development of a new handbook on quantitative methods for the social sciences. The Handbook is more than a set of methodologies, it is a journey. This methodological journey allows the reader to experience scaling, tests and measurement, and statistical methodologies applied to categorical, multilevel, and latent variables. The journey concludes with a number of philosophical issues of interest to researchers in the social sciences. The new Handbook is a must purchase." —Neil H. Timm, University of Pittsburgh The SAGE Handbook of Quantitative Methodology for the Social Sciences is the definitive reference for teachers, students, and researchers of quantitative methods in the social sciences, as it provides a comprehensive overview of the major techniques used in the field. The contributors, top methodologists and researchers, have written about their areas of expertise in ways that convey the utility of their respective techniques, but, where appropriate, they also offer a fair critique of these techniques. Relevance to real-world problems in the social sciences is an essential ingredient of each chapter and makes this an invaluable resource. The handbook is divided into six sections: • Scaling • Testing and Measurement • Models for Categorical Data • Models for Multilevel Data • Models for Latent Variables • Foundational Issues These sections, comprising twenty-four chapters, address topics in scaling and measurement, advances in statistical modeling methodologies, and broad philosophical themes and foundational issues that transcend many of the quantitative methodologies covered in the book. The Handbook is indispensable to the teaching, study, and research of quantitative methods and will enable readers to develop a level of understanding of statistical techniques commensurate with the most recent, state-of-the-art, theoretical developments in the field. It provides the foundations for quantitative research, with cutting-edge insights on the effectiveness of each method, depending on the data and distinct research situation.
Download or read book Resources in Education written by and published by . This book was released on 1998 with total page 384 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Computerized Adaptive and Multistage Testing with R written by David Magis and published by Springer. This book was released on 2017-11-23 with total page 183 pages. Available in PDF, EPUB and Kindle. Book excerpt: The goal of this guide and manual is to provide a practical and brief overview of the theory on computerized adaptive testing (CAT) and multistage testing (MST) and to illustrate the methodologies and applications using R open source language and several data examples. Implementation relies on the R packages catR and mstR that have been already or are being developed by the first author (with the team) and that include some of the newest research algorithms on the topic. The book covers many topics along with the R-code: the basics of R, theoretical overview of CAT and MST, CAT designs, CAT assembly methodologies, CAT simulations, catR package, CAT applications, MST designs, IRT-based MST methodologies, tree-based MST methodologies, mstR package, and MST applications. CAT has been used in many large-scale assessments over recent decades, and MST has become very popular in recent years. R open source language also has become one of the most useful tools for applications in almost all fields, including business and education. Though very useful and popular, R is a difficult language to learn, with a steep learning curve. Given the obvious need for but with the complex implementation of CAT and MST, it is very difficult for users to simulate or implement CAT and MST. Until this manual, there has been no book for users to design and use CAT and MST easily and without expense; i.e., by using the free R software. All examples and illustrations are generated using predefined scripts in R language, available for free download from the book's website.
Download or read book Integrating Timing Considerations to Improve Testing Practices written by Melissa J. Margolis and published by Routledge. This book was released on 2020-06-03 with total page 200 pages. Available in PDF, EPUB and Kindle. Book excerpt: Integrating Timing Considerations to Improve Testing Practices synthesizes a wealth of theory and research on time issues in assessment into actionable advice for test development, administration, and scoring. One of the major advantages of computer-based testing is the capability to passively record test-taking metadata—including how examinees use time and how time affects testing outcomes. This has opened many questions for testing administrators. Is there a trade-off between speed and accuracy in test taking? What considerations should influence equitable decisions about extended-time accommodations? How can test administrators use timing data to balance the costs and resulting validity of tests administered at commercial testing centers? In this comprehensive volume, experts in the field discuss the impact of timing considerations, constraints, and policies on valid score interpretations; administrative accommodations, test construction, and examinees’ experiences and behaviors; and how to implement the findings into practice. These 12 chapters provide invaluable resources for testing professionals to better understand the inextricable links between effective time allocation and the purposes of high-stakes testing. The Open Access version of this book, available at http://www.taylorfrancis.com, has been made available under a Creative Commons Attribution-Non Commercial-No Derivatives 4.0 license.
Download or read book Item Response Theory written by Ronald K. Hambleton and published by Springer Science & Business Media. This book was released on 2013-11-11 with total page 340 pages. Available in PDF, EPUB and Kindle. Book excerpt: In the decade of the 1970s, item response theory became the dominant topic for study by measurement specialists. But, the genesis of item response theory (IRT) can be traced back to the mid-thirties and early forties. In fact, the term "Item Characteristic Curve," which is one of the main IRT concepts, can be attributed to Ledyard Tucker in 1946. Despite these early research efforts, interest in item response theory lay dormant until the late 1960s and took a backseat to the emerging development of strong true score theory. While true score theory developed rapidly and drew the attention of leading psychometricians, the problems and weaknesses inherent in its formulation began to raise concerns. Such problems as the lack of invariance of item parameters across examinee groups, and the inadequacy of classical test procedures to detect item bias or to provide a sound basis for measurement in "tailored testing," gave rise to a resurgence of interest in item response theory. Impetus for the development of item response theory as we now know it was provided by Frederic M. Lord through his pioneering works (Lord, 1952; 1953a, 1953b). The progress in the fifties was painstakingly slow due to the mathematical complexity of the topic and the nonexistence of computer programs.
Download or read book Computer Based Testing written by Craig N. Mills and published by Routledge. This book was released on 2005-04-11 with total page 339 pages. Available in PDF, EPUB and Kindle. Book excerpt: Although computer-based tests (CBT) have been administered for many years, improvements in the speed and power of computers coupled with reductions in their cost have made large-scale computer delivery of tests increasingly feasible. CBT is now a common form of test delivery for licensure, certification, and admissions tests. Many large-scale, high-stakes testing programs have introduced CBT either as an option or as the sole means of test delivery. Although this movement to CBT has, to a great extent, been successful, it has not been without problems. Advances in psychometrics are required to ensure that those who rely on test results can have at least the same confidence in CBTs as they have in traditional forms of assessment. This volume stems from an ETS-sponsored colloquium in which more than 200 measurement professionals from eight countries and 29 states convened to assess the current and future status of CBT. The formal agenda for the colloquium was divided into three major segments: Test Models, Test Administration, and Test Analysis and Scoring. Each segment consisted of several presentations followed by comments from noted psychometricians and a break-out session in which presenters and discussants identified important issues and established priorities for a CBT research agenda. This volume contains the papers presented at the colloquium, the discussant remarks based on those papers, and the research agenda that was generated from the break-out sessions. Computer-Based Testing: Building the Foundation for Future Assessments is must reading for professionals, scholars, and advanced students working in the testing field, as well as people in the information technology field who have an interest in testing.
Download or read book Assessing Students in the Margin written by Michael Russell and published by IAP. This book was released on 2011-02-01 with total page 493 pages. Available in PDF, EPUB and Kindle. Book excerpt: The importance of student assessment, particularly for summative purposes, has increased greatly over the past thirty years. At the same time, emphasis on including all students in assessment programs has also increased. Assessment programs, whether they are large-scale, district-based, or teacher developed, have traditionally attempted to assess students using a single instrument administered to students under the same conditions. Educators and test developers, however, are increasingly acknowledging that this practice does not result in valid information, inferences, and decisions for all students. This problem is particularly true for students in the margins, whose characteristics and needs differ from what the public thinks of as the general population of students. Increasingly, educators, educational leaders, and test developers are seeking strategies, techniques, policies, and guidelines for assessing students for whom standard assessment instruments do not function well. Whether used for high-stakes decisions or classroom-based formative decisions, the most critical element of any educational assessment is validity. Developing and administering assessment instruments that provide valid measures and allow for valid inferences and decisions for all groups of students presents a major challenge for today’s assessment programs. Over the past few decades, several national policies have sparked research and development efforts that aim to increase test validity for students in the margins. This book explores recent developments and efforts in three important areas. The first section focuses on strategies for improving test validity through the provision of test accommodations. The second section focuses on alternate and modified assessments. Federal policies now allow testing programs to develop and administer alternate assessments for students who have not been exposed to grade-level content, and thus are not expected to demonstrate proficiency on grade-level assessments. A separate policy allows testing programs to develop modified assessments that will provided more useful information about achievement for a small percentage of students who are exposed to grade-level content but for whom the standard form of the grade-level test does not provide a valid measure of achievement. These policies are complex and can be confusing for educators who are not familiar with their details. The chapters in the second section unpack these policies and explore the implications these policies have for test design. The third and final section of the book examines how principles of Universal Design can be applied to improve test validity for all students. Collectively, this volume presents a comprehensive examination of the several issues that present challenges for assessing the achievement of all students. While our understanding of how to overcome these challenges continues to evolve, the lessons, strategies, and avenues for future research explored in this book empower educators, test developers, and testing programs with a deeper understanding of how we can improve assessments for students in the margins.
Download or read book The SAGE Encyclopedia of Research Design written by Bruce B. Frey and published by SAGE Publications. This book was released on 2022-01-27 with total page 3889 pages. Available in PDF, EPUB and Kindle. Book excerpt: The SAGE Encyclopedia of Research Design maps out how one makes decisions about research design, interprets data, and draws valid inferences, undertakes research projects in an ethical manner, and evaluates experimental design strategies and results. From A-to-Z, this four-volume work covers the spectrum of research design strategies and topics including, among other things: fundamental research design principles, ethics in the research process, quantitative versus qualitative and mixed-method designs, completely randomized designs, multiple comparison tests, diagnosing agreement between data and models, fundamental assumptions in analysis of variance, factorial treatment designs, complete and incomplete block designs, Latin square and related designs, hierarchical designs, response surface designs, split-plot designs, repeated measures designs, crossover designs, analysis of covariance, statistical software packages, and much more. Research design, with its statistical underpinnings, can be especially daunting for students and novice researchers. At its heart, research design might be described simply as a formalized approach toward problem solving, thinking, and acquiring knowledge, the success of which depends upon clearly defined objectives and appropriate choice of statistical design and analysis to meet those objectives. The SAGE Encyclopedia of Research Design will assist students and researchers with their work while providing vital information on research strategies.
Download or read book Computerized Adaptive Testing Theory and Practice written by Wim J. van der Linden and published by Springer Science & Business Media. This book was released on 2000-07-31 with total page 327 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book offers a comprehensive introduction to the latest developments in the theory and practice of CAT. It can be used both as a basic reference and a valuable resource on test theory. It covers such topics as item selection and ability estimation, item pool development and maintenance, item calibration and model fit, and testlet-based adaptive testing, as well as the operational aspects of existing large-scale CAT programs.
Download or read book Dissertation Abstracts International written by and published by . This book was released on 2002 with total page 470 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Multidimensional Item Response Theory written by M.D. Reckase and published by Springer Science & Business Media. This book was released on 2009-07-07 with total page 355 pages. Available in PDF, EPUB and Kindle. Book excerpt: First thorough treatment of multidimensional item response theory Description of methods is supported by numerous practical examples Describes procedures for multidimensional computerized adaptive testing
Download or read book Educational Measurement written by Craig S. Wells and published by Guilford Publications. This book was released on 2016-02-26 with total page 514 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book introduces and explores major topics in contemporary educational measurement: criterion-referenced testing, item response theory (IRT), computer-based testing, cross-lingual and cross-cultural assessment, and accountability testing. Psychometric experts describe forward-looking measurement practices and provide a contextualized understanding of how and why they were developed, how they can be used, and where they may go in the future. In addition to presenting key concepts and formulas, the volume covers established and emerging applications and discusses recurrent challenges that require additional research. A helpful glossary of abbreviations is included. The book is grounded in the work of Ronald K. Hambleton.
Download or read book Elements of Adaptive Testing written by Wim J. van der Linden and published by Springer Science & Business Media. This book was released on 2010-03-10 with total page 433 pages. Available in PDF, EPUB and Kindle. Book excerpt: The arrival of the computer in educational and psychological testing has led to the current popularity of adaptive testing---a testing format in which the computer uses statistical information about the test items to automatically adapt their selection to a real-time update of the test taker’s ability estimate. This book covers such key features of adaptive testing as item selection and ability estimation, adaptive testing with multidimensional abilities, sequencing adaptive test batteries, multistage adaptive testing, item-pool design and maintenance, estimation of item and item-family parameters, item and person fit, as well as adaptive mastery and classification testing. It also shows how these features are used in the daily operations of several large-scale adaptive testing programs.
Download or read book Handbook of Test Development written by Suzanne Lane and published by Routledge. This book was released on 2015-10-08 with total page 676 pages. Available in PDF, EPUB and Kindle. Book excerpt: The second edition of the Handbook of Test Development provides graduate students and professionals with an up-to-date, research-oriented guide to the latest developments in the field. Including thirty-two chapters by well-known scholars and practitioners, it is divided into five sections, covering the foundations of test development, content definition, item development, test design and form assembly, and the processes of test administration, documentation, and evaluation. Keenly aware of developments in the field since the publication of the first edition, including changes in technology, the evolution of psychometric theory, and the increased demands for effective tests via educational policy, the editors of this edition include new chapters on assessing noncognitive skills, measuring growth and learning progressions, automated item generation and test assembly, and computerized scoring of constructed responses. The volume also includes expanded coverage of performance testing, validity, fairness, and numerous other topics. Edited by Suzanne Lane, Mark R. Raymond, and Thomas M. Haladyna, The Handbook of Test Development, 2nd edition, is based on the revised Standards for Educational and Psychological Testing, and is appropriate for graduate courses and seminars that deal with test development and usage, professional testing services and credentialing agencies, state and local boards of education, and academic libraries serving these groups.