EBookClubs

Read Books & Download eBooks Full Online

EBookClubs

Read Books & Download eBooks Full Online

Book A Comparison of the Performance of Testlet based Computer Adaptive Tests and Multistage Tests

Download or read book A Comparison of the Performance of Testlet based Computer Adaptive Tests and Multistage Tests written by Leslie Keng and published by . This book was released on 2008 with total page 416 pages. Available in PDF, EPUB and Kindle. Book excerpt: Computer adaptive testing (CAT) has grown both in research and implementation. Test construction and security issues, however, have led many to reconsider the merits of CAT. Multistage testing (MST) is an alternative adaptive test design that purportedly addresses CAT's shortcomings. Yet considerably less research has been conducted on MST. Also, most research in adaptive testing has been based on item response theory (IRT). Many tests now make use of testlets -- bundles of items administered together, often based on a common stimulus. The use of testlets violates local independence, a fundamental assumptions of IRT. Testlet response theory (TRT) is a relatively new measurement model designed to measure testlet-based tests. Few studies though have examined its use in testlet-based CAT and MST designs. This dissertation investigated the performance of testlet-based CATs and MSTs measured using the TRT model. The test designs compared included a CAT that is adaptive at the testlet level only (testlet-level CAT), a CAT that is adaptive at both the testlet and item levels (item-level CAT) and a MST design (MST). Test conditions manipulated included test length, item pool size, and examinee ability distribution. Examinee data were generated using TRT-calibrated item parameters based on data from a large-scale reading assessment. The three test designs were evaluated based on measurement effectiveness and exposure control properties. The study found that all three adaptive test designs yielded similar and good measurement accuracy. Overall, the item-level CAT produced better measurement precision, followed by the MST design. However, the MST and CAT designs yielded better measurement precision at different areas of the ability scale. All three test designs yielded acceptable exposure control properties at the testlet level. At the item level, the testlet-level CAT produced the best overall result. The item-level CAT had less than ideal pool utilization, but was able to meet its pre-specified maximum exposure control rate and maintain low item exposure rates. The MST had excellent pool utilization, but a higher percentage of items with high exposure rates. Skewing the underlying ability distribution also had a particularly notable negative effect on the exposure control properties of the MST.

Book Computerized Adaptive Testing

Download or read book Computerized Adaptive Testing written by David J. Weiss and published by Guilford Publications. This book was released on 2024-04-29 with total page 388 pages. Available in PDF, EPUB and Kindle. Book excerpt: Used worldwide in assessment and professional certification contexts, computerized adaptive testing (CAT) offers a powerful means to measure individual differences or make classifications. This authoritative work from CAT pioneer David J. Weiss and Alper Şahin provides a complete how-to guide for planning and implementing an effective CAT to create a test unique to each person in real time. The book reviews the history of CAT and the basics of item response theory used in CAT. It walks the reader through developing an item bank, pretesting and linking items, selecting required CAT options, and using simulations to design a CAT. Available software for CAT delivery is described, including links to free and commercial options. Engaging multidisciplinary examples illustrate applications of CAT for measuring ability, achievement, proficiency, personality, attitudes, perceptions, patients’ reports of their symptoms, and academic or clinical progress.

Book Computerized Adaptive Testing Theory and Practice

Download or read book Computerized Adaptive Testing Theory and Practice written by Wim J. van der Linden and published by Springer Science & Business Media. This book was released on 2000-07-31 with total page 327 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book offers a comprehensive introduction to the latest developments in the theory and practice of CAT. It can be used both as a basic reference and a valuable resource on test theory. It covers such topics as item selection and ability estimation, item pool development and maintenance, item calibration and model fit, and testlet-based adaptive testing, as well as the operational aspects of existing large-scale CAT programs.

Book Computerized Adaptive Testing

Download or read book Computerized Adaptive Testing written by Howard Wainer and published by Routledge. This book was released on 2000-04-01 with total page 360 pages. Available in PDF, EPUB and Kindle. Book excerpt: This celebrated primer presents an introduction to all of the key ingredients in understanding computerized adaptive testing technology, test development, statistics, and mental test theory. Based on years of research, this accessible book educates the novice and serves as a compendium of state-of-the-art information for professionals interested in computerized testing in the areas of education, psychology, and other related social sciences. A hypothetical test taken as a prelude to employment is used as a common example throughout to highlight this book's most important features and problems. Changes in the new edition include: *a completely rewritten chapter 2 on the system considerations needed for modern computerized adaptive testing; *a revised chapter 4 to include the latest in methodology surrounding online calibration and in the modeling of testlets; and *a new chapter 10 with helpful information on how test items are really selected, usage patterns, how usage patterns influence the number of new items required, and tools for managing item pools.

Book Computerized Adaptive Testing

Download or read book Computerized Adaptive Testing written by David J. Weiss and published by Guilford Publications. This book was released on 2024-06-12 with total page 387 pages. Available in PDF, EPUB and Kindle. Book excerpt: "CAT is the use of artificial intelligence and machine learning to create a test unique to each person in real time. CAT: From Concept to Implementation is designed to take you from your initial decision to implement a CAT through each step in the process of fielding a CAT that will provide its benefits both to your examinees and to your organization. It describes how CATs are developed, and how they are implemented using current advanced psychometric methods"--

Book A Comparison of Adaptive Mastery Testing Using Testlets with the 3 parameter Logistic Model

Download or read book A Comparison of Adaptive Mastery Testing Using Testlets with the 3 parameter Logistic Model written by Melody Sue Jacobs-Cassuto and published by . This book was released on 2005 with total page 464 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Book Computerized Adaptive Testing

Download or read book Computerized Adaptive Testing written by Howard Wainer and published by Routledge. This book was released on 2000-04-01 with total page 403 pages. Available in PDF, EPUB and Kindle. Book excerpt: This celebrated primer presents an introduction to all of the key ingredients in understanding computerized adaptive testing technology, test development, statistics, and mental test theory. Based on years of research, this accessible book educates the novice and serves as a compendium of state-of-the-art information for professionals interested in computerized testing in the areas of education, psychology, and other related social sciences. A hypothetical test taken as a prelude to employment is used as a common example throughout to highlight this book's most important features and problems. Changes in the new edition include: *a completely rewritten chapter 2 on the system considerations needed for modern computerized adaptive testing; *a revised chapter 4 to include the latest in methodology surrounding online calibration and in the modeling of testlets; and *a new chapter 10 with helpful information on how test items are really selected, usage patterns, how usage patterns influence the number of new items required, and tools for managing item pools.

Book Resources in Education

Download or read book Resources in Education written by and published by . This book was released on 1998 with total page 320 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Book Elements of Adaptive Testing

Download or read book Elements of Adaptive Testing written by Wim J. van der Linden and published by Springer Science & Business Media. This book was released on 2010-03-10 with total page 433 pages. Available in PDF, EPUB and Kindle. Book excerpt: The arrival of the computer in educational and psychological testing has led to the current popularity of adaptive testing---a testing format in which the computer uses statistical information about the test items to automatically adapt their selection to a real-time update of the test taker’s ability estimate. This book covers such key features of adaptive testing as item selection and ability estimation, adaptive testing with multidimensional abilities, sequencing adaptive test batteries, multistage adaptive testing, item-pool design and maintenance, estimation of item and item-family parameters, item and person fit, as well as adaptive mastery and classification testing. It also shows how these features are used in the daily operations of several large-scale adaptive testing programs.

Book A Comparison of Multi stage and Computerized Adaptive Tests Based on the Generalized Partial Credit Model

Download or read book A Comparison of Multi stage and Computerized Adaptive Tests Based on the Generalized Partial Credit Model written by Candance L. Macken-Ruiz and published by . This book was released on 2008 with total page 300 pages. Available in PDF, EPUB and Kindle. Book excerpt: A multi-stage test (MST) design is an alternative design for the delivery of automated tests. While computerized adaptive tests (CAT) have dominated testing for the past three decades, increasing interest has been focused on the MST because it offers two advantages that CAT does not: Test sponsors and test developers can see an entire test before administration because it is pre-constructed from sets of modules of test items, and within a module examinees may skip forward and back through test items and make changes to previously answered items. Due to the dominance of CAT, little research has been devoted to differing MST designs with regard to the number of items per stage and routing rules that direct the selection of the next module after a previous module has been completed. This research used simulated response data for a large national test and the generalized partial credit model to compare a CAT to one of three MST designs that had either decreasing numbers of items per stage, increasing number of items per stage, or the same number of items per stage, and one of three routing rules, maximum information, fixed [theta], or number-right routing. As anticipated, CAT had the best performance with respect to estimating proficiency and item pool use. Among the MSTs, the MST with increasing numbers of items per stage performed the best with respect to estimating proficiency, followed by the MST with decreasing number of items per stage, and equal numbers of items per stage. By routing rule, maximum information performed the best and number-right routing performed the worst. Only one panel was constructed per MST design, so only limited comparisons of item pool use could be made. Although the MST designs did not perform as well as CAT, the differences in estimating proficiency were not large, implying that the MST design is a viable alternative to CAT.

Book Computerized Adaptive Testing

Download or read book Computerized Adaptive Testing written by Howard Wainer and published by Psychology Press. This book was released on 2000 with total page 335 pages. Available in PDF, EPUB and Kindle. Book excerpt: This celebrated primer presents an introduction to all of the key ingredients in understanding computerized adaptive testing technology, test development, statistics, and mental test theory. Based on years of research, this accessible book educates the novice and serves as a compendium of state-of-the-art information for professionals interested in computerized testing in the areas of education, psychology, and other related social sciences. A hypothetical test taken as a prelude to employment is used as a common example throughout to highlight this book's most important features and problems. Changes in the new edition include: *a completely rewritten chapter 2 on the system considerations needed for modern computerized adaptive testing; *a revised chapter 4 to include the latest in methodology surrounding online calibration and in the modeling of testlets; and *a new chapter 10 with helpful information on how test items are really selected, usage patterns, how usage patterns influence the number of new items required, and tools for managing item pools.

Book Computer Based Testing

Download or read book Computer Based Testing written by Craig N. Mills and published by Routledge. This book was released on 2005-04-11 with total page 347 pages. Available in PDF, EPUB and Kindle. Book excerpt: Although computer-based tests (CBT) have been administered for many years, improvements in the speed and power of computers coupled with reductions in their cost have made large-scale computer delivery of tests increasingly feasible. CBT is now a common form of test delivery for licensure, certification, and admissions tests. Many large-scale, high-stakes testing programs have introduced CBT either as an option or as the sole means of test delivery. Although this movement to CBT has, to a great extent, been successful, it has not been without problems. Advances in psychometrics are required to ensure that those who rely on test results can have at least the same confidence in CBTs as they have in traditional forms of assessment. This volume stems from an ETS-sponsored colloquium in which more than 200 measurement professionals from eight countries and 29 states convened to assess the current and future status of CBT. The formal agenda for the colloquium was divided into three major segments: Test Models, Test Administration, and Test Analysis and Scoring. Each segment consisted of several presentations followed by comments from noted psychometricians and a break-out session in which presenters and discussants identified important issues and established priorities for a CBT research agenda. This volume contains the papers presented at the colloquium, the discussant remarks based on those papers, and the research agenda that was generated from the break-out sessions. Computer-Based Testing: Building the Foundation for Future Assessments is must reading for professionals, scholars, and advanced students working in the testing field, as well as people in the information technology field who have an interest in testing.

Book Practical Considerations in Computer Based Testing

Download or read book Practical Considerations in Computer Based Testing written by Cynthia G. Parshall and published by Springer Science & Business Media. This book was released on 2012-12-06 with total page 233 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book introduces computer-based testing, addressing both nontechnical and technical considerations. The material is oriented toward practitioners and graduate students. The practical emphasis will be useful to measurement professionals who are or will be responsible for implementing a computerized testing program. The instructional information is also designed to be suitable for a one-semester graduate course in computerized testing in an educational measurement or quantitative methods program. While certain theoretical concepts are addressed, the focus of the book is on the applied nature of computerized testing. For this reason, the materials include such features as example applications, figures, and plots to illustrate critical points in the discussions. A wide range ofnontechnical issues need to be considered in implementing a computer-based testing program. Separate chapters are provided on test administration and development issues, examinee issues, software issues, and innovative item types. Test administration and delivery issues include the location of exam administration, selection of hardware and software, security considerations, scheduling of administration frequency and time limits, cost implications, and program support as well as approaches for addressing reliability, validity, comparability, and data analysis. Examinee issues include the influence ofexaminees' reactions to adaptive testing, the effect ofcomputer based task constraints, and the impact of examinees' prior computer experience. Software issues include usability studies and software evaluation as tools in selecting and developing appropriate software, based on the test program needs.