Download or read book A Differential Response Functioning Framework for Understanding Item Bundle and Test Bias written by Robert Philip Sidney Chalmers and published by . This book was released on 2016 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: This dissertation extends the parametric sampling method and area-based statistics for differential test functioning (DTF) proposed by Chalmers, Counsell, and Flora (2016). Measures for differential item and bundle functioning are first introduced as a special case of the DTF statistics. Next, these extensions are presented in concert with the original DTF measures as a unified framework for quantifying differential response functioning (DRF) of items, bundles, and tests. To evaluate the utility of the new family of measures, the DRF framework is compared to the previously established simultaneous item bias test (SIBTEST) and differential functioning of items and tests (DFIT) frameworks. A series of Monte Carlo simulation conditions were designed to estimate the power to detect differential effects when compensatory and non-compensatory differential effects are present, as well as to evaluate Type I error control. Benefits inherent to the DRF framework are discussed, extensions are suggested, and alternative methods for generating composite-level sampling variability are presented. Finally, it is argued that the area-based measures in the DRF framework provide an intuitive and meaningful quantification of marginal and conditional response bias over and above what has been offered by the previously established statistical frameworks.
Download or read book The SAGE Encyclopedia of Industrial and Organizational Psychology written by Steven G. Rogelberg and published by SAGE Publications. This book was released on 2016-09-27 with total page 1923 pages. Available in PDF, EPUB and Kindle. Book excerpt: The well-received first edition of the Encyclopedia of Industrial and Organizational Psychology (2007, 2 vols) established itself in the academic library market as a landmark reference that presents a thorough overview of this cross-disciplinary field for students, researchers, and professionals in the areas of psychology, business, management, and human resources. Nearly ten years later, SAGE presents a thorough revision that both updates current entries and expands the overall coverage, adding approximately 200 new articles, expanding from two volumes to four. Examining key themes and topics from within this dynamic and expanding field of psychology, this work offers a truly cross-cultural and global perspective.
Download or read book The Impact of Multidimensionality on the Detection of Differential Bundle Functioning Using SIBTEST written by Terris Raiford-Ross and published by . This book was released on 2007 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: In response to public concern over fairness in testing, conducting a differential item functioning (DIF) analysis is now standard practice for many large-scale testing programs (e.g., Scholastic Aptitude Test, intelligence tests, licensing exams). As highlighted by the Standards for Educational and Psychological Testing manual, the legal and ethical need to avoid bias when measuring examinee abilities is essential to fair testing practices (AERA-APA-NCME, 1999). Likewise, the development of statistical and substantive methods of investigating DIF is crucial to the goal of designing fair and valid educational and psychological tests. Douglas, Roussos and Stout (1996) introduced the concept of item bundle DIF and the implications of differential bundle functioning (DBF) for identifying the underlying causes of DIF. Since then, several studies have demonstrated DIF/DBF analyses within the framework of "unintended" multidimensionality (Oshima & Miller, 1992; Russell, 2005). Russell (2005), in particular, examined the effect of secondary traits on DBF/DTF detection. Like Russell, this study created item bundles by including multidimensional items on a simulated test designed in theory to be unidimensional. Simulating reference group members to have a higher mean ability than the focal group on the nuisance secondary dimension, resulted in DIF for each of the multidimensional items, that when examined together produced differential bundle functioning. The purpose of this Monte Carlo simulation study was to assess the Type I error and power performance of SIBTEST (Simultaneous Item Bias Test; Shealy & Stout, 1993a) for DBF analysis under various conditions with simulated data. The variables of interest included sample size and ratios of reference to focal group sample sizes, correlation between primary and secondary dimensions, magnitude of DIF/DBF, and angular item direction. Results showed SIBTEST to be quite powerful in detecting DBF and controlling Type I error for almost all of the simulated conditions. Specifically, power rates were .80 or above for 84% of all conditions and the average Type I error rate was approximately .05. Furthermore, the combined effect of the studied variables on SIBTEST power and Type I error rates provided much needed information to guide further use of SIBTEST for identifying potential sources of differential item/bundle functioning.
Download or read book Investigations of Differential Item Functioning written by Insu Paek and published by . This book was released on 2002 with total page 434 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Psychometrics written by C.R. Rao and published by Elsevier. This book was released on 2007 with total page 1191 pages. Available in PDF, EPUB and Kindle. Book excerpt: This volume, representing a compilation of authoritative reviews on a multitude of uses of statistics in epidemiology and medical statistics written by internationally renowned experts, is addressed to statisticians working in biomedical and epidemiological fields who use statistical and quantitative methods in their work. While the use of statistics in these fields has a long and rich history, explosive growth of science in general and clinical and epidemiological sciences in particular have gone through a see of change, spawning the development of new methods and innovative adaptations of standard methods. Since the literature is highly scattered, the Editors have undertaken this humble exercise to document a representative collection of topics of broad interest to diverse users. The volume spans a cross section of standard topics oriented toward users in the current evolving field, as well as special topics in much need which have more recent origins. This volume was prepared especially keeping the applied statisticians in mind, emphasizing applications-oriented methods and techniques, including references to appropriate software when relevant. The contributors are internationally renowned experts in their respective areas. This volume addresses emerging statistical challenges in epidemiological, biomedical, and pharmaceutical research. It features: methods for assessing Biomarkers, analysis of competing risks; clinical trials including sequential and group sequential, crossover designs, cluster randomized, and adaptive designs; and, structural equations modelling and longitudinal data analysis.
Download or read book Comparing Methods for Identifying Suspect Items and Item Bundles in a Multidimensionality based DIF Analysis Approach written by Marian Fushell and published by . This book was released on 2006 with total page 198 pages. Available in PDF, EPUB and Kindle. Book excerpt: Traditional approaches for identifying test items exhibiting differential item functioning (DIF) or groups of items exhibiting differential bundle functioning (DBF) use an exploratory approach based on statistical criteria. In 1996, Roussos and Stout proposed a multidimensionality-based approach in which suspect items and bundles of items are identified before being examined for possible DIF/DBE. Roussos and Stout suggested identifying suspect items or bundles of items based on the test's table of specifications, content analysis, cognitive level analysis, or statistical analysis; however, these approaches have not been compared. In this study, the effectiveness of two of these methods, the test's table of specifications and statistical analysis, are compared. A second research question concerns how one-item-at-a-time DIF analysis compares for bundles exhibiting and not exhibiting significant DBF. When applied to the 2001 School Achievement Indicators Program Mathematics Assessment, the two bundle-organizing methods lead to different kinds of bundles: the bundles derived from the test specifications were related to mathematics content, and the bundles from statistical analysis were related to item format and difficulty. The approaches identified different suspect items and suspect bundles of items as exhibiting gender and language DIF/DBF. Further analysis of the one-item-at-a-time DIF of the items within the identified bundles revealed different patterns for bundles with significant DBF and bundles having no significant DBF. These patterns were generally consistent in the direction of the differential bias and somewhat related to the detectible multidimensionality of the bundles. This study suggests that researchers should identify suspect items as well as suspect bundles and use more than one method to inform decision-making about the presence of bias.
Download or read book The SAGE Handbook of Quantitative Methodology for the Social Sciences written by David Kaplan and published by SAGE Publications. This book was released on 2004-06-21 with total page 529 pages. Available in PDF, EPUB and Kindle. Book excerpt: Click ′Additional Materials′ for downloadable samples "The 24 chapters in this Handbook span a wide range of topics, presenting the latest quantitative developments in scaling theory, measurement, categorical data analysis, multilevel models, latent variable models, and foundational issues. Each chapter reviews the historical context for the topic and then describes current work, including illustrative examples where appropriate. The level of presentation throughout the book is detailed enough to convey genuine understanding without overwhelming the reader with technical material. Ample references are given for readers who wish to pursue topics in more detail. The book will appeal to both researchers who wish to update their knowledge of specific quantitative methods, and students who wish to have an integrated survey of state-of- the-art quantitative methods." —Roger E. Millsap, Arizona State University "This handbook discusses important methodological tools and topics in quantitative methodology in easy to understand language. It is an exhaustive review of past and recent advances in each topic combined with a detailed discussion of examples and graphical illustrations. It will be an essential reference for social science researchers as an introduction to methods and quantitative concepts of great use." —Irini Moustaki, London School of Economics, U.K. "David Kaplan and SAGE Publications are to be congratulated on the development of a new handbook on quantitative methods for the social sciences. The Handbook is more than a set of methodologies, it is a journey. This methodological journey allows the reader to experience scaling, tests and measurement, and statistical methodologies applied to categorical, multilevel, and latent variables. The journey concludes with a number of philosophical issues of interest to researchers in the social sciences. The new Handbook is a must purchase." —Neil H. Timm, University of Pittsburgh The SAGE Handbook of Quantitative Methodology for the Social Sciences is the definitive reference for teachers, students, and researchers of quantitative methods in the social sciences, as it provides a comprehensive overview of the major techniques used in the field. The contributors, top methodologists and researchers, have written about their areas of expertise in ways that convey the utility of their respective techniques, but, where appropriate, they also offer a fair critique of these techniques. Relevance to real-world problems in the social sciences is an essential ingredient of each chapter and makes this an invaluable resource. The handbook is divided into six sections: • Scaling • Testing and Measurement • Models for Categorical Data • Models for Multilevel Data • Models for Latent Variables • Foundational Issues These sections, comprising twenty-four chapters, address topics in scaling and measurement, advances in statistical modeling methodologies, and broad philosophical themes and foundational issues that transcend many of the quantitative methodologies covered in the book. The Handbook is indispensable to the teaching, study, and research of quantitative methods and will enable readers to develop a level of understanding of statistical techniques commensurate with the most recent, state-of-the-art, theoretical developments in the field. It provides the foundations for quantitative research, with cutting-edge insights on the effectiveness of each method, depending on the data and distinct research situation.
Download or read book Fairness and Validation in Language Assessment written by Antony John Kunnan and published by Cambridge University Press. This book was released on 2000-10-12 with total page 318 pages. Available in PDF, EPUB and Kindle. Book excerpt: Fairness of language tests and testing practices has been a concern among test developers and test users. The 19th annual Language Testing Research Colloquium held in 1997 in Florida, brought this concern into focus. The papers in this volume offer an introduction to fairness and validation in the field of language assessment.
Download or read book International Encyclopedia of Education written by and published by Elsevier. This book was released on 2009-04-17 with total page 6964 pages. Available in PDF, EPUB and Kindle. Book excerpt: The field of education has experienced extraordinary technological, societal, and institutional change in recent years, making it one of the most fascinating yet complex fields of study in social science. Unequalled in its combination of authoritative scholarship and comprehensive coverage, International Encyclopedia of Education, Third Edition succeeds two highly successful previous editions (1985, 1994) in aiming to encapsulate research in this vibrant field for the twenty-first century reader. Under development for five years, this work encompasses over 1,000 articles across 24 individual areas of coverage, and is expected to become the dominant resource in the field. Education is a multidisciplinary and international field drawing on a wide range of social sciences and humanities disciplines, and this new edition comprehensively matches this diversity. The diverse background and multidisciplinary subject coverage of the Editorial Board ensure a balanced and objective academic framework, with 1,500 contributors representing over 100 countries, capturing a complete portrait of this evolving field. A totally new work, revamped with a wholly new editorial board, structure and brand-new list of meta-sections and articles Developed by an international panel of editors and authors drawn from senior academia Web-enhanced with supplementary multimedia audio and video files, hotlinked to relevant references and sources for further study Incorporates ca. 1,350 articles, with timely coverage of such topics as technology and learning, demography and social change, globalization, and adult learning, to name a few Offers two content delivery options - print and online - the latter of which provides anytime, anywhere access for multiple users and superior search functionality via ScienceDirect, as well as multimedia content, including audio and video files
Download or read book Measurement Error in Longitudinal Data written by Alexandru Cernat and published by Oxford University Press. This book was released on 2021-03-18 with total page 304 pages. Available in PDF, EPUB and Kindle. Book excerpt: Longitudinal data is essential for understanding how the world around us changes. Most theories in the social sciences and elsewhere have a focus on change, be it of individuals, of countries, of organizations, or of systems, and this is reflected in the myriad of longitudinal data that are being collected using large panel surveys. This type of data collection has been made easier in the age of Big Data and with the rise of social media. Yet our measurements of the world are often imperfect, and longitudinal data is vulnerable to measurement errors which can lead to flawed and misleading conclusions. Measurement Error in Longitudinal Data tackles the important issue of how to investigate change in the context of imperfect data. It compiles the latest advances in estimating change in the presence of measurement error from several fields and covers the entire process, from the best ways of collecting longitudinal data, to statistical models to estimate change under uncertainty, to examples of researchers applying these methods in the real world. This book introduces the essential issues of longitudinal data collection, such as memory effects, panel conditioning (or mere measurement effects), the use of administrative data, and the collection of multi-mode longitudinal data. It also presents some of the most important models used in this area, including quasi-simplex models, latent growth models, latent Markov chains, and equivalence/DIF testing. Finally, the use of vignettes in the context of longitudinal data and estimation methods for multilevel models of change in the presence of measurement error are also discussed.
Download or read book The Routledge Handbook of Language Testing written by Glenn Fulcher and published by Taylor & Francis. This book was released on 2021-12-15 with total page 675 pages. Available in PDF, EPUB and Kindle. Book excerpt: This second edition of The Routledge Handbook of Language Testing provides an updated and comprehensive account of the area of language testing and assessment. The volume brings together 35 authoritative articles, divided into ten sections, written by 51 leading specialists from around the world. There are five entirely new chapters covering the four skills: reading, writing, listening, and speaking, as well as a new entry on corpus linguistics and language testing. The remaining 30 chapters have been revised, often extensively, or entirely rewritten with new authorship teams at the helm, reflecting new generations of expertise in the field. With a dedicated section on technology in language testing, reflecting current trends in the field, the Handbook also includes an extended epilogue written by Harding and Fulcher, contemplating what has changed between the first and second editions and charting a trajectory for the field of language testing and assessment. Providing a basis for discussion, project work, and the design of both language tests themselves and related validation research, this Handbook represents an invaluable resource for students, researchers, and practitioners working in language testing and assessment and the wider field of language education.
Download or read book Creating a DIF Index a Combination of DIF Measure DIF Direction and DIF Impact on People written by Hequn Wang and published by . This book was released on 2009 with total page 304 pages. Available in PDF, EPUB and Kindle. Book excerpt: Differential Item Functioning (dif) is a group-related item/test characteristic targeting the issue of item/test bias. In this dissertation, a new dif index is described that has three parts: (1) a dif measure indicating the degree of different (item) performances between the reference and focal groups, (2) a dif direction statement about the dif direction and the favored groups, etc., and (3) a descriptive statement about the impact of DIF--which and how many examinees are influenced by the dif item. For the dif measure, one method of significance detection is described and evaluated. Then, the dif index is applied to real data, and its results are compared to the results of other dif methods. Furthermore, an introduction is given to the extensions of the dif index to the test level and the polytomous item response data. Finally, some problems are evaluated and future developments are described in the discussion chapter. [The dissertation citations contained here are published with the permission of ProQuest llc. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.].
Download or read book Educational Measurement written by Robert L. Brennan and published by Rowman & Littlefield. This book was released on 2023-10-03 with total page 804 pages. Available in PDF, EPUB and Kindle. Book excerpt: Educational Measurement has been the bible in its field since the first edition was published by ACE in 1951. The importance of this fourth edition of Educational Measurement is to extensively update and extend the topics treated in the previous three editions. As such, the fourth edition documents progress in the field and provides critical guidance to the efforts of new generations of researchers and practitioners. Edited by Robert Brennan and jointly sponsored by the American Council on Education (ACE) and the National Council on Measurement in Education, the fourth edition provides in-depth treatments of critical measurement topics, and the chapter authors are acknowledged experts in their respective fields. Educational measurement researchers and practitioners will find this text essential, and those interested in statistics, psychology, business, and economics should also find this work to be of very strong interest. Topics covered are divided into three subject areas: theory and general principles; construction, administration, and scoring; and applications. The first part of the book covers the topics of validation, reliability, item response theory, scaling and norming, linking and equating, test fairness, and cognitive psychology. Part two includes chapters on test development, test administration, performance assessment, setting performance standards, and technology in testing. The final section includes chapters on second language testing, testing for accountability in K-12 schools, standardized assessment of individual achievement in K-12 schools, higher education admissions testing, monitoring educational progress, licensure and certification testing, and legal and ethical issues.
Download or read book Constructing Measures written by Mark Wilson and published by Routledge. This book was released on 2004-12-13 with total page 236 pages. Available in PDF, EPUB and Kindle. Book excerpt: Constructing Measures introduces a way to understand the advantages and disadvantages of measurement instruments, how to use such instruments, and how to apply these methods to develop new instruments or adapt old ones. The book is organized around the steps taken while constructing an instrument. It opens with a summary of the constructive steps involved. Each step is then expanded on in the next four chapters. These chapters develop the "building blocks" that make up an instrument--the construct map, the design plan for the items, the outcome space, and the statistical measurement model. The next three chapters focus on quality control. They rely heavily on the calibrated construct map and review how to check if scores are operating consistently and how to evaluate the reliability and validity evidence. The book introduces a variety of item formats, including multiple-choice, open-ended, and performance items; projects; portfolios; Likert and Guttman items; behavioral observations; and interview protocols. Each chapter includes an overview of the key concepts, related resources for further investigation and exercises and activities. Some chapters feature appendices that describe parts of the instrument development process in more detail, numerical manipulations used in the text, and/or data results. A variety of examples from the behavioral and social sciences and education including achievement and performance testing; attitude measures; health measures, and general sociological scales, demonstrate the application of the material. An accompanying downloadable resources feature control files, output, and a data set to allow readers to compute the text's exercises and create new analyses and case archives based on the book's examples so the reader can work through the entire development of an instrument. Constructing Measures is an ideal text or supplement in courses on item, test, or instrument development, measurement, item response theory, or rasch analysis taught in a variety of departments including education and psychology. The book also appeals to those who develop instruments, including industrial/organizational, educational, and school psychologists, health outcomes researchers, program evaluators, and sociological measurers. Knowledge of basic descriptive statistics and elementary regression is recommended.
Download or read book Test Fairness in the New Generation of Large Scale Assessment written by Hong Jiao and published by IAP. This book was released on 2017-06-01 with total page 248 pages. Available in PDF, EPUB and Kindle. Book excerpt: The new generation of tests is faced with new challenges. In the K?12 setting, the new learning targets are intended to assess higher?order thinking skills and prepare students to be ready for college and career and to keep American students competitive with their international peers. In addition, the new generation of state tests requires the use of technology in item delivery and embedding assessment in real?world, authentic, situations. It further requires accurate assessment of students at all ability levels. One of the most important questions is how to maintain test fairness in the new assessments with technology innovative items and technology delivered tests. In the traditional testing programs such as licensure and certification tests and college admission tests, test fairness has constantly been a key psychometric issue in test development and this continues to be the case with the national testing programs. As test fairness needs to be addressed throughout the whole process of test development, experts from state, admission, and licensure tests will address test fairness challenges in the new generation assessment. The book chapters clarify misconceptions of test fairness including the use of admission test results in cohort comparison, the use of international assessment results in trend evaluation, whether standardization and fairness necessarily mean uniformity when test?takers have different cultural backgrounds, and whether standardization can insure fairness. More technically, chapters also address issues related to how compromised items and test fairness are related to classification decisions, how accessibility in item development and accommodation could be mingled with technology, how to assess special populations with dyslexia, using Blinder?Oaxaca Decomposition for differential item functioning detection, and differential feature functioning in automated scoring. Overall, this book addresses test fairness issues in state assessment, college admission testing, international assessment, and licensure tests. Fairness is discussed in the context of culture and special populations. Further, fairness related to performance assessment and automated scoring is a focus as well. This book provides a very good source of information related to test fairness issues in test development in the new generation of assessment where technology is highly involved.
Download or read book Handbook of Polytomous Item Response Theory Models written by Michael Nering and published by Taylor & Francis. This book was released on 2011-01-19 with total page 307 pages. Available in PDF, EPUB and Kindle. Book excerpt: This comprehensive Handbook focuses on the most used polytomous item response theory (IRT) models. These models help us understand the interaction between examinees and test questions where the questions have various response categories. The book reviews all of the major models and includes discussions about how and where the models originated, conceptually and in practical terms. Diverse perspectives on how these models can best be evaluated are also provided. Practical applications provide a realistic account of the issues practitioners face using these models. Disparate elements of the book are linked through editorial sidebars that connect common ideas across chapters, compare and reconcile differences in terminology, and explain variations in mathematical notation. These sidebars help to demonstrate the commonalities that exist across the field. By assembling this critical information, the editors hope to inspire others to use polytomous IRT models in their own research so they too can achieve the type of improved measurement that such models can provide. Part 1 examines the most commonly used polytomous IRT models, major issues that cut across these models, and a common notation for calculating functions for each model. An introduction to IRT software is also provided. Part 2 features distinct approaches to evaluating the effectiveness of polytomous IRT models in various measurement contexts. These chapters appraise evaluation procedures and fit tests and demonstrate how to implement these procedures using IRT software. The final section features groundbreaking applications. Here the goal is to provide solutions to technical problems to allow for the most effective use of these models in measuring educational, psychological, and social science abilities and traits. This section also addresses the major issues encountered when using polytomous IRT models in computerized adaptive testing. Equating test scores across different testing contexts is the focus of the last chapter. The various contexts include personality research, motor performance, health and quality of life indicators, attitudes, and educational achievement. Featuring contributions from the leading authorities, this handbook will appeal to measurement researchers, practitioners, and students who want to apply polytomous IRT models to their own research. It will be of particular interest to education and psychology assessment specialists who develop and use tests and measures in their work, especially researchers in clinical, educational, personality, social, and health psychology. This book also serves as a supplementary text in graduate courses on educational measurement, psychometrics, or item response theory.
Download or read book Educational and Psychological Measurement written by W. Holmes Finch and published by Routledge. This book was released on 2018-10-12 with total page 558 pages. Available in PDF, EPUB and Kindle. Book excerpt: This new text provides the most current coverage of measurement and psychometrics in a single volume. Authors W. Holmes Finch and Brian F. French first review the basics of psychometrics and measurement, before moving on to more complex topics such as equating and scaling, item response theory, standard setting, and computer adaptive testing. Also included are discussions of cutting-edge topics utilized by practitioners in the field, such as automated test development, game-based assessment, and automated test scoring. This book is ideal for use as a primary text for graduate-level psychometrics/measurement courses, as well as for researchers in need of a broad resource for understanding test theory. Features: "How it Works" and "Psychometrics in the Real World" boxes break down important concepts through worked examples, and show how theory can be applied to practice. End-of-chapter exercises allow students to test their comprehension of the material, while suggested readings and website links provide resources for further investigation. A collection of free online resources include the full output from R, SPSS, and Excel for each of the analyses conducted in the book, as well as additional exercises, sample homework assignments, answer keys, and PowerPoint lecture slides.
