Download or read book Computational Psychometrics New Methodologies for a New Generation of Digital Learning and Assessment written by Alina A. von Davier and published by Springer Nature. This book was released on 2022-01-01 with total page 265 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book defines and describes a new discipline, named “computational psychometrics,” from the perspective of new methodologies for handling complex data from digital learning and assessment. The editors and the contributing authors discuss how new technology drastically increases the possibilities for the design and administration of learning and assessment systems, and how doing so significantly increases the variety, velocity, and volume of the resulting data. Then they introduce methods and strategies to address the new challenges, ranging from evidence identification and data modeling to the assessment and prediction of learners’ performance in complex settings, as in collaborative tasks, game/simulation-based tasks, and multimodal learning and assessment tasks. Computational psychometrics has thus been defined as a blend of theory-based psychometrics and data-driven approaches from machine learning, artificial intelligence, and data science. All these together provide a better methodological framework for analysing complex data from digital learning and assessments. The term “computational” has been widely adopted by many other areas, as with computational statistics, computational linguistics, and computational economics. In those contexts, “computational” has a meaning similar to the one proposed in this book: a data-driven and algorithm-focused perspective on foundations and theoretical approaches established previously, now extended and, when necessary, reconceived. This interdisciplinarity is already a proven success in many disciplines, from personalized medicine that uses computational statistics to personalized learning that uses, well, computational psychometrics. We expect that this volume will be of interest not just within but beyond the psychometric community. In this volume, experts in psychometrics, machine learning, artificial intelligence, data science and natural language processing illustrate their work, showing how the interdisciplinary expertise of each researcher blends into a coherent methodological framework to deal with complex data from complex virtual interfaces. In the chapters focusing on methodologies, the authors use real data examples to demonstrate how to implement the new methods in practice. The corresponding programming codes in R and Python have been included as snippets in the book and are also available in fuller form in the GitHub code repository that accompanies the book.

Download or read book Computational Aspects of Psychometric Methods written by Patricia Martinková and published by CRC Press. This book was released on 2023-07-03 with total page 348 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book covers the computational aspects of psychometric methods involved in developing measurement instruments and analyzing measurement data in social sciences. It covers the main topics of psychometrics such as validity, reliability, item analysis, item response theory models, and computerized adaptive testing. The computational aspects comprise the statistical theory and models, comparison of estimation methods and algorithms, as well as an implementation with practical data examples in R and also in an interactive ShinyItemAnalysis application. Key Features: Statistical models and estimation methods involved in psychometric research Includes reproducible R code and examples with real datasets Interactive implementation in ShinyItemAnalysis application The book is targeted toward a wide range of researchers in the field of educational, psychological, and health-related measurements. It is also intended for those developing measurement instruments and for those collecting and analyzing data from behavioral measurements, who are searching for a deeper understanding of underlying models and further development of their analytical skills.

Download or read book Advancing Natural Language Processing in Educational Assessment written by Victoria Yaneva and published by Taylor & Francis. This book was released on 2023-06-05 with total page 339 pages. Available in PDF, EPUB and Kindle. Book excerpt: Advancing Natural Language Processing in Educational Assessment examines the use of natural language technology in educational testing, measurement, and assessment. Recent developments in natural language processing (NLP) have enabled large-scale educational applications, though scholars and professionals may lack a shared understanding of the strengths and limitations of NLP in assessment as well as the challenges that testing organizations face in implementation. This first-of-its-kind book provides evidence-based practices for the use of NLP-based approaches to automated text and speech scoring, language proficiency assessment, technology-assisted item generation, gamification, learner feedback, and beyond. Spanning historical context, validity and fairness issues, emerging technologies, and implications for feedback and personalization, these chapters represent the most robust treatment yet about NLP for education measurement researchers, psychometricians, testing professionals, and policymakers. The Open Access version of this book, available at www.taylorfrancis.com, has been made available under a Creative Commons Attribution-NonCommercial-No Derivatives 4.0 license.

Download or read book Design Recommendations for Intelligent Tutoring Systems Volume 10 Strengths Weaknesses Opportunities and Threats SWOT Analysis of Intelligent Tutoring Systems written by Anne Sinatra and published by U.S. Army DEVCOM – Soldier Center. This book was released on 2023-03-10 with total page 160 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book is a resource for those who are new to intelligent tutoring systems (ITSs), as well as those with a great deal of experience with them. This is the tenth book in our Design Recommendations for Intelligent Tutoring Systems book series. The focus of this book is on Strengths, Weaknesses, Opportunities, and Threats (SWOT) Analyses of varying components of ITSs. Each chapter in the book represents a different topic area, and includes a SWOT analysis that is specific to that topic and how it relates to ITSs. This book can be read in order, or a reader can choose a specific topic area and move directly to that chapter. Each SWOT Analysis describes the current state of the topic area, and how the lessons learned from the analysis could be applied to the Generalized Intelligent Framework for Tutoring (GIFT) (Sottilare et al., 2012; Sottilare et al., 2017). GIFT is an ITS architecture that is open-source, modular, and domain independent (Sottilare et al., 2017). Each book in the design recommendations series has addressed a different ITS topic area, and how the work in each chapter can relate to and inform the GIFT architecture. GIFT has continually been in development, with features consistently being added to improve functionality, as well as reduce the skill requirement for authoring content in GIFT. GIFT is freely available in both downloadable and Cloud versions at https://www.GIFTtutoring.org.

Download or read book Assessing Through the Lens of Social and Emotional Learning written by Cynthia Sistek and published by Corwin Press. This book was released on 2024-01-11 with total page 260 pages. Available in PDF, EPUB and Kindle. Book excerpt: Help usher in a new era of student assessment This empowering guide revolutionizes the assessment process by putting students at the center. Dive into practical strategies and best practices for fostering social and emotional learning (SEL) competencies through student-centered assessments and discover how you can transform classrooms into inclusive spaces where learning thrives. Inside you′ll find Humanistic assessing practices to integrate into everyday teaching and learning Best practices for designing and implementing savvy SEL assessments Ways to develop a classroom that is student empowered and culturally relevant Rubrics, portfolios, and digital tools that demonstrate students’ competencies and knowledge through an SEL lens Explore dozens of practical examples, case studies, and field-tested activities that support research-based teaching and learning across the curriculum. Assessing Through the Lens of Social and Emotional Learning inspires educators to move beyond traditional testing to focus on nurturing and fostering skills that students will need for both academic and lifelong success.

Download or read book Principles and Applications of Adaptive Artificial Intelligence written by Lv, Zhihan and published by IGI Global. This book was released on 2024-01-24 with total page 332 pages. Available in PDF, EPUB and Kindle. Book excerpt: The rapid adoption of deep learning models has resulted in many business services becoming model services, yet most AI systems lack the necessary automation and industrialization capabilities. This leads to heavy reliance on manual operation and maintenance, which not only consumes power but also causes resource wastage and stability issues during system mutations. The inadequate self-adaptation of AI systems poses significant challenges in terms of cost-effectiveness and operational stability. Principles and Applications of Adaptive Artificial Intelligence, edited by Zhihan Lv from Uppsala University, Sweden, offers a comprehensive solution to the self-adaptation problem in AI systems. It explores the latest concepts, technologies, and applications of Adaptive AI, equipping academic scholars and professionals with the necessary knowledge to overcome the challenges faced by traditional business logic transformed into model services. With its problem-solving approach, real-world case studies, and thorough analysis, the Handbook provides practitioners with practical ideas and solutions, while also serving as a valuable teaching material and reference guide for students and educators in AI-related disciplines. By emphasizing self-adaptation, continuous model iteration, and dynamic learning based on real-time feedback, the book empowers readers to significantly enhance the cost-effectiveness and operational stability of AI systems, making it an indispensable resource for researchers, professionals, and students seeking to revolutionize their research and applications in the field of Adaptive AI.

Download or read book Quantitative Psychology written by Marie Wiberg and published by Springer Nature. This book was released on 2022-07-12 with total page 329 pages. Available in PDF, EPUB and Kindle. Book excerpt: The volume represents presentations given at the 86th annual meeting of the Psychometric Society, held virtually on July 19–23, 2021. About 500 individuals contributed paper presentations, symposiums, poster presentations, pre-conference workshops, keynote presentations, and invited presentations. Since the 77th meeting, Springer has published the conference proceedings volume from this annual meeting to allow presenters to share their work and ideas with the wider research community, while still undergoing a thorough review process. This proceedings covers a diverse set of psychometric topics, including item response theory, Bayesian models, reliability, longitudinal measures, and cognitive diagnostic models.

Download or read book Machine Learning Natural Language Processing and Psychometrics written by Hong Jiao and published by IAP. This book was released on 2024-04-01 with total page 242 pages. Available in PDF, EPUB and Kindle. Book excerpt: With the exponential increase of digital assessment, different types of data in addition to item responses become available in the measurement process. One of the salient features in digital assessment is that process data can be easily collected. This non-conventional structured or unstructured data source may bring new perspectives to better understand the assessment products or accuracy and the process how an item product was attained. The analysis of the conventional and non-conventional assessment data calls for more methodology other than the latent trait modeling. Natural language processing (NLP) methods and machine learning algorithms have been successfully applied in automated scoring. It has been explored in providing diagnostic feedback to test-takers in writing assessment. Recently, machine learning algorithms have been explored for cheating detection and cognitive diagnosis. When the measurement field promote the use of assessment data to provide feedback to improve teaching and learning, it is the right time to explore new methodology and explore the value added from other data sources. This book presents the use cases of machine learning and NLP in improving the assessment theory and practices in high-stakes summative assessment, learning, and instruction. More specifically, experts from the field addressed the topics related to automated item generations, automated scoring, automated feedback in writing, explainability of automated scoring, equating, cheating and alarming response detection, adaptive testing, and applications in science assessment. This book demonstrates the utility of machine learning and NLP in assessment design and psychometric analysis.

Download or read book Talent Assessment written by Tracy Kantrowitz and published by Oxford University Press. This book was released on 2023 with total page 585 pages. Available in PDF, EPUB and Kindle. Book excerpt: "Technology-enhanced assessments for selection and development have flourished over the past several decades. Sophisticated assessment programs that weren't possible even a few years ago can now be assembled and launched on a global scale to measure almost any attribute in any language with greater realism, efficiency, and precision than ever before. Large-scale assessment applications have emerged where candidates are recruited online, automatically screened, assessed and prioritized, and presented with online interview questions based on the results of their assessments - all without any human contact. Many organizations have enthusiastically embraced these developments due to the obvious practical benefits and immediate payoff associated with increased efficiency and reduced costs to move candidates from recruitment through to selection"--

Download or read book Artificial Intelligence in Education written by Ido Roll and published by Springer Nature. This book was released on 2021-06-11 with total page 536 pages. Available in PDF, EPUB and Kindle. Book excerpt: This two-volume set LNAI 12748 and 12749 constitutes the refereed proceedings of the 22nd International Conference on Artificial Intelligence in Education, AIED 2021, held in Utrecht, The Netherlands, in June 2021.* The 40 full papers presented together with 76 short papers, 2 panels papers, 4 industry papers, 4 doctoral consortium, and 6 workshop papers were carefully reviewed and selected from 209 submissions. The conference provides opportunities for the cross-fertilization of approaches, techniques and ideas from the many fields that comprise AIED, including computer science, cognitive and learning sciences, education, game design, psychology, sociology, linguistics as well as many domain-specific areas. ​*The conference was held virtually due to the COVID-19 pandemic.

Download or read book Trust and Inclusion in AI Mediated Education written by Dora Kourkoulou and published by Springer Nature. This book was released on with total page 344 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Innovative Psychometric Modeling and Methods written by Hong Jiao and published by IAP. This book was released on 2020-09-01 with total page 236 pages. Available in PDF, EPUB and Kindle. Book excerpt: The general theme of this book is to present innovative psychometric modeling and methods. In particular, this book includes research and successful examples of modeling techniques for new data sources from digital assessments, such as eye-tracking data, hint uses, and process data from game-based assessments. In addition, innovative psychometric modeling approaches, such as graphical models, item tree models, network analysis, and cognitive diagnostic models, are included. Chapters 1, 2, 4 and 6 are about psychometric models and methods for learning analytics. The first two chapters focus on advanced cognitive diagnostic models for tracking learning and the improvement of attribute classification accuracy. Chapter 4 demonstrates the use of network analysis for learning analytics. Chapter 6 introduces the conjunctive root causes model for the understanding of prerequisite skills in learning. Chapters 3, 5, 8, 9 are about innovative psychometric techniques to model process data. Specifically, Chapters 3 and 5 illustrate the usage of generalized linear mixed effect models and item tree models to analyze eye-tracking data. Chapter 8 discusses the modeling approach of hint uses and response accuracy in learning environment. Chapter 9 demonstrates the identification of observable outcomes in the game-based assessments. Chapters 7 and 10 introduce innovative latent variable modeling approaches, including the graphical and generalized linear model approach and the dynamic modeling approach. In summary, the book includes theoretical, methodological, and applied research and practices that serve as the foundation for future development. These chapters provide illustrations of efforts to model and analyze multiple data sources from digital assessments. When computer-based assessments are emerging and evolving, it is important that researchers can expand and improve the methods for modeling and analyzing new data sources. This book provides a useful resource to researchers who are interested in the development of psychometric methods to solve issues in this digital assessment age.

Download or read book Design Recommendations for Intelligent Tutoring System Volume 5 Assessment Methods written by Dr. Robert Sottilare and published by US Army Research Laboratory. This book was released on 2017-08-28 with total page 364 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book is the fifth in a planned series of books that examine key topics (e.g., learner modeling, instructional strategies, authoring, domain modeling, assessment, impact on learning, team tutoring, machine learning, and potential standards) in intelligent tutoring system (ITS) design through the lens of the Generalized Intelligent Framework for Tutoring (GIFT) (Sottilare, Brawner, Goldberg & Holden, 2012; Sottilare, Brawner, Sinatra, & Johnston, 2017). GIFT is a modular, service-oriented architecture created to reduce the cost and skill required to author ITSs, manage instruction within ITSs, and evaluate the effect of ITS technologies on learning, performance, retention, transfer of skills, and other instructional outcomes. Along with this volume, the first four books in this series, Learner Modeling (ISBN 978-0-9893923-0-3), Instructional Management (ISBN 978-0-9893923-2-7), Authoring Tools (ISBN 978-0-9893923-6-5) and Domain Modeling (978-0-9893923-9-6) are freely available at www.GIFTtutoring.org and on Google Play.

Download or read book Sociocognitive Foundations of Educational Measurement written by Robert J. Mislevy and published by Routledge. This book was released on 2018-04-09 with total page 438 pages. Available in PDF, EPUB and Kindle. Book excerpt: Several key developments challenge the field of educational measurement today: demands for tests at larger scales with higher stakes, an improved understanding of how people develop capabilities, and new technologies for interactive digital assessments. Sociocognitive Foundations of Educational Measurement integrates new developments in educational measurement and educational psychology in order to provide researchers, testing professionals, and students with an innovative sociocognitive perspective on assessment. This comprehensive volume begins with a broad explanation of the sociocognitive perspective and the foundations of assessment, then provides a series of focused applications to major topics such as assessment arguments, validity, fairness, interactive assessment, and a conception of "measurement" in educational assessment. Classical test theory, item response theory, categorical models, mixture models, cognitive diagnosis models, and Bayesian networks are explored from the resulting perspective. Ideal for specialists in these areas, graduate students, developers, and scholars in both educational measurement and fields that contribute to a sociocognitive perspective, this book consolidates nearly a decade of research into a fresh perspective on educational measurement.

Download or read book The Routledge International Handbook of Automated Essay Evaluation written by Mark D. Shermis and published by Taylor & Francis. This book was released on 2024-06-27 with total page 647 pages. Available in PDF, EPUB and Kindle. Book excerpt: The Routledge International Handbook of Automated Essay Evaluation (AEE) is a definitive guide at the intersection of automation, artificial intelligence, and education. This volume encapsulates the ongoing advancement of AEE, reflecting its application in both large-scale and classroom-based assessments to support teaching and learning endeavors. It presents a comprehensive overview of AEE's current applications, including its extension into reading, speech, mathematics, and writing research; modern automated feedback systems; critical issues in automated evaluation such as psychometrics, fairness, bias, transparency, and validity; and the technological innovations that fuel current and future developments in this field. As AEE approaches a tipping point of global implementation, this Handbook stands as an essential resource, advocating for the conscientious adoption of AEE tools to enhance educational practices ethically. The Handbook will benefit readers by equipping them with the knowledge to thoughtfully integrate AEE, thereby enriching educational assessment, teaching, and learning worldwide. Aimed at researchers, educators, AEE developers, and policymakers, the Handbook is poised not only to chart the current landscape but also to stimulate scholarly discourse, define and inform best practices, and propel and guide future innovations.

Download or read book Test Fairness in the New Generation of Large Scale Assessment written by Hong Jiao and published by IAP. This book was released on 2017-06-01 with total page 248 pages. Available in PDF, EPUB and Kindle. Book excerpt: The new generation of tests is faced with new challenges. In the K?12 setting, the new learning targets are intended to assess higher?order thinking skills and prepare students to be ready for college and career and to keep American students competitive with their international peers. In addition, the new generation of state tests requires the use of technology in item delivery and embedding assessment in real?world, authentic, situations. It further requires accurate assessment of students at all ability levels. One of the most important questions is how to maintain test fairness in the new assessments with technology innovative items and technology delivered tests. In the traditional testing programs such as licensure and certification tests and college admission tests, test fairness has constantly been a key psychometric issue in test development and this continues to be the case with the national testing programs. As test fairness needs to be addressed throughout the whole process of test development, experts from state, admission, and licensure tests will address test fairness challenges in the new generation assessment. The book chapters clarify misconceptions of test fairness including the use of admission test results in cohort comparison, the use of international assessment results in trend evaluation, whether standardization and fairness necessarily mean uniformity when test?takers have different cultural backgrounds, and whether standardization can insure fairness. More technically, chapters also address issues related to how compromised items and test fairness are related to classification decisions, how accessibility in item development and accommodation could be mingled with technology, how to assess special populations with dyslexia, using Blinder?Oaxaca Decomposition for differential item functioning detection, and differential feature functioning in automated scoring. Overall, this book addresses test fairness issues in state assessment, college admission testing, international assessment, and licensure tests. Fairness is discussed in the context of culture and special populations. Further, fairness related to performance assessment and automated scoring is a focus as well. This book provides a very good source of information related to test fairness issues in test development in the new generation of assessment where technology is highly involved.

Download or read book Advancements in Technology Based Assessment Emerging Item Formats Test Designs and Data Sources written by Frank Goldhammer and published by Frontiers Media SA. This book was released on 2020-02-20 with total page 275 pages. Available in PDF, EPUB and Kindle. Book excerpt: This eBook is a collection of articles from a Frontiers Research Topic. Frontiers Research Topics are very popular trademarks of the Frontiers Journals Series: they are collections of at least ten articles, all centered on a particular subject. With their unique mix of varied contributions from Original Research to Review Articles, Frontiers Research Topics unify the most influential researchers, the latest key findings and historical advances in a hot research area! Find out more on how to host your own Frontiers Research Topic or contribute to one as an author by contacting the Frontiers Editorial Office: frontiersin.org/about/contact.