Download or read book Innovative Psychometric Modeling and Methods written by Hong Jiao and published by IAP. This book was released on 2020-09-01 with total page 236 pages. Available in PDF, EPUB and Kindle. Book excerpt: The general theme of this book is to present innovative psychometric modeling and methods. In particular, this book includes research and successful examples of modeling techniques for new data sources from digital assessments, such as eye-tracking data, hint uses, and process data from game-based assessments. In addition, innovative psychometric modeling approaches, such as graphical models, item tree models, network analysis, and cognitive diagnostic models, are included. Chapters 1, 2, 4 and 6 are about psychometric models and methods for learning analytics. The first two chapters focus on advanced cognitive diagnostic models for tracking learning and the improvement of attribute classification accuracy. Chapter 4 demonstrates the use of network analysis for learning analytics. Chapter 6 introduces the conjunctive root causes model for the understanding of prerequisite skills in learning. Chapters 3, 5, 8, 9 are about innovative psychometric techniques to model process data. Specifically, Chapters 3 and 5 illustrate the usage of generalized linear mixed effect models and item tree models to analyze eye-tracking data. Chapter 8 discusses the modeling approach of hint uses and response accuracy in learning environment. Chapter 9 demonstrates the identification of observable outcomes in the game-based assessments. Chapters 7 and 10 introduce innovative latent variable modeling approaches, including the graphical and generalized linear model approach and the dynamic modeling approach. In summary, the book includes theoretical, methodological, and applied research and practices that serve as the foundation for future development. These chapters provide illustrations of efforts to model and analyze multiple data sources from digital assessments. When computer-based assessments are emerging and evolving, it is important that researchers can expand and improve the methods for modeling and analyzing new data sources. This book provides a useful resource to researchers who are interested in the development of psychometric methods to solve issues in this digital assessment age.

Download or read book Machine Learning Natural Language Processing and Psychometrics written by Hong Jiao and published by IAP. This book was released on 2024-04-01 with total page 242 pages. Available in PDF, EPUB and Kindle. Book excerpt: With the exponential increase of digital assessment, different types of data in addition to item responses become available in the measurement process. One of the salient features in digital assessment is that process data can be easily collected. This non-conventional structured or unstructured data source may bring new perspectives to better understand the assessment products or accuracy and the process how an item product was attained. The analysis of the conventional and non-conventional assessment data calls for more methodology other than the latent trait modeling. Natural language processing (NLP) methods and machine learning algorithms have been successfully applied in automated scoring. It has been explored in providing diagnostic feedback to test-takers in writing assessment. Recently, machine learning algorithms have been explored for cheating detection and cognitive diagnosis. When the measurement field promote the use of assessment data to provide feedback to improve teaching and learning, it is the right time to explore new methodology and explore the value added from other data sources. This book presents the use cases of machine learning and NLP in improving the assessment theory and practices in high-stakes summative assessment, learning, and instruction. More specifically, experts from the field addressed the topics related to automated item generations, automated scoring, automated feedback in writing, explainability of automated scoring, equating, cheating and alarming response detection, adaptive testing, and applications in science assessment. This book demonstrates the utility of machine learning and NLP in assessment design and psychometric analysis.

Download or read book Innovative Research Methodologies in Management written by Luiz Moutinho and published by Springer. This book was released on 2017-12-05 with total page 282 pages. Available in PDF, EPUB and Kindle. Book excerpt: A seminal collection of research methodology themes, this two-volume work provides a set of key scholarly developments related to robustness, allowing scholars to advance their knowledge of research methods used outside of their own immediate fields. With a focus on emerging methodologies within management, key areas of importance are dissected with chapters covering statistical modelling, new measurements, digital research, biometrics and neuroscience, the philosophy of research, computer modelling approaches and new mathematical theories, among others. A genuinely pioneering contribution to the advancement of research methods in business studies, Innovative Research Methodologies in Management presents an analytical and engaging discussion on each topic. By introducing new research agendas it aims to pave the way for increased application of innovative techniques, allow ing the exploration of future research perspectives. Volume I covers a range of research methodologies within the realms of philosophy, measurement and modelling, and focusses on meta-modern mixed methods such as neurophilosophy, diagnostic measurement, and emotivity and ephemera research.

Download or read book Data Analytics and Psychometrics written by Hong Jiao and published by IAP. This book was released on 2018-12-01 with total page 248 pages. Available in PDF, EPUB and Kindle. Book excerpt: The general theme of this book is to encourage the use of relevant methodology in data mining which is or could be applied to the interplay of education, statistics and computer science to solve psychometric issues and challenges in the new generation of assessments. In addition to item response data, other data collected in the process of assessment and learning will be utilized to help solve psychometric challenges and facilitate learning and other educational applications. Process data include those collected or available for collection during the process of assessment and instructional phase such as responding sequence data, log files, the use of help features, the content of web searches, etc. Some book chapters present the general exploration of process data in large-scale assessment. Further, other chapters also address how to integrate psychometrics and learning analytics in assessment and survey, how to use data mining techniques for security and cheating detection, how to use more assessment results to facilitate student’s learning and guide teacher’s instructional efforts. The book includes both theoretical and methodological presentations that might guide the future in this area, as well as illustrations of efforts to implement big data analytics that might be instructive to those in the field of learning and psychometrics. The context of the effort is diverse, including K-12, higher education, financial planning, and survey utilization. It is hoped that readers can learn from different disciplines, especially those who are specialized in assessment, would be critical to expand the ideas of what we can do with data analytics for informing assessment practices.

Download or read book The SAGE Handbook of Innovation in Social Research Methods written by Malcolm Williams and published by SAGE Publications. This book was released on 2011-04-19 with total page 665 pages. Available in PDF, EPUB and Kindle. Book excerpt: Social research is a bourgeoning field. Of course it has many traditions and approaches, but there is a high premium upon thinking differently and thinking anew because social life is never static or wholly predictable. The Handbook, edited by internationally recognized scholars, provides a comprehensive, pitch-perfect critical assessment of the field. The main features of the Handbook are: Clear organization into 4 parts dealing with The Social Context of Research; Design and Data Collection; Integrating The Analysis of New Data Types; Sampling, Inference and Measurement Clear, cutting edge chapters on Objectivity; Causation; Organizing Social Research; Correspondence Analysis; Grounded Theory; Conversational Surveys; Mixed Methods; Meta-Analysis; Optimal Matching Analysis; GIS Analysis; Quantitative Narrative Analysis; Longitudinal Studies; SEM; MLM; Qualitative Comparative Analysis; Respondent Driven Sampling Brings together a glittering assembly of the key figures working in the field of research methods Demonstrates the continuities and productive tensions between classical traditions and real world research. The result is a superbly organized text which will be required reading for anyone interested in the routes and future of social research. It is an unparalleled teaching resource and a 'must have' for serious social researchers.

Download or read book Innovative Assessment of Collaboration written by Alina A. von Davier and published by Springer. This book was released on 2017-04-04 with total page 330 pages. Available in PDF, EPUB and Kindle. Book excerpt: This edited volume provides a platform for experts from various fields to introduce and discuss their different perspectives on the topic of teamwork and collaborative problem solving. It brings together researchers in organizational teaming, educational collaboration, tutoring, simulation, and gaming as well as those involved in statistical and psychometric process modelling. This book seeks to channel this expertise towards advances in the measurement and assessment of cognitive and non-cognitive skills of individuals and teams.

Download or read book Games as Stealth Assessments written by McCreery, Michael P. and published by IGI Global. This book was released on 2023-11-01 with total page 386 pages. Available in PDF, EPUB and Kindle. Book excerpt: In the world of assessment, traditional methods often fall short, providing limited insight into individuals' skills and abilities while being susceptible to response biases. Recognizing these shortcomings, researchers have delved into the realm of stealth assessments, a novel approach that embeds traditional measurement techniques within a game-based environment. By seamlessly integrating assessment into gameplay, stealth assessments offer a contextually rich and unobtrusive method of data collection, allowing for a comprehensive understanding of the constructs being assessed. Games as Stealth Assessments unveils the promising field of stealth assessment, exploring its design considerations, research methods, and practical applications. Drawing upon a foundation of psychometrically-sound assessment practices, this book delves into the intersection of thoughtful game design and empirical support for the use of stealth assessments. It justifies the adoption of stealth assessments in academic disciplines such as mathematics, science, and literacy, as well as in the assessment of psychological constructs like aggression, social skills, and self-regulation.

Download or read book Handbook of Research on Digital Based Assessment and Innovative Practices in Education written by Keengwe, Jared and published by IGI Global. This book was released on 2022-05-06 with total page 474 pages. Available in PDF, EPUB and Kindle. Book excerpt: Even though digital technologies are ubiquitous in education, assessment methods continue to employ traditional assessments even though they are inadequate to provide information about a student's reasoning and conceptual understanding. Digital-based assessment models allow students to demonstrate higher-order skills while integrating digital technologies as a powerful teaching tool. Digital technologies can support inquiry-based learning that is essential to developing a deep conceptual understanding of the content. The Handbook of Research on Digital-Based Assessment and Innovative Practices in Education identifies digital tools and applications for effective assessment of learning, shares various models of digital-based assessment in education, and considers best pedagogical practices for assessment in education. Covering a range of topics such as formative assessments, design thinking, virtual reality, and equity, this major reference work is crucial for educational technologists, instructional designers, policymakers, administrators, faculty, researchers, academicians, scholars, practitioners, instructors, and students.

Download or read book Innovating Assessments to Measure and Support Complex Skills written by OECD and published by OECD Publishing. This book was released on 2023-04-28 with total page 254 pages. Available in PDF, EPUB and Kindle. Book excerpt: Policy makers around the world recognise the importance of developing young people’s 21st century skills like problem solving, creative thinking, self-regulation and collaboration. Many countries also include these skills as part of the intended learning outcomes of their education systems.

Download or read book Visualizations and Dashboards for Learning Analytics written by Muhittin Sahin and published by Springer Nature. This book was released on 2021-12-16 with total page 624 pages. Available in PDF, EPUB and Kindle. Book excerpt: This edited volume fills the gaps in existing literature on visualization and dashboard design for learning analytics. To do so, it presents critical tips to stakeholders and acts as guide to efficient implementation. The book covers the following topics: visualization and dashboard design for learning analytics, visualization and dashboard preferences of stakeholders, learners’ patterns on the dashboard, usability of visualization techniques and the dashboard, dashboard and intervention design, learning and instructional design for learning analytics, privacy and security issues about the dashboard, and future directions of visualization and dashboard design. This book will be of interest to researchers with interest in learning analytics and data analytics, teachers and students in higher education institutions and instructional designers, as it includes contributions from a wide variety of educational and psychological researchers, engineers, instructional designers, learning scientists, and computer scientists interested in learning analytics.

Download or read book Application of Artificial Intelligence to Assessment written by Hong Jiao and published by IAP. This book was released on 2020-03-01 with total page 223 pages. Available in PDF, EPUB and Kindle. Book excerpt: The general theme of this book is to present the applications of artificial intelligence (AI) in test development. In particular, this book includes research and successful examples of using AI technology in automated item generation, automated test assembly, automated scoring, and computerized adaptive testing. By utilizing artificial intelligence, the efficiency of item development, test form construction, test delivery, and scoring could be dramatically increased. Chapters on automated item generation offer different perspectives related to generating a large number of items with controlled psychometric properties including the latest development of using machine learning methods. Automated scoring is illustrated for different types of assessments such as speaking and writing from both methodological aspects and practical considerations. Further, automated test assembly is elaborated for the conventional linear tests from both classical test theory and item response theory perspectives. Item pool design and assembly for the linear-on-the-fly tests elaborates more complications in practice when test security is a big concern. Finally, several chapters focus on computerized adaptive testing (CAT) at either item or module levels. CAT is further illustrated as an effective approach to increasing test-takers’ engagement in testing. In summary, the book includes both theoretical, methodological, and applied research and practices that serve as the foundation for future development. These chapters provide illustrations of efforts to automate the process of test development. While some of these automation processes have become common practices such as automated test assembly, automated scoring, and computerized adaptive testing, some others such as automated item generation calls for more research and exploration. When new AI methods are emerging and evolving, it is expected that researchers can expand and improve the methods for automating different steps in test development to enhance the automation features and practitioners can adopt quality automation procedures to improve assessment practices.

Download or read book The Wiley Handbook of Psychometric Testing written by Paul Irwing and published by John Wiley & Sons. This book was released on 2018-03-14 with total page 1064 pages. Available in PDF, EPUB and Kindle. Book excerpt: A must-have resource for researchers, practitioners, and advanced students interested or involved in psychometric testing Over the past hundred years, psychometric testing has proved to be a valuable tool for measuring personality, mental ability, attitudes, and much more. The word ‘psychometrics’ can be translated as ‘mental measurement’; however, the implication that psychometrics as a field is confined to psychology is highly misleading. Scientists and practitioners from virtually every conceivable discipline now use and analyze data collected from questionnaires, scales, and tests developed from psychometric principles, and the field is vibrant with new and useful methods and approaches. This handbook brings together contributions from leading psychometricians in a diverse array of fields around the globe. Each provides accessible and practical information about their specialist area in a three-step format covering historical and standard approaches, innovative issues and techniques, and practical guidance on how to apply the methods discussed. Throughout, real-world examples help to illustrate and clarify key aspects of the topics covered. The aim is to fill a gap for information about psychometric testing that is neither too basic nor too technical and specialized, and will enable researchers, practitioners, and graduate students to expand their knowledge and skills in the area. Provides comprehensive coverage of the field of psychometric testing, from designing a test through writing items to constructing and evaluating scales Takes a practical approach, addressing real issues faced by practitioners and researchers Provides basic and accessible mathematical and statistical foundations of all psychometric techniques discussed Provides example software code to help readers implement the analyses discussed

Download or read book Human Factors in Simulation and Training written by Dennis A. Vincenzi and published by CRC Press. This book was released on 2023-08-30 with total page 273 pages. Available in PDF, EPUB and Kindle. Book excerpt: Human Factors in Simulation and Training: Theory and Methods covers theoretical concepts on human factors principles as they apply to the fields of simulation and training in the real world. This book discusses traditional and nontraditional aspects of simulation and training. Topics covered include simulation fidelity, transfer of training, limits of simulation and training, virtual reality in the training environment, simulation-based situation awareness training, automated performance measures, performance assessment in simulation, adaptive simulation-based training, and scoring simulations with artificial intelligence This book will be a valuable resource for professionals and graduate students in the fields of ergonomics, human factors, computer engineering, aerospace engineering and occupational health and safety.

Download or read book Enhancing Effective Instruction and Learning Using Assessment Data written by Hong Jiao and published by IAP. This book was released on 2022-01-01 with total page 243 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book introduces theories and practices for using assessment data to enhance learning and instruction. Topics include reshaping the homework review process, iterative learning engineering, learning progressions, learning maps, score report designing, the use of psychosocial data, and the combination of adaptive testing and adaptive learning. In addition, studies proposing new methods and strategies, technical details about the collection and maintenance of process data, and examples illustrating proposed methods and software are included. Chapters 1, 4, 6, 8, and 9 discuss how to make valid interpretations of results and achieve more efficient instructions from various sources of data. Chapters 3 and 7 propose and evaluate new methods to promote students’ learning by using evidence-based iterative learning engineering and supporting the teachers’ use of assessment data, respectively. Chapter 2 provides technical details on the collection, storage, and security protection of process data. Chapter 5 introduces software for automating some aspects of developmental education and the use of predictive modeling. Chapter 10 describes the barriers to using psychosocial data for formative assessment purposes. Chapter 11 describes a conceptual framework for adaptive learning and testing and gives an example of a functional learning and assessment system. In summary, the book includes comprehensive perspectives of the recent development and challenges of using test data for formative assessment purposes. The chapters provide innovative theoretical frameworks, new perspectives on the use of data with technology, and how to build new methods based on existing theories. This book is a useful resource to researchers who are interested in using data and technology to inform decision making, facilitate instructional utility, and achieve better learning outcomes.

Download or read book Measurement Theory and Applications for the Social Sciences written by Deborah L. Bandalos and published by Guilford Publications. This book was released on 2018-01-31 with total page 686 pages. Available in PDF, EPUB and Kindle. Book excerpt: Which types of validity evidence should be considered when determining whether a scale is appropriate for a given measurement situation? What about reliability evidence? Using clear explanations illustrated by examples from across the social and behavioral sciences, this engaging text prepares students to make effective decisions about the selection, administration, scoring, interpretation, and development of measurement instruments. Coverage includes the essential measurement topics of scale development, item writing and analysis, and reliability and validity, as well as more advanced topics such as exploratory and confirmatory factor analysis, item response theory, diagnostic classification models, test bias and fairness, standard setting, and equating. End-of-chapter exercises (with answers) emphasize both computations and conceptual understanding to encourage readers to think critically about the material. ÿ

Download or read book The Wiley Handbook of Cognition and Assessment written by Andre A. Rupp and published by John Wiley & Sons. This book was released on 2016-11-21 with total page 648 pages. Available in PDF, EPUB and Kindle. Book excerpt: This state-of-the-art resource brings together the most innovative scholars and thinkers in the field of testing to capture the changing conceptual, methodological, and applied landscape of cognitively-grounded educational assessments. Offers a methodologically-rigorous review of cognitive and learning sciences models for testing purposes, as well as the latest statistical and technological know-how for designing, scoring, and interpreting results Written by an international team of contributors at the cutting-edge of cognitive psychology and educational measurement under the editorship of a research director at the Educational Testing Service and an esteemed professor of educational psychology at the University of Alberta as well as supported by an expert advisory board Covers conceptual frameworks, modern methodologies, and applied topics, in a style and at a level of technical detail that will appeal to a wide range of readers from both applied and scientific backgrounds Considers emerging topics in cognitively-grounded assessment, including applications of emerging socio-cognitive models, cognitive models for human and automated scoring, and various innovative virtual performance assessments

Download or read book Human Factors in Simulation and Training written by Peter A. Hancock and published by CRC Press. This book was released on 2008-12-17 with total page 470 pages. Available in PDF, EPUB and Kindle. Book excerpt: Discussing issues and concepts relating to human factors in simulation, this book covers theory and application in fields such as space, ships, submarines, naval aviation, and commercial aviation. The authors develop and expand on concepts in simulator usage particularly specific characteristics and issues of simulation and their effect on the validity and functionality of simulators as a training device. The chapters contain in depth discussions of these particular characteristics and issues. They also incorporate theories pertaining to the motivational aspects of training, simulation of social events, and PC based simulation.