Download or read book Estimating Spoken Dialog System Quality with User Models written by Klaus-Peter Engelbrecht and published by Springer Science & Business Media. This book was released on 2012-08-04 with total page 136 pages. Available in PDF, EPUB and Kindle. Book excerpt: Spoken dialog systems have the potential to offer highly intuitive user interfaces, as they allow systems to be controlled using natural language. However, the complexity inherent in natural language dialogs means that careful testing of the system must be carried out from the very beginning of the design process. This book examines how user models can be used to support such early evaluations in two ways: by running simulations of dialogs, and by estimating the quality judgments of users. First, a design environment supporting the creation of dialog flows, the simulation of dialogs, and the analysis of the simulated data is proposed. How the quality of user simulations may be quantified with respect to their suitability for both formative and summative evaluation is then discussed. The remainder of the book is dedicated to the problem of predicting quality judgments of users based on interaction data. New modeling approaches are presented, which process the dialogs as sequences, and which allow knowledge about the judgment behavior of users to be incorporated into predictions. All proposed methods are validated with example evaluation studies.
Download or read book Spoken Dialogue Systems written by Kristiina Jokinen and published by Morgan & Claypool Publishers. This book was released on 2010 with total page 151 pages. Available in PDF, EPUB and Kindle. Book excerpt: Considerable progress has been made in recent years in the development of dialogue systems that support robust and efficient human-machine interaction using spoken language. Spoken dialogue technology allows various interactive applications to be built and used for practical purposes, and research focuses on issues that aim to increase the system's communicative competence by including aspects of error correction, cooperation, multimodality, and adaptation in context. This book gives a comprehensive view of state-of-the-art techniques that are used to build spoken dialogue systems. It provides an overview of the basic issues such as system architectures, various dialogue management methods, system evaluation, and also surveys advanced topics concerning extensions of the basic model to more conversational setups. The goal of the book is to provide an introduction to the methods, problems, and solutions that are used in dialogue system development and evaluation. It presents dialogue modelling and system development issues relevant in both academic and industrial environments and also discusses requirements and challenges for advanced interaction management and future research. Table of Contents: Preface / Introduction to Spoken Dialogue Systems / Dialogue Management / Error Handling / Case Studies: Advanced Approaches to Dialogue Management / Advanced Issues / Methodologies and Practices of Evaluation / Future Directions / References / Author Biographies
Download or read book Quality of Telephone Based Spoken Dialogue Systems written by Sebastian Möller and published by Springer Science & Business Media. This book was released on 2004-11-12 with total page 498 pages. Available in PDF, EPUB and Kindle. Book excerpt: Quality of Telephone-Based Spoken Dialogue Systems is a systematic overview of assessment, evaluation, and prediction methods for the quality of services such as travel and touristic information, phone-directory and messaging, or telephone-banking services. A new taxonomy of quality-of-service is presented which serves as a tool for classifying assessment and evaluation methods, for planning and interpreting evaluation experiments, and for estimating quality. A broad overview of parameters and evaluation methods is given, both on a system-component level and for a fully integrated system. Three experimental investigations illustrate the relationships between system characteristics and perceived quality. The resulting information is needed in all phases of system specification, design, implementation, and operation. Although Quality of Telephone-Based Spoken Dialogue Systems is written from the perspective of an engineer in telecommunications, it is an invaluable source of information for professionals in signal processing, communication acoustics, computational linguistics, speech and language sciences, human factor design and ergonomics
Download or read book Simulation Based Usability Evaluation of Spoken and Multimodal Dialogue Systems written by Stefan Hillmann and published by Springer. This book was released on 2017-11-23 with total page 262 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book describes an extension of the user behaviour simulation (UBS) of an existing tool for automatic usability evaluation (AUE). This extension is based upon a user study with a smart home system. It uses technical-sociological methods for the execution of the study and the analysis of the collected data. A comparison of the resulting UBS with former UBSs, as well as the empirical data, shows that the new simulation approach outperforms the former simulation. The improvement affects the prediction of dialogue metrics that are related to dialogue efficiency and dialogue effectiveness. Furthermore, the book describes a parameter-based data model, as well as a related framework. Both are used to uniformly describe multimodal human-computer interactions and to provide such descriptions for usability evaluations. Finally, the book proposes a new two-stage method for the evaluation of UBSs. The method is based on the computation of a distance measures between two dialogue corpora and the pair-wise comparison of distances among several dialogue corpora.
Download or read book Data Driven Methods for Adaptive Spoken Dialogue Systems written by Oliver Lemon and published by Springer Science & Business Media. This book was released on 2012-10-20 with total page 184 pages. Available in PDF, EPUB and Kindle. Book excerpt: Data driven methods have long been used in Automatic Speech Recognition (ASR) and Text-To-Speech (TTS) synthesis and have more recently been introduced for dialogue management, spoken language understanding, and Natural Language Generation. Machine learning is now present “end-to-end” in Spoken Dialogue Systems (SDS). However, these techniques require data collection and annotation campaigns, which can be time-consuming and expensive, as well as dataset expansion by simulation. In this book, we provide an overview of the current state of the field and of recent advances, with a specific focus on adaptivity.
Download or read book Towards Adaptive Spoken Dialog Systems written by Alexander Schmitt and published by Springer Science & Business Media. This book was released on 2012-09-19 with total page 258 pages. Available in PDF, EPUB and Kindle. Book excerpt: In Monitoring Adaptive Spoken Dialog Systems, authors Alexander Schmitt and Wolfgang Minker investigate statistical approaches that allow for recognition of negative dialog patterns in Spoken Dialog Systems (SDS). The presented stochastic methods allow a flexible, portable and accurate use. Beginning with the foundations of machine learning and pattern recognition, this monograph examines how frequently users show negative emotions in spoken dialog systems and develop novel approaches to speech-based emotion recognition using hybrid approach to model emotions. The authors make use of statistical methods based on acoustic, linguistic and contextual features to examine the relationship between the interaction flow and the occurrence of emotions using non-acted recordings several thousand real users from commercial and non-commercial SDS. Additionally, the authors present novel statistical methods that spot problems within a dialog based on interaction patterns. The approaches enable future SDS to offer more natural and robust interactions. This work provides insights, lessons and inspiration for future research and development, not only for spoken dialog systems, but for data-driven approaches to human-machine interaction in general.
Download or read book Quality of Telephone Based Spoken Dialogue Systems written by Sebastian Möller and published by Springer. This book was released on 2008-11-01 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: Quality of Telephone-Based Spoken Dialogue Systems is a systematic overview of assessment, evaluation, and prediction methods for the quality of services such as travel and touristic information, phone-directory and messaging, or telephone-banking services. A new taxonomy of quality-of-service is presented which serves as a tool for classifying assessment and evaluation methods, for planning and interpreting evaluation experiments, and for estimating quality. A broad overview of parameters and evaluation methods is given, both on a system-component level and for a fully integrated system. Three experimental investigations illustrate the relationships between system characteristics and perceived quality. The resulting information is needed in all phases of system specification, design, implementation, and operation. Although Quality of Telephone-Based Spoken Dialogue Systems is written from the perspective of an engineer in telecommunications, it is an invaluable source of information for professionals in signal processing, communication acoustics, computational linguistics, speech and language sciences, human factor design and ergonomics
Download or read book Highlights of Practical Applications of Scalable Multi Agent Systems The PAAMS Collection written by Javier Bajo and published by Springer. This book was released on 2016-05-19 with total page 455 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the refereed proceedings of the seven workshops co-located with the 14th International Conference on Practical Applications of Agents and Multi-Agent Systems, PAAMS 2016, held in Sevilla, Spain, in June 2016.The 37 full papers presented were carefully reviewed and selected from 77 submissions. The volume presents the papers that have been accepted for the following workshops: Workshop on Agents and Multi-Agent Systems for AAL and e-Health; Workshop on Agent-Based Solutions for Manufacturing and Supply Chain; Workshop on MAS for Complex Networks and Social Computation; Workshop on Decision Making in Dynamic Information Environments; Workshop on Intelligent Systems for Context-based Information Fusion; Workshop on Multi-Agent based Applications for Smart Grids and Sustainable Energy Systems; Workshop on Multiagent System based Learning Environments.
Download or read book An Evaluation Framework for Multimodal Interaction written by Ina Wechsung and published by Springer Science & Business Media. This book was released on 2014-01-06 with total page 204 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book presents (1) an exhaustive and empirically validated taxonomy of quality aspects of multimodal interaction as well as respective measurement methods, (2) a validated questionnaire specifically tailored to the evaluation of multimodal systems and covering most of the taxonomy‘s quality aspects, (3) insights on how the quality perceptions of multimodal systems relate to the quality perceptions of its individual components, (4) a set of empirically tested factors which influence modality choice, and (5) models regarding the relationship of the perceived quality of a modality and the actual usage of a modality.
Download or read book Towards Adaptive Spoken Dialog Systems written by Alexander Schmitt and published by Springer Science & Business Media. This book was released on 2012-09-19 with total page 258 pages. Available in PDF, EPUB and Kindle. Book excerpt: In Monitoring Adaptive Spoken Dialog Systems, authors Alexander Schmitt and Wolfgang Minker investigate statistical approaches that allow for recognition of negative dialog patterns in Spoken Dialog Systems (SDS). The presented stochastic methods allow a flexible, portable and accurate use. Beginning with the foundations of machine learning and pattern recognition, this monograph examines how frequently users show negative emotions in spoken dialog systems and develop novel approaches to speech-based emotion recognition using hybrid approach to model emotions. The authors make use of statistical methods based on acoustic, linguistic and contextual features to examine the relationship between the interaction flow and the occurrence of emotions using non-acted recordings several thousand real users from commercial and non-commercial SDS. Additionally, the authors present novel statistical methods that spot problems within a dialog based on interaction patterns. The approaches enable future SDS to offer more natural and robust interactions. This work provides insights, lessons and inspiration for future research and development, not only for spoken dialog systems, but for data-driven approaches to human-machine interaction in general.
Download or read book Human Computer Interaction INTERACT 2015 written by Julio Abascal and published by Springer. This book was released on 2015-08-31 with total page 716 pages. Available in PDF, EPUB and Kindle. Book excerpt: The four-volume set LNCS 9296-9299 constitutes the refereed proceedings of the 15th IFIP TC13 International Conference on Human-Computer Interaction, INTERACT 2015, held in Bamberg, Germany, in September 2015. The 74 full and short papers and 4 organizational overviews, 2 panels, 6 tutorials, and 11 workshops included in the fourth volume are organized in topical sections on tangible and tactile interaction; tools for design; touch and haptic; user and task modelling; visualization; visualization 3D; visualization in virtual spaces; wearable computing; demonstrations; and interactive posters.
Download or read book ICCM 2012 Proceedings written by and published by Univerlagtuberlin. This book was released on with total page 355 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Predicting User Performance and Errors written by Marc Halbrügge and published by Springer. This book was released on 2017-07-20 with total page 156 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book proposes a combination of cognitive modeling with model-based user interface development to tackle the problem of maintaining the usability of applications that target several device types at once (e.g., desktop PC, smart phone, smart TV). Model-based applications provide interesting meta-information about the elements of the user interface (UI) that are accessible through computational introspection. Cognitive user models can capitalize on this meta-information to provide improved predictions of the interaction behavior of future human users of applications under development. In order to achieve this, cognitive processes that link UI properties to usability aspects like effectiveness (user error) and efficiency (task completion time) are established empirically, are explained through cognitive modeling, and are validated in the course of this treatise. In the case of user error, the book develops an extended model of sequential action control based on the Memory for Goals theory and it is confirmed in different behavioral domains and experimental paradigms. This new model of user cognition and behavior is implemented using the MeMo workbench and integrated with the model-based application framework MASP in order to provide automated usability predictions from early software development stages on. Finally, the validity of the resulting integrated system is confirmed by empirical data from a new application, eliciting unexpected behavioral patterns.
Download or read book Dialogues with Social Robots written by Kristiina Jokinen and published by Springer. This book was released on 2016-12-23 with total page 477 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book explores novel aspects of social robotics, spoken dialogue systems, human-robot interaction, spoken language understanding, multimodal communication, and system evaluation. It offers a variety of perspectives on and solutions to the most important questions about advanced techniques for social robots and chat systems. Chapters by leading researchers address key research and development topics in the field of spoken dialogue systems, focusing in particular on three special themes: dialogue state tracking, evaluation of human-robot dialogue in social robotics, and socio-cognitive language processing. The book offers a valuable resource for researchers and practitioners in both academia and industry whose work involves advanced interaction technology and who are seeking an up-to-date overview of the key topics. It also provides supplementary educational material for courses on state-of-the-art dialogue system technologies, social robotics, and related research fields.
Download or read book Natural Language Dialog Systems and Intelligent Assistants written by G.G. Lee and published by Springer. This book was released on 2015-09-28 with total page 269 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book covers state-of-the-art topics on the practical implementation of Spoken Dialog Systems and intelligent assistants in everyday applications. It presents scientific achievements in language processing that result in the development of successful applications and addresses general issues regarding the advances in Spoken Dialog Systems with applications in robotics, knowledge access and communication. Emphasis is placed on the following topics: speaker/language recognition, user modeling / simulation, evaluation of dialog system, multi-modality / emotion recognition from speech, speech data mining, language resource and databases, machine learning for spoken dialog systems and educational and healthcare applications.
Download or read book Quality of Telephone Based Spoken Dialogue Systems written by Sebastian Möller and published by Springer Science & Business Media. This book was released on 2005-12-28 with total page 480 pages. Available in PDF, EPUB and Kindle. Book excerpt: Quality of Telephone-Based Spoken Dialogue Systems is a systematic overview of assessment, evaluation, and prediction methods for the quality of services such as travel and touristic information, phone-directory and messaging, or telephone-banking services. A new taxonomy of quality-of-service is presented which serves as a tool for classifying assessment and evaluation methods, for planning and interpreting evaluation experiments, and for estimating quality. A broad overview of parameters and evaluation methods is given, both on a system-component level and for a fully integrated system. Three experimental investigations illustrate the relationships between system characteristics and perceived quality. The resulting information is needed in all phases of system specification, design, implementation, and operation. Although Quality of Telephone-Based Spoken Dialogue Systems is written from the perspective of an engineer in telecommunications, it is an invaluable source of information for professionals in signal processing, communication acoustics, computational linguistics, speech and language sciences, human factor design and ergonomics
Download or read book Natural Interaction with Robots Knowbots and Smartphones written by Joseph Mariani and published by Springer Science & Business Media. This book was released on 2014-07-08 with total page 385 pages. Available in PDF, EPUB and Kindle. Book excerpt: These proceedings presents the state-of-the-art in spoken dialog systems with applications in robotics, knowledge access and communication. It addresses specifically: 1. Dialog for interacting with smartphones; 2. Dialog for Open Domain knowledge access; 3. Dialog for robot interaction; 4. Mediated dialog (including crosslingual dialog involving Speech Translation); and,5. Dialog quality evaluation. These articles were presented at the IWSDS 2012 workshop.
