Download or read book Toward a Unified Theory of Audiovisual Integration in Speech Perception written by Nicholas Altieri and published by Universal-Publishers. This book was released on 2010-09-09 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: Auditory and visual speech recognition unfolds in real time and occurs effortlessly for normal hearing listeners. However, model theoretic descriptions of the systems level cognitive processes responsible for integrating auditory and visual speech information are currently lacking, primarily because they rely too heavily on accuracy rather than reaction time predictions. Speech and language researchers have argued about whether audiovisual integration occurs in a parallel or in coactive fashion, and also the extent to which audiovisual occurs in an efficient manner. The Double Factorial Paradigm introduced in Section 1 is an experimental paradigm that is equipped to address dynamical processing issues related to architecture (parallel vs. coactive processing) as well as efficiency (capacity). Experiment 1 employed a simple word discrimination task to assess both architecture and capacity in high accuracy settings. Experiments 2 and 3 assessed these same issues using auditory and visual distractors in Divided Attention and Focused Attention tasks respectively. Experiment 4 investigated audiovisual integration efficiency across different auditory signal-to-noise ratios. The results can be summarized as follows: Integration typically occurs in parallel with an efficient stopping rule, integration occurs automatically in both focused and divided attention versions of the task, and audiovisual integration is only efficient (in the time domain) when the clarity of the auditory signal is relatively poor--although considerable individual differences were observed. In Section 3, these results were captured within the milieu of parallel linear dynamic processing models with cross channel interactions. Finally, in Section 4, I discussed broader implications for this research, including applications for clinical research and neural-biological models of audiovisual convergence.
Download or read book Audiovisual Speech Recognition Correspondence between Brain and Behavior written by Nicholas Altieri and published by Frontiers E-books. This book was released on 2014-07-09 with total page 102 pages. Available in PDF, EPUB and Kindle. Book excerpt: Perceptual processes mediating recognition, including the recognition of objects and spoken words, is inherently multisensory. This is true in spite of the fact that sensory inputs are segregated in early stages of neuro-sensory encoding. In face-to-face communication, for example, auditory information is processed in the cochlea, encoded in auditory sensory nerve, and processed in lower cortical areas. Eventually, these “sounds” are processed in higher cortical pathways such as the auditory cortex where it is perceived as speech. Likewise, visual information obtained from observing a talker’s articulators is encoded in lower visual pathways. Subsequently, this information undergoes processing in the visual cortex prior to the extraction of articulatory gestures in higher cortical areas associated with speech and language. As language perception unfolds, information garnered from visual articulators interacts with language processing in multiple brain regions. This occurs via visual projections to auditory, language, and multisensory brain regions. The association of auditory and visual speech signals makes the speech signal a highly “configural” percept. An important direction for the field is thus to provide ways to measure the extent to which visual speech information influences auditory processing, and likewise, assess how the unisensory components of the signal combine to form a configural/integrated percept. Numerous behavioral measures such as accuracy (e.g., percent correct, susceptibility to the “McGurk Effect”) and reaction time (RT) have been employed to assess multisensory integration ability in speech perception. On the other hand, neural based measures such as fMRI, EEG and MEG have been employed to examine the locus and or time-course of integration. The purpose of this Research Topic is to find converging behavioral and neural based assessments of audiovisual integration in speech perception. A further aim is to investigate speech recognition ability in normal hearing, hearing-impaired, and aging populations. As such, the purpose is to obtain neural measures from EEG as well as fMRI that shed light on the neural bases of multisensory processes, while connecting them to model based measures of reaction time and accuracy in the behavioral domain. In doing so, we endeavor to gain a more thorough description of the neural bases and mechanisms underlying integration in higher order processes such as speech and language recognition.
Download or read book Multisensory and sensorimotor interactions in speech perception written by Kaisa Tiippana and published by Frontiers Media SA. This book was released on 2015-06-26 with total page 265 pages. Available in PDF, EPUB and Kindle. Book excerpt: Speech is multisensory since it is perceived through several senses. Audition is the most important one as speech is mostly heard. The role of vision has long been acknowledged since many articulatory gestures can be seen on the talker's face. Sometimes speech can even be felt by touching the face. The best-known multisensory illusion is the McGurk effect, where incongruent visual articulation changes the auditory percept. The interest in the McGurk effect arises from a major general question in multisensory research: How is information from different senses combined? Despite decades of research, a conclusive explanation for the illusion remains elusive. This is a good demonstration of the challenges in the study of multisensory integration. Speech is special in many ways. It is the main means of human communication, and a manifestation of a unique language system. It is a signal with which all humans have a lot of experience. We are exposed to it from birth, and learn it through development in face-to-face contact with others. It is a signal that we can both perceive and produce. The role of the motor system in speech perception has been debated for a long time. Despite very active current research, it is still unclear to which extent, and in which role, the motor system is involved in speech perception. Recent evidence shows that brain areas involved in speech production are activated during listening to speech and watching a talker's articulatory gestures. Speaking involves coordination of articulatory movements and monitoring their auditory and somatosensory consequences. How do auditory, visual, somatosensory, and motor brain areas interact during speech perception? How do these sensorimotor interactions contribute to speech perception? It is surprising that despite a vast amount of research, the secrets of speech perception have not yet been solved. The multisensory and sensorimotor approaches provide new opportunities in solving them. Contributions to the research topic are encouraged for a wide spectrum of research on speech perception in multisensory and sensorimotor contexts, including novel experimental findings ranging from psychophysics to brain imaging, theories and models, reviews and opinions.
Download or read book Modularity and the Motor theory of Speech Perception written by Michael Studdert-Kennedy and published by Psychology Press. This book was released on 2014-01-02 with total page 484 pages. Available in PDF, EPUB and Kindle. Book excerpt: A compilation of the proceedings of a conference held to honor Alvin M. Liberman for his outstanding contributions to research in speech perception, this volume deals with two closely related and controversial proposals for which Liberman and his colleagues at Haskins Laboratories have argued forcefully over the past 35 years. The first is that articulatory gestures are the units not only of speech production but also of speech perception; the second is that speech production and perception are not cognitive processes, but rather functions of a special mechanism. This book explores the implications of these proposals not only for speech production and speech perception, but for the neurophysiology of language, language acquisition, higher-level linguistic processing, the visual perception of phonetic gestures, the production and perception of sign language, the reading process, and learning to read. The contributors to this volume include linguists, psycholinguists, speech scientists, neurophysiologists, and ethologists. Liberman himself responds in the final chapter.
Download or read book Hearing by Eye II written by Ruth Campbell and published by Psychology Press. This book was released on 1998 with total page 338 pages. Available in PDF, EPUB and Kindle. Book excerpt: This volume outlines developments in practical and theoretical research into speechreading lipreading.
Download or read book Hearing and Speech written by Quentin Summerfield and published by Psychology Press. This book was released on 1991 with total page 444 pages. Available in PDF, EPUB and Kindle. Book excerpt: Many experimental psychologists carry out research on hearing and speech, yet only rarely is their work reported in the Quarterly Journal. This Special Issue seeks to redress the imbalance. It contains nineteen papers contributed by scientists working in Britain, the U.S.A., and The Netherlands. The papers were among those submitted in response to a call for papers and were subjected to the Journal's usual process of peer review. Seventeen papers report new perceptual data. They cover a wide range of topical issues in speech perception and psychoacoustics including: profile analysis, comodulation masking release, and across-channel masking of modulated signals; adaptation, detection, and lateralization; frequency selectivity and the perception of loudness in listeners with impaired hearing; the analysis of cues to phonetic categories by listeners with normal hearing and by patients with cochlear implants; phonemic restoration; second-language learning; the role of resolved harmonics in specifying formant frequencies; audio?visual speech perception; and prosodic cues issued by talkers when correcting errors in speech production. Finally, two papers describe new models of auditory and perceptual processes: one is a mathematical account of audio-visual integration in speech perception; the other is a computational model of auditory stream segregation. Most of the papers are relatively short and have been written in a style that should make them accessible to a wide readership.
Download or read book Papers in Speech Communication written by Joanne L. Miller and published by . This book was released on 1991 with total page 792 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Audiovisual Speech Processing written by Gérard Bailly and published by Cambridge University Press. This book was released on 2012-04-26 with total page 507 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book presents a complete overview of all aspects of audiovisual speech including perception, production, brain processing and technology.
Download or read book Cognitive Neuroscience written by Marie T. Banich and published by Cambridge University Press. This book was released on 2018-04-05 with total page 680 pages. Available in PDF, EPUB and Kindle. Book excerpt: Updated fully, this accessible and comprehensive text highlights the most important theoretical, conceptual and methodological issues in cognitive neuroscience. Written by two experienced teachers, the consistent narrative ensures that students link concepts across chapters, and the careful selection of topics enables them to grasp the big picture without getting distracted by details. Clinical applications such as developmental disorders, brain injuries and dementias are highlighted. In addition, analogies and examples within the text, opening case studies, and 'In Focus' boxes engage students and demonstrate the relevance of the material to real-world concerns. Students are encouraged to develop the critical thinking skills that will enable them to evaluate future developments in this fast-moving field. A new chapter on Neuroscience and Society considers how cognitive neuroscience issues relate to the law, education, and ethics, highlighting the clinical and real-world relevance. An expanded online package includes a test bank.
Download or read book Audiovisual Speech Processing written by Gérard Bailly and published by . This book was released on 2012 with total page 470 pages. Available in PDF, EPUB and Kindle. Book excerpt: "When we speak, we configure the vocal tract which shapes the visible motions of the face and the patterning of the audible speech acoustics. Similarly, we use these visible and audible behaviors to perceive speech. This book showcases a broad range of research investigating how these two types of signals are used in spoken communication, how they interact, and how they can be used to enhance the realistic synthesis and recognition of audible and visible speech. The volume begins by addressing two important questions about human audiovisual performance: how auditory and visual signals combine to access the mental lexicon and where in the brain this and related processes take place. It then turns to the production and perception of multimodal speech and how structures are coordinated within and across the two modalities. Finally, the book presents overviews and recent developments in machine-based speech recognition and synthesis of AV speech"--Provided by publisher.
Download or read book Perception Cognition Interface Cross Modal Experiences Insights into Unified Consciousness written by Aleksandra Mroczko-Wąsowicz and published by Frontiers Media SA. This book was released on 2017-01-26 with total page 137 pages. Available in PDF, EPUB and Kindle. Book excerpt: The present Research Topic explores closely related aspects of mental functioning, namely an interplay between perception and cognition, interactions among various sensory modalities, and finally, more or less unified conscious experiences arising in the context of these relations. Contributions emphasize a high flexibility observed in perception and may be seen as potential challenges to the traditional modular architecture of perceptual systems. Although the articles describe different phenomena, they follow one common theme - to investigate broadly understood unified experience - by studying either perception-cognition integration or the integration between sensory modalities. These integrative processes may well apply to subpersonal unconscious representations. However, the aim here is to approach phenomenal experience and thus a straightforward way of thinking about it is in terms of conscious perception. Putting together scientific and philosophical concerns, this special issue encourages extending the study of perceptual experience beyond the single sense perception to advance our understanding of the complex interdependencies between different sensory modalities, other mental domains, and various kinds of unifying relations within conscious experience. It exhibits a remarkable need to study these phenomena in tangent, and so, the authors examine a variety of ways in which our perceptual experiences may be cross-modal or multisensory, integrated, embodied, synesthetic, cognitively penetrated, or otherwise affected by top-down influences. The Research Topic comprises theoretical and empirical contributions of such fields as philosophy of mind, cognitive science, psychology, and neuroscience in the form of hypothesis and theory articles, original research articles, opinion papers, reviews, and commentaries.
Download or read book A Matter of Bottom Up or Top Down Processes The Role of Attention in Multisensory Integration written by Jess Hartcher-O'Brien and published by Frontiers Media SA. This book was released on 2017-07-04 with total page 141 pages. Available in PDF, EPUB and Kindle. Book excerpt: The integration of information from various sensory modalities influences behaviour. It can induce behavioural benefits such as faster reaction times and enhanced detection of noisy signals but may also produce illusions, all of which have been characterized by specific neuronal signatures. Yet, while these effects of multisensory integration are largely accepted, the role of attention in this process is still the object of intense debate. On the one hand, it has been suggested that attention may guide multisensory integration in a top-down fashion by selection of specific inputs to be integrated out of the plethora of information in our environment. On the other hand, there is evidence that integration could occur in a bottom-up manner, based on temporal and spatial correlations, and outside the focus of attention. An extreme example is the multisensory enhancement of neural responses in anesthetised animals. Attention itself is not a unitary construct, and may refer to a range of different selection mechanisms. Therefore, the interplay between attention and multisensory integration can take many forms which explain, in part, the diversity of findings and the disputes in the literature. The goal of this Research Topic is to help clarify the picture by trying to answer the following questions from various perspectives: Under which circumstances does multisensory integration take place without attention?, and, When does attention determine the fate of multisensory integration?
Download or read book Speech Perception By Ear and Eye written by Dominic W. Massaro and published by Psychology Press. This book was released on 2014-02-25 with total page 331 pages. Available in PDF, EPUB and Kindle. Book excerpt: First published in 1987. This book is about the processing of information. The central domain of interest is face-to-face communication in which the speaker makes available both audible and visible characteristics to the perceiver. Articulation by the speaker creates changes in atmospheric pressure for hearing and provides tongue, lip, jaw, and facial movements for seeing. These characteristics must be processed by the perceiver to recover the message conveyed by the speaker. The speaker and perceiver must share a language to make communication possible; some internal representation is necessarily functional for the perceiver to recover the message of the speaker. The current study integrates information-processing and psychophysical approaches in the analysis of speech perception by ear and eye.
Download or read book Systems Factorial Technology written by Daniel Little and published by Academic Press. This book was released on 2017-04-10 with total page 428 pages. Available in PDF, EPUB and Kindle. Book excerpt: Systems Factorial Technology: A Theory Driven Methodology for the Identification of Perceptual and Cognitive Mechanisms explores the theoretical and methodological tools used to investigate fundamental questions central to basic psychological and perceptual processes. Such processes include detection, identification, classification, recognition, and decision-making. This book collects the tools that allow researchers to deal with the pervasive model mimicry problems which exist in standard experimental and theoretical paradigms and includes novel applications to not only basic psychological questions, but also clinical diagnosis and links to neuroscience. Researchers can use this book to begin using the methodology behind SFT and to get an overview of current uses and future directions. The collected developments and applications of SFT allow us to peer inside the human mind and provide strong constraints on psychological theory. Provides a thorough introduction to the diagnostic tools offered by SFT Includes a tutorial on applying the method to reaction time data from a variety of different situations Introduces novel advances for testing the significance of SFT results Incorporates new measures that allow for the relaxation of the high accuracy criterion Examines tools to expand the scope of SFT analyses Applies SFT to a spectrum of different cognitive domains across different sensory modalities
Download or read book The Handbook of Multisensory Processes written by Gemma Calvert and published by MIT Press. This book was released on 2004 with total page 952 pages. Available in PDF, EPUB and Kindle. Book excerpt: Research is suggesting that rather than our senses being independent, perception is fundamentally a multisensory experience. This handbook reviews the evidence and explores the theory of broad underlying principles that govern sensory interactions, regardless of the specific senses involved.
Download or read book The Oxford Handbook of Cognitive Neuroscience written by Kevin N Ochsner and published by Oxford University Press. This book was released on 2013-11-13 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: Cognitive neuroscience has grown into a rich and complex discipline, some 35 years after the term was coined. Given the great expanse of the field, an inclusive and authoritative resource such as this handbook is needed for examining the current state-of-the-science in cognitive neuroscience. Spread across two volumes, the 59 chapters included in this handbook systemically survey all aspects of cognitive neuroscience, spanning perception, attention, memory, language, emotion, self and social cognition, higher cognitive functions, and clinical applications. Additional chapters cover topics ranging from the use of top-down cognitive processes in visual perception to the representation and recognition of objects and spatial relations; attention and its relationship to action as well as visual motor control; language and related core abilities including semantics, speech perception and production, the distinction between linguistic competence and performance, and the capacity for written language. Special coverage is also given to chapters describing the psychopharmacology of cognition, the theory of mind, the neuroscience underlying the regulation of emotion, and neuropsychological and neuroimaging evidence that supports the special status of self-knowledge in memory. This handbook provides a comprehensive compendium of research on cognitive neuroscience that will be widely accessible to students, researchers, and professionals working in this exciting and growing field.
Download or read book Toward a Unified Theory of Development written by John P. Spencer and published by Oxford University Press, USA. This book was released on 2009 with total page 424 pages. Available in PDF, EPUB and Kindle. Book excerpt: This resource defines and refines two major theoretical approaches within developmental science that address the central issues of development-connectionism and dynamical systems theory.
