Download or read book Recent Perspectives on Gesture and Multimodality written by Anabela Cruz-Santos and published by Cambridge Scholars Publishing. This book was released on 2019-07-14 with total page 184 pages. Available in PDF, EPUB and Kindle. Book excerpt: What is gesture and what does it do? What is the meaning of multimodality? What do these concepts signify within the different theoretical approaches to interaction and communication among human beings? Why do we study gesture and multimodality? The thirteen chapters that make up this volume provide answers to these questions. They bring together an eclectic set of recent studies on visible bodily actions conducted by junior and senior researchers and are a testimony to the curiosity and vitality that have always distinguished gesture studies. This young yet rapidly growing field investigates the semiotic features of gesture in relation to speech as integral parts of utterances, the different uses of gestures with and without speech, such as gestures in language acquisition, gestures in the performing arts (music, dance, theatre) and gestures in Artificial Intelligence.
Download or read book New Perspectives on Narrative and Multimodality written by Ruth Page and published by Routledge. This book was released on 2009-09-10 with total page 243 pages. Available in PDF, EPUB and Kindle. Book excerpt: This study investigates the richly diverse but integrated semiotic potential of storytelling. Unlike other interdisciplinary approaches to narrative studies which have privileged the study of words in storytelling, this unique collection provides a much needed analysis of how narrative operates using combinations of visual, typographic, aural, gestural and haptic resources. Although both multimodal theory and narrative studies have been invigorated by a variety of theoretical approaches, this volume seeks to avoid a single dominant paradigm. Instead, the contributors use literary criticism, linguistics and new media frameworks in a series of critical studies that are directly engaged with a range of multimodal stories. The contributors analyze works that include oral accounts of personal experience, opera, cartoons, print literature and new media forms of storytelling such as experimental digital fiction and fanfiction.
Download or read book Gesture and Multimodal Development written by Jean-Marc Colletta and published by John Benjamins Publishing. This book was released on 2012 with total page 236 pages. Available in PDF, EPUB and Kindle. Book excerpt: Brings together studies from language acquisition and developmental psychology. This title addresses topics such as: gesture use in prelinguistic infants with a focus on pointing, the relationship between gestures and lexical development in typically developing and deaf children and even how gesture can help to learn mathematics
Download or read book Perspectives on Multimodality written by Eija Ventola and published by John Benjamins Publishing. This book was released on 2004-01-01 with total page 260 pages. Available in PDF, EPUB and Kindle. Book excerpt: This volume sign posts several paths of multimodality research and theory-building today. The chapters represent a cross-section of current perspectives on multimodal discourse with a special focus on theoretical and methodological issues (mode hierarchies, modelling semiotic resources as multiple semiotic systems, multimodal corpus annotation). In addition, it discusses a wide range of applications for multimodal description in fields like mathematics, entertainment, education, museum design, medicine and translation.
Download or read book Repetitions in Gesture written by Jana Bressem and published by Walter de Gruyter GmbH & Co KG. This book was released on 2021-09-07 with total page 253 pages. Available in PDF, EPUB and Kindle. Book excerpt: Repetitive sequences play a major role as a pattern-building device and are a basic syntagmatic linguistic means on all language levels in spoken and signed languages. Little attention has been paid to investigating them in multimodal language use. Do gestures exhibit different types of repetitive sequences? Do they build complex units based on these types and if so, how is the pattern building to be described? How is the interrelation of gestural and spoken units in such complex units? Is it possible to identify repetitive patterns that are comparable to spoken and signed languages and/or patterns specific to the gestural modality? Based on a corpus-analysis of multimodal usage-events, 7 chapters explore gestural repetitions with regard to their structure, semantic and syntactic relevance for multimodal utterances, and cognitive saliency. Fine-grained cognitive-linguistic analyses of multimodal usage events reveal that gestural repetitions are not only a basic principle of building patterns in spoken and signed languages, but also in gestures. By addressing questions of mediality and multimodality of language-in-use, the book contributes to the investigation of repetition as a fundamental means of sign and meaning construction (crosscutting modalities) and enhances the understanding of the multimodal character of language in use.
Download or read book Gesture Based Communication in Human Computer Interaction written by Antonio Camurri and published by Springer. This book was released on 2011-04-02 with total page 571 pages. Available in PDF, EPUB and Kindle. Book excerpt: Research on the multifaceted aspects of modeling, analysis, and synthesis of - man gesture is receiving growing interest from both the academic and industrial communities. On one hand, recent scienti?c developments on cognition, on - fect/emotion, on multimodal interfaces, and on multimedia have opened new perspectives on the integration of more sophisticated models of gesture in c- putersystems.Ontheotherhand,theconsolidationofnewtechnologiesenabling “disappearing” computers and (multimodal) interfaces to be integrated into the natural environments of users are making it realistic to consider tackling the complex meaning and subtleties of human gesture in multimedia systems, - abling a deeper, user-centered, enhanced physical participation and experience in the human-machine interaction process. The research programs supported by the European Commission and s- eral national institutions and governments individuated in recent years strategic ?elds strictly concerned with gesture research. For example, the DG Infor- tion Society of the European Commission (www.cordis.lu/ist) supports several initiatives, such as the “Disappearing Computer” and “Presence” EU-IST FET (Future and Emerging Technologies), the IST program “Interfaces & Enhanced Audio-Visual Services” (see for example the project MEGA, Multisensory - pressive Gesture Applications, www.megaproject.org), and the IST strategic - jective “Multimodal Interfaces.” Several EC projects and other funded research are represented in the chapters of this book. Awiderangeofapplicationscanbene?tfromadvancesinresearchongesture, from consolidated areas such as surveillance to new or emerging ?elds such as therapy and rehabilitation, home consumer goods, entertainment, and aud- visual, cultural and artistic applications, just to mention only a few of them.
Download or read book Gesture and Multimodal Development written by Jean-Marc Colletta and published by John Benjamins Publishing. This book was released on 2012-06-13 with total page 237 pages. Available in PDF, EPUB and Kindle. Book excerpt: We gesture while we talk and children use gestures prior to words to communicate during the first year. Later, as words become the preferred form of communication, children continue to gesture to reinforce or extend the spoken messages or even to replace them. This volume, originally published as a Special Issue of Gesture 10:2/3 (2010), brings together studies from language acquisition and developmental psychology. It provides a review of common theoretical, methodological and empirical themes, and the contributions address topics such as gesture use in prelinguistic infants with a special and new focus on pointing, the relationship between gestures and lexical development in typically developing and deaf children and even how gesture can help to learn mathematics. All in all, it brings additional evidence on how gestures are related to language, communication and mind development.
Download or read book Integrating Gestures written by Silva Ladewig and published by Walter de Gruyter GmbH & Co KG. This book was released on 2020-07-20 with total page 254 pages. Available in PDF, EPUB and Kindle. Book excerpt: Gestures are now viewed as an integral part of spoken language. But little attention has been paid to the recipients’ cognitive processes of integrating both gesture and speech. How do people understand a speaker’s gestures when inserted into gaps in the flow of speech? What cognitive-semiotic mechanisms allow this integration to occur? And what linguistic and gestural properties do people draw on when construing multimodal meaning? This book offers answers by investigating multimodal utterances in which speech is replaced by gestures. Through fine-grained cognitive-linguistic and cognitive-semiotic analyses of multimodal utterances combined with naturalistic perception experiments, six chapters explore gestures’ potential to realize grammatical notions of nouns and verbs and to integrate with speech by merging into multimodal syntactic constructions. Analyses of speech-replacing gestures and a range of related phenomena compel us to consider gestures as well as spoken and signed language as manifestations of the same conceptual system. An overarching framework is proposed for studying these different modalities together – a multimodal cognitive grammar.
Download or read book Emerging Perspectives on Gesture and Embodiment in Mathematics written by Laurie D. Edwards and published by IAP. This book was released on 2014-07-01 with total page 279 pages. Available in PDF, EPUB and Kindle. Book excerpt: The purpose of the book is to establish a common language for, and understanding of, embodiment as it applies to mathematical thinking, and to link mathematics education research to recent work in gesture studies, cognitive linguistics and the theory of embodied cognition. Just as in past decades, mathematics education experienced a "turn to the social" in which socio-cultural factors were explored, in recent years there has been a nascent "turn to the body." An increasing number of researchers and theorists in mathematics education have become interested in the fact that, although mathematics may be socially constructed, this construction is not arbitrary or unconstrained, but rather is rooted in, and shaped by, the body. All those who engage with mathematics, whether at an elementary or advanced level, share the same basic biological and cognitive capabilities, as well as certain common physical experiences that come with being humans living in a material world. In addition, the doing and communicating of mathematics is never a purely intellectual activity: it involves a wide range of bodily actions, from committing inscriptions to paper or whiteboard, to speaking, listening, gesturing and gazing. This volume will present recent research on gesture and mathematics, within a framework that addresses several levels of mathematical development. The chapters will begin with contributions that examine early mathematical and proto-mathematical knowledge, for example, the conservation of volume and counting. The role of gesture in teaching and learning arithmetic procedures will be addressed. Core concepts and tools from secondary level mathematics will be investigated, including algebra, functions and graphing. And finally, research into the embodied understanding of advanced topics in geometry and calculus will be presented. The overall goal for the volume is to acknowledge the multimodal nature of mathematical knowing, and to contribute to the creation of a model of the interactions and mutual influences of bodily motion, spatial thinking, gesture, speech and external inscriptions on mathematical thinking, communication and learning. The intended audience is researchers and theorists in mathematics education as well as graduate students in the field.
Download or read book Stories and Social Media written by Ruth E. Page and published by Routledge. This book was released on 2013-03-01 with total page 254 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book examines everyday stories of personal experience that are published online in contemporary forms of social media. Taking examples from discussion boards, blogs, social network sites, microblogging sites, wikis, collaborative and participatory storytelling projects, Ruth Page explores how new and existing narrative genres are being (re)shaped in different online contexts. The book shows how the characteristics of social media, which emphasize recency, interpersonal connection and mobile distribution, amplify or reverse different aspects of canonical storytelling. The new storytelling patterns which emerge provide a fresh perspective on some of the key concepts in narrative research: structure, evaluation and the location of speaker and audience in time and space. The online stories are profoundly social in nature, and perform important identity work for their tellers as they interact with their audiences - identities which range from celebrities in Twitter, cancer survivors in the blogosphere to creative writers convening storytelling projects or local histories. Stories and Social Media brings together the stories told in well-known sites like Facebook and lesser-known community archives, providing a landmark survey and critique of personal storytelling as it is being reworked online at the start of the 21st century.
Download or read book Integrating Gestures written by Gale Stam and published by John Benjamins Publishing. This book was released on 2011 with total page 381 pages. Available in PDF, EPUB and Kindle. Book excerpt: Gestures are ubiquitous and natural in our everyday life. They convey information about culture, discourse, thought, intentionality, emotion, intersubjectivity, cognition, and first and second language acquisition. Additionally, they are used by non-human primates to communicate with their peers and with humans. Consequently, the modern field of gesture studies has attracted researchers from a number of different disciplines such as anthropology, cognitive science, communication, neuroscience, psycholinguistics, primatology, psychology, robotics, sociology and semiotics. This volume presents an overview of the depth and breadth of current research in gesture. Its focus is on the interdisciplinary nature of gesture. The twenty-six chapters included in the volume are divided into six sections or themes: the nature and functions of gesture, first language development and gesture, second language effects on gesture, gesture in the classroom and in problem solving, gesture aspects of discourse and interaction, and gestural analysis of music and dance.
Download or read book Body Language Communication Volume 2 written by Cornelia Müller and published by Walter de Gruyter GmbH & Co KG. This book was released on 2014-10-29 with total page 1084 pages. Available in PDF, EPUB and Kindle. Book excerpt: Volume II of the handbook offers a unique collection of exemplary case studies. In five chapters and 99 articles it presents the state of the art on how body movements are used for communication around the world. Topics include the functions of body movements, their contexts of occurrence, their forms and meanings, their integration with speech, and how bodily motion can function as language. By including an interdisciplinary chapter on ‘embodiment’, volume II explores the body and its role in the grounding of language and communication from one of the most widely discussed current theoretical perspectives. Volume II of the handbook thus entails the following chapters: VI. Gestures across cultures, VII. Body movements: functions, contexts and interactions, VIII. Gesture and language, IX. Embodiment: the body and its role for cognition, emotion, and communication, X. Sign Language: Visible body movements as language. Authors include: Mats Andrèn, Richard Asheley, Benjamin Bergen, Ulrike Bohle, Dominique Boutet, Heather Brookes, Penelope Brown, Kensy Cooperrider, Onno Crasborn, Seana Coulson, James Essegby, Maria Graziano, Marianne Gullberg, Simon Harrison, Hermann Kappelhoff, Mardi Kidwell, Irene Kimbara, Stefan Kopp, Grigoriy Kreidlin, Dan Loehr, Irene Mittelberg, Aliyah Morgenstern, Rafael Nuñez, Isabella Poggi, David Quinto-Pozos, Monica Rector, Pio Enrico Ricci-Bitti, Göran Sonesson, Timo Sowa, Gale Stam, Eve Sweetser, Mark Tutton, Ipke Wachsmuth, Linda Waugh, Sherman Wilcox.
Download or read book Examining the Cross modal Patterning of Gesture and Speech in Real time Narrative written by Doron Lee Cohen and published by . This book was released on 2010 with total page 282 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book New Perspectives on Narrative and Multimodality written by Ruth Page and published by Routledge. This book was released on 2009-09-10 with total page 410 pages. Available in PDF, EPUB and Kindle. Book excerpt: The contributors in this collection question what kinds of relationships hold between narrative studies and the recently established field of multimodality, evaluate how we might develop an analytical vocabulary which recognizes that stories do not consist of words alone, and demonstrate the ways in which multimodality brings into fresh focus the embodied nature of narrative production and processing. Engaging with a spectrum of multimodal storytelling, from ‘low tech’ examples encompassing face-to-face stories, comic books, printed literature, through to opera, film adaptation and television documentary, stretching beyond to narratives that employ new media such as hypertext, performance art, and interactive museum guides, this volume examines the interplay of semiotic codes (visual, oral, aural, haptic, physiological) within each case under scrutiny, thereby exposing both points of commonality and difference in the range of multimodal narrative experiences.
Download or read book Performing Kamishibai written by Tara McGowan and published by Routledge. This book was released on 2015-04-10 with total page 231 pages. Available in PDF, EPUB and Kindle. Book excerpt: Kamishibai (paper-theater), a Japanese picture-storytelling medium, is gaining global interest as we move from a text-based culture to one that emphasizes multiple semiotic systems and performance. This is the first volume to explore the potential of kamishibai as a dynamic "new" interactive medium for teaching multimodal communication and shows how synchronizing oral, visual and gestural modes develops students’ awareness of all modes of communication as potential resources in their learning. By examining the multiple modes involved in kamishibai through actual student performances over several venues, this volume overturns commonly held expectations about literacy in the classroom and provides a critical perspective on assumptions about other media. It offers much-needed information about a medium that is attracting interest from educators, academics and artists worldwide.
Download or read book Transmedia Directors written by Carol Vernallis and published by Bloomsbury Publishing USA. This book was released on 2019-12-26 with total page 529 pages. Available in PDF, EPUB and Kindle. Book excerpt: Transmedia Directors focuses on artist-practitioners who work across media, platforms and disciplines, including film, television, music video, commercials and the internet. Working in the age of media convergence, today's em/impresarios project a distinctive style that points toward a new contemporary aesthetics. The media they engage with enrich their practices – through film and television (with its potential for world-building and sense of the past and future), music video (with its audiovisual aesthetics and rhythm), commercials (with their ability to project a message quickly) and the internet (with its refreshed concepts of audience and participation), to larger forms like restaurants and amusement parks (with their materiality alongside today's digital aesthetics). These directors encourage us to reassess concepts of authorship, assemblage, transmedia, audiovisual aesthetics and world-building. Providing a vital resource for scholars and practitioners, this collection weaves together insights about artist-practitioners' collaborative processes as well as strategies for composition, representation, subversion and resistance.
Download or read book Body Sound and Space in Music and Beyond Multimodal Explorations written by Clemens Wöllner and published by Routledge. This book was released on 2017-04-07 with total page 324 pages. Available in PDF, EPUB and Kindle. Book excerpt: Body and space refer to vital and interrelated dimensions in the experience of sounds and music. Sounds have an overwhelming impact on feelings of bodily presence and inform us about the space we experience. Even in situations where visual information is artificial or blurred, such as in virtual environments or certain genres of film and computer games, sounds may shape our perceptions and lead to surprising new experiences. This book discusses recent developments in a range of interdisciplinary fields, taking into account the rapidly changing ways of experiencing sounds and music, the consequences for how we engage with sonic events in daily life and the technological advancements that offer insights into state-of-the-art methods and future perspectives. Topics range from the pleasures of being locked into the beat of the music, perception–action coupling and bodily resonance, and affordances of musical instruments, to neural processing and cross-modal experiences of space and pitch. Applications of these findings are discussed for movement sonification, room acoustics, networked performance, and for the spatial coordination of movements in dance, computer gaming and interactive artistic installations.
