Download or read book Real time Hand Gesture Detection and Recognition for Human Computer Interaction written by Nasser Hasan Abdel-Qader Dardas and published by . This book was released on 2012 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: This thesis focuses on bare hand gesture recognition by proposing a new architecture to solve the problem of real-time vision-based hand detection, tracking, and gesture recognition for interaction with an application via hand gestures. The first stage of our system allows detecting and tracking a bare hand in a cluttered background using face subtraction, skin detection and contour comparison. The second stage allows recognizing hand gestures using bag-of-features and multi-class Support Vector Machine (SVM) algorithms. Finally, a grammar has been developed to generate gesture commands for application control. Our hand gesture recognition system consists of two steps: offline training and online testing. In the training stage, after extracting the keypoints for every training image using the Scale Invariance Feature Transform (SIFT), a vector quantization technique will map keypoints from every training image into a unified dimensional histogram vector (bag-of-words) after K-means clustering. This histogram is treated as an input vector for a multi-class SVM to build the classifier. In the testing stage, for every frame captured from a webcam, the hand is detected using my algorithm. Then, the keypoints are extracted for every small image that contains the detected hand posture and fed into the cluster model to map them into a bag-of-words vector, which is fed into the multi-class SVM classifier to recognize the hand gesture. Another hand gesture recognition system was proposed using Principle Components Analysis (PCA). The most eigenvectors and weights of training images are determined. In the testing stage, the hand posture is detected for every frame using my algorithm. Then, the small image that contains the detected hand is projected onto the most eigenvectors of training images to form its test weights. Finally, the minimum Euclidean distance is determined among the test weights and the training weights of each training image to recognize the hand gesture. Two application of gesture-based interaction with a 3D gaming virtual environment were implemented. The exertion videogame makes use of a stationary bicycle as one of the main inputs for game playing. The user can control and direct left-right movement and shooting actions in the game by a set of hand gesture commands, while in the second game, the user can control and direct a helicopter over the city by a set of hand gesture commands.
Download or read book Face Detection and Gesture Recognition for Human Computer Interaction written by Ming-Hsuan Yang and published by Springer Science & Business Media. This book was released on 2012-12-06 with total page 188 pages. Available in PDF, EPUB and Kindle. Book excerpt: Traditionally, scientific fields have defined boundaries, and scientists work on research problems within those boundaries. However, from time to time those boundaries get shifted or blurred to evolve new fields. For instance, the original goal of computer vision was to understand a single image of a scene, by identifying objects, their structure, and spatial arrangements. This has been referred to as image understanding. Recently, computer vision has gradually been making the transition away from understanding single images to analyzing image sequences, or video understanding. Video understanding deals with understanding of video sequences, e. g. , recognition of gestures, activities, facial expressions, etc. The main shift in the classic paradigm has been from the recognition of static objects in the scene to motion-based recognition of actions and events. Video understanding has overlapping research problems with other fields, therefore blurring the fixed boundaries. Computer graphics, image processing, and video databases have obvious overlap with computer vision. The main goal of computer graphics is to gener ate and animate realistic looking images, and videos. Researchers in computer graphics are increasingly employing techniques from computer vision to gen erate the synthetic imagery. A good example of this is image-based rendering and modeling techniques, in which geometry, appearance, and lighting is de rived from real images using computer vision techniques. Here the shift is from synthesis to analysis followed by synthesis.
Download or read book Real Time Vision for Human Computer Interaction written by Branislav Kisacanin and published by Springer Science & Business Media. This book was released on 2005-08-23 with total page 324 pages. Available in PDF, EPUB and Kindle. Book excerpt: The need for natural and effective Human-Computer Interaction (HCI) is increasingly important due to the prevalence of computers in human activities. Computer vision and pattern recognition continue to play a dominant role in the HCI realm. However, computer vision methods often fail to become pervasive in the field due to the lack of real-time, robust algorithms, and novel and convincing applications. This state-of-the-art contributed volume is comprised of articles by prominent experts in computer vision, pattern recognition and HCI. It is the first published text to capture the latest research in this rapidly advancing field with exclusive focus on real-time algorithms and practical applications in diverse and numerous industries, and it outlines further challenges in these areas. Real-Time Vision for Human-Computer Interaction is an invaluable reference for HCI researchers in both academia and industry, and a useful supplement for advanced-level courses in HCI and Computer Vision.
Download or read book Real time 2D Static Hand Gesture Recognition and 2D Hand Tracking for Human Computer Interaction written by Pavel Alexandrovich Popov and published by . This book was released on 2020 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: The topic of this thesis is Hand Gesture Recognition and Hand Tracking for user interface applications. 3 systems were produced, as well as datasets for recognition and tracking, along with UI applications to prove the concept of the technology. These represent significant contributions to resolving the hand recognition and tracking problems for 2d systems. The systems were designed to work in video only contexts, be computationally light, provide recognition and tracking of the user's hand, and operate without user driven fine tuning and calibration. Existing systems require user calibration, use depth sensors and do not work in video only contexts, or are computationally heavy requiring GPU to run in live situations. A 2-step static hand gesture recognition system was created which can recognize 3 different gestures in real-time. A detection step detects hand gestures using machine learning models. A validation step rejects false positives. The gesture recognition system was combined with hand tracking. It recognizes and then tracks a user's hand in video in an unconstrained setting. The tracking uses 2 collaborative strategies. A contour tracking strategy guides a minimization based template tracking strategy and makes it real-time, robust, and recoverable, while the template tracking provides stable input for UI applications. Lastly, an improved static gesture recognition system addresses the drawbacks due to stratified colour sampling of the detection boxes in the detection step. It uses the entire presented colour range and clusters it into constituent colour modes which are then used for segmentation, which improves the overall gesture recognition rates. One dataset was produced for static hand gesture recognition which allowed for the comparison of multiple different machine learning strategies, including deep learning. Another dataset was produced for hand tracking which provides a challenging series of user scenarios to test the gesture recognition and hand tracking system. Both datasets are significantly larger than other available datasets. The hand tracking algorithm was used to create a mouse cursor control application, a paint application for Android mobile devices, and a FPS video game controller. The latter in particular demonstrates how the collaborating hand tracking can fulfill the demanding nature of responsive aiming and movement controls.
Download or read book Perception and Machine Intelligence written by Malay K. Kundu and published by Springer. This book was released on 2012-01-12 with total page 394 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the proceedings of the First Indo-Japanese conference on Perception and Machine Intelligence, PerMIn 2012, held in Kolkata, India, in January 2012. The 41 papers, presented together with 1 keynote paper and 3 plenary papers, were carefully reviewed and selected for inclusion in the book. The papers are organized in topical sections named perception; human-computer interaction; e-nose and e-tongue; machine intelligence and application; image and video processing; and speech and signal processing.
Download or read book Gesture Based Communication in Human Computer Interaction written by Antonio Camurri and published by Springer. This book was released on 2011-04-02 with total page 571 pages. Available in PDF, EPUB and Kindle. Book excerpt: Research on the multifaceted aspects of modeling, analysis, and synthesis of - man gesture is receiving growing interest from both the academic and industrial communities. On one hand, recent scienti?c developments on cognition, on - fect/emotion, on multimodal interfaces, and on multimedia have opened new perspectives on the integration of more sophisticated models of gesture in c- putersystems.Ontheotherhand,theconsolidationofnewtechnologiesenabling “disappearing” computers and (multimodal) interfaces to be integrated into the natural environments of users are making it realistic to consider tackling the complex meaning and subtleties of human gesture in multimedia systems, - abling a deeper, user-centered, enhanced physical participation and experience in the human-machine interaction process. The research programs supported by the European Commission and s- eral national institutions and governments individuated in recent years strategic ?elds strictly concerned with gesture research. For example, the DG Infor- tion Society of the European Commission (www.cordis.lu/ist) supports several initiatives, such as the “Disappearing Computer” and “Presence” EU-IST FET (Future and Emerging Technologies), the IST program “Interfaces & Enhanced Audio-Visual Services” (see for example the project MEGA, Multisensory - pressive Gesture Applications, www.megaproject.org), and the IST strategic - jective “Multimodal Interfaces.” Several EC projects and other funded research are represented in the chapters of this book. Awiderangeofapplicationscanbene?tfromadvancesinresearchongesture, from consolidated areas such as surveillance to new or emerging ?elds such as therapy and rehabilitation, home consumer goods, entertainment, and aud- visual, cultural and artistic applications, just to mention only a few of them.
Download or read book Gesture Based Human Computer Interaction and Simulation written by Miguel Sales Dias and published by Springer Science & Business Media. This book was released on 2009-01-12 with total page 294 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the thoroughly refereed post-proceedings of the 7th International Workshop on Gesture-Based Human-Computer Interaction and Simulation, GW 2007, held in Lisbon, Portugal, in May 2007. The 31 revised papers presented were carefully selected from 53 submissions. The papers are organized in topical sections on analysis and synthesis of gesture; theoretical aspects of gestural communication and interaction; vision-based gesture recognition; sign language processing; gesturing with tangible interfaces and in virtual and augmented reality; gesture for music and performing arts; gesture for therapy and rehabilitation; and gesture in Mobile computing and usability studies.
Download or read book Gesture Based Communication in Human Computer Interaction written by Annelies Braffort and published by Springer Science & Business Media. This book was released on 2000-01-12 with total page 322 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the thoroughly refereed post-proceedings of the International Gesture Workshop, GW'99, held in Gif-sur-Yvette, France, in March 1999. The 16 revised long papers and seven revised short papers were carefully reviewed for inclusion in the book. Also included are four invited papers and the transcription of a round table discussion. The papers are organized in sections on human perception and production of gesture, localization and segmentation, recognition, sign language, gesture synthesis and animation, and multimodality.
Download or read book Advances in Image and Video Technology written by Domingo Mery and published by Springer. This book was released on 2007-12-07 with total page 981 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the refereed proceedings of the Second Pacific Rim Symposium on Image and Video Technology, PSIVT 2007, held in Santiago, Chile, in December 2007. The 75 revised full papers presented together with four keynote lectures were carefully reviewed and selected from 155 submissions. The symposium features ongoing research including all aspects of video and multimedia, both technical and artistic perspectives and both theoretical and practical issues.
Download or read book Advances in Computation and Intelligence written by Zhihua Cai and published by Springer Science & Business Media. This book was released on 2010-10-06 with total page 551 pages. Available in PDF, EPUB and Kindle. Book excerpt: Volumes CCIS 107 and LNCS 6382 constitute the proceedings of the 5th International Symposium, ISICA 2010, held in Wuhan, China, in October 2010. ISICA 2010 attracted 267 submissions and through rigorous reviews 53 papers were included in LNCS 6382. The papers are presented in sections on ANT colony and particle swarm optimization, differential evolution, distributed computing, genetic algorithms, multi-agent systems, multi-objective and dynamic optimization, robot intelligence, statistic learning and system design.
Download or read book Color and Illumination Independent Hand Tracking and Gesture Recognition written by and published by . This book was released on 2006 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: Recognition of human motion provides hints to understand human activities and gives opportunities to the development of a new human-computer interaction (HCI) interface. Hidden Markov Models (HMMs) are used for visual recognition of complex, structured hand gestures such as the ones found in a sign language, since they have proved their success in recognizing speech and handwriting. In this paper, we introduce a hand gesture recognition system to recognize gestures in real-time. Hand tracking is performed in two different ways. The first method is based on color segmentation and blob generation over the hand region, and the second method uses block matching and particle filtering algorithms to detect the moving hand which makes the system totally color and illumination independent. In both methods, extracted information is used as the input to the HMM based gesture recognizer.
Download or read book Human Computer Interaction Gesture Spotting and Recognition written by Mahmoud Elmezain and published by LAP Lambert Academic Publishing. This book was released on 2014-03 with total page 168 pages. Available in PDF, EPUB and Kindle. Book excerpt: Even though automatic hand gesture recognition technology has been applied to real-world applications with relative success, there are still several problems which need to be addressed for wider applications of Human-Computer Interaction. One of such problems which arise in hand gesture recognition is to spot meaningful gestures from the continuous sequence of the hand motions. Another problem is caused by the fact that there is quite a bit of variability (i.e. in shape, trajectory and duration) in the same gesture even for the same person. Throughout literature, the backward spotting technique is used which first detects the end points of gestures and then tracks back through their optimal paths to discover the start points of gestures. Upon the detection of the start and the end points, in between points trajectory is sent to the recognizer for recognition. So, a time delay is observed between the meaningful gesture spotting and recognition. This time delay is unacceptable for online applications. Given the fact of high variability of corresponding gesture to other gestures, modeling the other gesture is a vital issue to accommodate the infinite number of non-gesture patterns.
Download or read book Real time Immersive Human computer Interaction Based on Tracking and Recognition of Dynamic Hand Gestures written by Gan Lu and published by . This book was released on 2011 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: With fast developing and ever growing use of computer based technologies, human-computer interaction (HCI) plays an increasingly pivotal role. In virtual reality (VR), HCI technologies provide not only a better understanding of three-dimensional shapes and spaces, but also sensory immersion and physical interaction. With the hand based HCI being a key HCI modality for object manipulation and gesture based communication, challenges are presented to provide users a natural, intuitive, effortless, precise, and real-time method for HCI based on dynamic hand gestures, due to the complexity of hand postures formed by multiple joints with high degrees-of-freedom, the speed of hand movements with highly variable trajectories and rapid direction changes, and the precision required for interaction between hands and objects in the virtual world. Presented in this thesis is the design and development of a novel real-time HCI system based on a unique combination of a pair of data gloves based on fibre-optic curvature sensors to acquire finger joint angles, a hybrid tracking system based on inertia and ultrasound to capture hand position and orientation, and a stereoscopic display system to provide an immersive visual feedback. The potential and effectiveness of the proposed system is demonstrated through a number of applications, namely, hand gesture based virtual object manipulation and visualisation, hand gesture based direct sign writing, and hand gesture based finger spelling. For virtual object manipulation and visualisation, the system is shown to allow a user to select, translate, rotate, scale, release and visualise virtual objects (presented using graphics and volume data) in three-dimensional space using natural hand gestures in real-time. For direct sign writing, the system is shown to be able to display immediately the corresponding SignWriting symbols signed by a user using three different signing sequences and a range of complex hand gestures, which consist of various combinations of hand postures (with each finger open, half-bent, closed, adduction and abduction), eight hand orientations in horizontal/vertical plans, three palm facing directions, and various hand movements (which can have eight directions in horizontal/vertical plans, and can be repetitive, straight/curve, clockwise/anti-clockwise). The development includes a special visual interface to give not only a stereoscopic view of hand gestures and movements, but also a structured visual feedback for each stage of the signing sequence. An excellent basis is therefore formed to develop a full HCI based on all human gestures by integrating the proposed system with facial expression and body posture recognition methods. Furthermore, for finger spelling, the system is shown to be able to recognise five vowels signed by two hands using the British Sign Language in real-time.
Download or read book Challenges and Applications for Hand Gesture Recognition written by Kane, Lalit and published by IGI Global. This book was released on 2022-03-25 with total page 249 pages. Available in PDF, EPUB and Kindle. Book excerpt: Due to the rise of new applications in electronic appliances and pervasive devices, automated hand gesture recognition (HGR) has become an area of increasing interest. HGR developments have come a long way from the traditional sign language recognition (SLR) systems to depth and wearable sensor-based electronic devices. Where the former are more laboratory-oriented frameworks, the latter are comparatively realistic and practical systems. Based on various gestural traits, such as hand postures, gesture recognition takes different forms. Consequently, different interpretations can be associated with gestures in various application contexts. A considerable amount of research is still needed to introduce more practical gesture recognition systems and associated algorithms. Challenges and Applications for Hand Gesture Recognition highlights the state-of-the-art practices of HGR research and discusses key areas such as challenges, opportunities, and future directions. Covering a range of topics such as wearable sensors and hand kinematics, this critical reference source is ideal for researchers, academicians, scholars, industry professionals, engineers, instructors, and students.
Download or read book Vision Based Interaction written by Matthew Turk and published by Morgan & Claypool Publishers. This book was released on 2013-10-01 with total page 136 pages. Available in PDF, EPUB and Kindle. Book excerpt: In its early years, the field of computer vision was largely motivated by researchers seeking computational models of biological vision and solutions to practical problems in manufacturing, defense, and medicine. For the past two decades or so, there has been an increasing interest in computer vision as an input modality in the context of human-computer interaction. Such vision-based interaction can endow interactive systems with visual capabilities similar to those important to human-human interaction, in order to perceive non-verbal cues and incorporate this information in applications such as interactive gaming, visualization, art installations, intelligent agent interaction, and various kinds of command and control tasks. Enabling this kind of rich, visual and multimodal interaction requires interactive-time solutions to problems such as detecting and recognizing faces and facial expressions, determining a person's direction of gaze and focus of attention, tracking movement of the body, and recognizing various kinds of gestures. In building technologies for vision-based interaction, there are choices to be made as to the range of possible sensors employed (e.g., single camera, stereo rig, depth camera), the precision and granularity of the desired outputs, the mobility of the solution, usability issues, etc. Practical considerations dictate that there is not a one-size-fits-all solution to the variety of interaction scenarios; however, there are principles and methodological approaches common to a wide range of problems in the domain. While new sensors such as the Microsoft Kinect are having a major influence on the research and practice of vision-based interaction in various settings, they are just a starting point for continued progress in the area. In this book, we discuss the landscape of history, opportunities, and challenges in this area of vision-based interaction; we review the state-of-the-art and seminal works in detecting and recognizing the human body and its components; we explore both static and dynamic approaches to "looking at people" vision problems; and we place the computer vision work in the context of other modalities and multimodal applications. Readers should gain a thorough understanding of current and future possibilities of computer vision technologies in the context of human-computer interaction.
Download or read book Gesture Recognition written by Qiguang Miao and published by Elsevier. This book was released on 2024-07-26 with total page 225 pages. Available in PDF, EPUB and Kindle. Book excerpt: Gesture Recognition: Theory and Applications covers this important topic in computer science and language technology that has a goal of interpreting human gestures via mathematical algorithms. The book begins by examining the computer vision-based gesture recognition method, focusing on the theory and related research results of various recent gesture recognition technologies. The book takes the evolutions of gesture recognition technology as a clue, systematically introducing gesture recognition methods based on handcrafted features, convolutional neural networks, recurrent neural networks, multimodal data fusion, and visual attention mechanisms. Three gesture recognition-based HCI (Human Computer Interaction) practical cases are introduced. Finally, the book looks at emerging research trends and application. Focuses on the theory and application of gesture recognition, providing a systematic introduction to commonly used datasets in the field as well as algorithms based on handcrafted features, convolutional neural networks, multimodal fusion, and attention mechanisms Introduces the practical applications of gesture recognition in real-world scenarios, enabling readers to enhance their practical application skills while learning about relevant technologies Demonstrates four main categories of gesture recognition methods and analyzes their associated challenges
Download or read book Micro Electronics and Telecommunication Engineering written by Devendra Kumar Sharma and published by Springer Nature. This book was released on 2020-04-02 with total page 735 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book presents selected papers from the 3rd International Conference on Micro-Electronics and Telecommunication Engineering, held at SRM Institute of Science and Technology, Ghaziabad, India, on 30-31 August 2019. It covers a wide variety of topics in micro-electronics and telecommunication engineering, including micro-electronic engineering, computational remote sensing, computer science and intelligent systems, signal and image processing, and information and communication technology.
