Download or read book A Bayesian Framework for Multiple Acoustic Source Tracking written by Xionghu Zhong and published by . This book was released on 2010 with total page 220 pages. Available in PDF, EPUB and Kindle. Book excerpt: Acoustic source (speaker) tracking in the room environment plays an important role in many speech and audio applications such as multimedia, hearing aids and hands-free speech communication and teleconferencing systems; the position information can be fed into a higher processing stage for high-quality speech acquisition, enhancement of a specific speech signal in the presence of other competing talkers, or keeping a camera focused on the speaker in a video-conferencing scenario. Most of existing systems focus on the single source tracking problem, which assumes one and only one source is active all the time, and the state to be estimated is simply the source position. However, in practical scenarios, multiple speakers may be simultaneously active, and the tracking algorithm should be able to localise each individual source and estimate the number of sources. This thesis contains three contributions towards solutions to multiple acoustic source tracking in a moderate noisy and reverberant environment. The first contribution of this thesis is proposing a time-delay of arrival (TDOA) estimation approach for multiple sources. Although the phase transform (PHAT) weighted generalised cross-correlation (GCC) method has been employed to extract the TDOAs of multiple sources, it is primarily used for a single source scenario and its performance for multiple TDOA estimation has not been comprehensively studied. The proposed approach combines the degenerate unmixing estimation technique (DUET) and GCC method. Since the speech mixtures are assumed window-disjoint orthogonal (WDO) in the time-frequency domain, the spectrograms can be separated by employing DUET, and the GCC method can then be applied to the spectrogram of each individual source. The probabilities of detection and false alarm are also proposed to evaluate the TDOA estimation performance under a series of experimental parameters. Next, considering multiple acoustic sources may appear nonconcurrently, an extended Kalman particle filtering (EKPF) is developed for a special multiple acoustic source tracking problem, namely "nonconcurrent multiple acoustic tracking (NMAT)". The extended Kalman filter (EKF) is used to approximate the optimum weights, and the subsequent particle filtering (PF) naturally takes the previous position estimates as well as the current TDOA measurements into account. The proposed approach is thus able to lock on the sharp change of the source position quickly, and avoid the tracking-lag in the general sequential importance resampling (SIR) PF. Finally, these investigations are extended into an approach to track the multiple unknown and time-varying number of acoustic sources. The DUET-GCC method is used to obtain the TDOA measurements for multiple sources and a random finite set (RFS) based Rao-blackwellised PF is employed and modified to track the sources. Each particle has a RFS form encapsulating the states of all sources and is capable of addressing source dynamics: source survival, new source appearance and source deactivation. A data association variable is defined to depict the source dynamic and its relation to the measurements. The Rao-blackwellisation step is used to decompose the state: the source positions are marginalised by using an EKF, and only the data association variable needs to be handled by a PF. The performances of all the proposed approaches are extensively studied under different noisy and reverberant environments, and are favorably comparable with the existing tracking techniques.
Download or read book A Bayesian Framework for Target Tracking Using Acoustic and Image Measurements written by Volkan Cevher and published by . This book was released on 2005 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: Target tracking is a broad subject area extensively studied in many engineering disciplines. In this thesis, target tracking implies the temporal estimation of target features such as the target's direction-of-arrival (DOA), the target's boundary pixels in a sequence of images, and/or the target's position in space. For multiple target tracking, we have introduced a new motion model that incorporates an acceleration component along the heading direction of the target. We have also shown that the target motion parameters can be considered part of a more general feature set for target tracking, e.g., target frequencies, which may be unrelated to the target motion, can be used to improve the tracking performance. We have introduced an acoustic multiple-target tracker using a flexible observation model based on an image tracking approach by assuming that the DOA observations might be spurious and that some of the DOAs might be missing in the observation set. We have also addressed the acoustic calibration problem from sources of opportunity such as beacons or a moving source. We have derived and compared several calibration methods for the case where the node can hear a moving source whose position can be reported back to the node. The particle filter, as a recursive algorithm, requires an initialization phase prior to tracking a state vector. The Metropolis-Hastings (MH) algorithm has been used for sampling from intractable multivariate target distributions and is well suited for the initialization problem. Since the particle filter only needs samples around the mode, we have modified the MH algorithm to generate samples distributed around the modes of the target posterior. By simulations, we show that this "mode hungry" algorithm converges an order of magnitude faster than the original MH scheme. Finally, we have developed a general framework for the joint state-space tracking problem. A proposal strategy for joint state-space tracking using the particle filters is defined by carefully placing the random support of the joint filter in the region where the final posterior is likely to lie. Computer simulations demonstrate improved performance and robustness of the joint state-space when using the new particle proposal strategy.
Download or read book Bayesian 3D Multiple People Tracking Using Multiple Indoor Cameras and Microphones written by Yeongseon Lee and published by . This book was released on 2009 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: This thesis represents Bayesian joint audio-visual tracking for the 3D locations of multiple people and a current speaker in a real conference environment. To achieve this objective, it focuses on several different research interests, such as acoustic-feature detection, visual-feature detection, a non-linear Bayesian framework, data association, and sensor fusion. As acoustic-feature detection, time-delay-of-arrival~(TDOA) estimation is used for multiple source detection. Localization performance using TDOAs is also analyzed according to different configurations of microphones. As a visual-feature detection, Viola-Jones face detection is used to initialize the locations of unknown multiple objects. Then, a corner feature, based on the results from the Viola-Jones face detection, is used for motion detection for robust objects. Simple point-to-line correspondences between multiple cameras using fundamental matrices are used to determine which features are more robust. As a method for data association and sensor fusion, Monte-Carlo JPDAF and a data association with IPPF~(DA-IPPF) are implemented in the framework of particle filtering. Three different tracking scenarios of acoustic source tracking, visual source tracking, and joint acoustic-visual source tracking are represented using the proposed algorithms. Finally the real-time implementation of this joint acoustic-visual tracking system using a PC, four cameras, and six microphones is addressed with two parts of system implementation and real-time processing.
Download or read book Bayesian Approach in Acoustic Source Localization and Imaging Anglais written by Ning Chu and published by . This book was released on 2013 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: Acoustic imaging is an advanced technique for acoustic source localization and power reconstruction using limited measurements at microphone sensor array. This technique can provide meaningful insights into performances, properties and mechanisms of acoustic sources. It has been widely used for evaluating the acoustic influence in automobile and aircraft industries. Acoustic imaging methods often involve in two aspects: a forward model of acoustic signal (power) propagation, and its inverse solution. However, the inversion usually causes a very ill-posed inverse problem, whose solution is not unique and is quite sensitive to measurement errors. Therefore, classical methods cannot easily obtain high spatial resolutions between two close sources, nor achieve wide dynamic range of acoustic source powers. In this thesis, we firstly build up a discrete forward model of acoustic signal propagation. This signal model is a linear but under-determined system of equations linking the measured data and unknown source signals. Based on this signal model, we set up a discrete forward model of acoustic power propagation. This power model is both linear and determined for source powers. In the forward models, we consider the measurement errors to be mainly composed of background noises at sensor array, model uncertainty caused by multi-path propagation, as well as model approximating errors. For the inverse problem of the acoustic power model, we firstly propose a robust super-resolution approach with the sparsity constraint, so that we can obtain very high spatial resolution in strong measurement errors. But the sparsity parameter should be carefully estimated for effective performance. Then for the acoustic imaging with large dynamic range and robustness, we propose a robust Bayesian inference approach with a sparsity enforcing prior: the double exponential law. This sparse prior can better embody the sparsity characteristic of source distribution than the sparsity constraint. All the unknown variables and parameters can be alternatively estimated by the Joint Maximum A Posterior (JMAP) estimation. However, this JMAP suffers a non-quadratic optimization and causes huge computational cost. So that we improve two following aspects: In order to accelerate the JMAP estimation, we investigate an invariant 2D convolution operator to approximate acoustic power propagation model. Owing to this invariant convolution model, our approaches can be parallelly implemented by the Graphics Processing Unit (GPU). Furthermore, we consider that measurement errors are spatially variant (non-stationary) at different sensors. In this more practical case, the distribution of measurement errors can be more accurately modeled by Students-t law which can express the variant variances by hidden parameters. Moreover, the sparsity enforcing distribution can be more conveniently described by the Student's-t law which can be decomposed into multivariate Gaussian and Gamma laws. However, the JMAP estimation risks to obtain so many unknown variables and hidden parameters. Therefore, we apply the Variational Bayesian Approximation (VBA) to overcome the JMAP drawbacks. One of the fabulous advantages of VBA is that it can not only achieve the parameter estimations, but also offer the confidential interval of interested parameters thanks to hidden parameters used in Students-t priors. To conclude, proposed approaches are validated by simulations, real data from wind tunnel experiments of Renault S2A, as well as the hybrid data. Compared with some typical state-of-the-art methods, the main advantages of proposed approaches are robust to measurement errors, super spatial resolutions, wide dynamic range and no need for source number nor Signal to Noise Ration (SNR) beforehand.
Download or read book Bayesian Geoacoustic Inversion and Source Tracking for Horizontal Line Array Data written by and published by . This book was released on 2004 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: The overall goal of this thesis is to develop non-linear Bayesian methods for three-dimensional tracking of a moving acoustic source in shallow water despite environmental uncertainty, with application to data from a horizontal line array (HLA) of hydrophones. As a precursor, Bayesian geoacoustic inversion is applied to estimate seabed model parameters and their uncertainties. A simulation study examines the effect of source and array factors on geoacoustic information content in matched-field inversion of HLA data, as quantified in terms of model parameter uncertainties. Bayesian geoacoustic inversion is applied to both controlled-source and ship-noise data from a HLA deployed on the seafloor in a shallow-water experiment conducted in the Barents Sea. A new approach is introduced to account for data error reduction due to averaging data over time-series subsegments (snapshots), based on empirically apportioning measurement and theory error, with effects on inversion results compared to those of existing approaches. It is further demonstrated that combining data from multiple, independent time-series segments (for a moving source) in the inversion can significantly reduce geoacoustic parameter uncertainties. Geoacoustic uncertainties are also shown to depend on ship range and orientation, with lowest uncertainties for short ranges and for the ship stern/propeller oriented toward the array. Sediment sound-speed profile and density estimates from controlled-source and ship-noise data inversions are found to be in good agreement with values from geophysical measurements. Two non-linear Bayesian matched-field inversion approaches are developed for three-dimensional source tracking despite environmental uncertainty. Focalization-tracking maximizes the posterior probability density (PPD) over track and environmental parameters. Synthetic test cases show that the algorithm substantially outperforms tracking with poor environmental estimates and generally obtains results cl.
Download or read book Bayesian Multiple Target Tracking written by Lawrence D. Stone and published by Artech House Radar Library (Ha. This book was released on 1999 with total page 362 pages. Available in PDF, EPUB and Kindle. Book excerpt: Get the solutions to your most challenging tracking problems with this up-to-date resource. Using the Bayesian inference framework, the book helps you design and develop mathematically sound algorithms for dealing with tracking problems involving multiple targets, multiple sensors, and multiple platforms. The book shows you how non-linear Multiple Hypothesis Tracking and the Theory of Unified Tracking are successful methods when multiple target tracking must be performed without contacts or association.
Download or read book Bayesian Signal Processing written by James V. Candy and published by John Wiley & Sons. This book was released on 2016-06-20 with total page 638 pages. Available in PDF, EPUB and Kindle. Book excerpt: Presents the Bayesian approach to statistical signal processing for a variety of useful model sets This book aims to give readers a unified Bayesian treatment starting from the basics (Baye’s rule) to the more advanced (Monte Carlo sampling), evolving to the next-generation model-based techniques (sequential Monte Carlo sampling). This next edition incorporates a new chapter on “Sequential Bayesian Detection,” a new section on “Ensemble Kalman Filters” as well as an expansion of Case Studies that detail Bayesian solutions for a variety of applications. These studies illustrate Bayesian approaches to real-world problems incorporating detailed particle filter designs, adaptive particle filters and sequential Bayesian detectors. In addition to these major developments a variety of sections are expanded to “fill-in-the gaps” of the first edition. Here metrics for particle filter (PF) designs with emphasis on classical “sanity testing” lead to ensemble techniques as a basic requirement for performance analysis. The expansion of information theory metrics and their application to PF designs is fully developed and applied. These expansions of the book have been updated to provide a more cohesive discussion of Bayesian processing with examples and applications enabling the comprehension of alternative approaches to solving estimation/detection problems. The second edition of Bayesian Signal Processing features: “Classical” Kalman filtering for linear, linearized, and nonlinear systems; “modern” unscented and ensemble Kalman filters: and the “next-generation” Bayesian particle filters Sequential Bayesian detection techniques incorporating model-based schemes for a variety of real-world problems Practical Bayesian processor designs including comprehensive methods of performance analysis ranging from simple sanity testing and ensemble techniques to sophisticated information metrics New case studies on adaptive particle filtering and sequential Bayesian detection are covered detailing more Bayesian approaches to applied problem solving MATLAB® notes at the end of each chapter help readers solve complex problems using readily available software commands and point out other software packages available Problem sets included to test readers’ knowledge and help them put their new skills into practice Bayesian Signal Processing, Second Edition is written for all students, scientists, and engineers who investigate and apply signal processing to their everyday problems.
Download or read book Data Driven Multi Microphone Speaker Localization on Manifolds written by Bracha Laufer-Goldshtein and published by . This book was released on 2020-10-06 with total page 178 pages. Available in PDF, EPUB and Kindle. Book excerpt: Acoustic source localization is an essential component in many modern day audio applications. For example, smart speakers require localization capabilities in order to determine the speakers in the scene and their role. Based on the location information, they can enhance a speaker or carry out location specific tasks, such as switching the lights on and off, steering a camera, etc. Localization has often been based on creating physical models which become extremely intricate in real-world applications. Recently, researchers have started using learning techniques to address localization problems. This monograph introduces the reader to the research and practical aspects behind the approach of learning the characteristics of the acoustic environment directly from the data rather than using a predefined physical model. Written by the experts in the field who have developed many of these techniques, it provides a comprehensive overview and insights into this burgeoning area of acoustic developments. The reader is introduced to the underlying mathematics before being introduced to the localization problem in depth. The core paradigm of using manifolds for diffusion mapping and distance is then described. Building on these concepts, the authors address both single and multiple manifold localization. Finally, manifold-based tracking is covered. Data-Driven Multi-Microphone Speaker Localization on Manifolds is an illuminating introduction to designing and building acoustic systems where localization of multi-microphone and speakers forms an essential part of the system.
Download or read book Audio Source Separation and Speech Enhancement written by Emmanuel Vincent and published by John Wiley & Sons. This book was released on 2018-10-22 with total page 517 pages. Available in PDF, EPUB and Kindle. Book excerpt: Learn the technology behind hearing aids, Siri, and Echo Audio source separation and speech enhancement aim to extract one or more source signals of interest from an audio recording involving several sound sources. These technologies are among the most studied in audio signal processing today and bear a critical role in the success of hearing aids, hands-free phones, voice command and other noise-robust audio analysis systems, and music post-production software. Research on this topic has followed three convergent paths, starting with sensor array processing, computational auditory scene analysis, and machine learning based approaches such as independent component analysis, respectively. This book is the first one to provide a comprehensive overview by presenting the common foundations and the differences between these techniques in a unified setting. Key features: Consolidated perspective on audio source separation and speech enhancement. Both historical perspective and latest advances in the field, e.g. deep neural networks. Diverse disciplines: array processing, machine learning, and statistical signal processing. Covers the most important techniques for both single-channel and multichannel processing. This book provides both introductory and advanced material suitable for people with basic knowledge of signal processing and machine learning. Thanks to its comprehensiveness, it will help students select a promising research track, researchers leverage the acquired cross-domain knowledge to design improved techniques, and engineers and developers choose the right technology for their target application scenario. It will also be useful for practitioners from other fields (e.g., acoustics, multimedia, phonetics, and musicology) willing to exploit audio source separation or speech enhancement as pre-processing tools for their own needs.
Download or read book Multimodal Technologies for Perception of Humans written by Rainer Stiefelhagen and published by Springer Science & Business Media. This book was released on 2008-07 with total page 565 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the thoroughly refereed joint post-workshop proceedings of two co-located events: the Second International Workshop on Classification of Events, Activities and Relationships, CLEAR 2007, and the 5th Rich Transcription 2007 Meeting Recognition evaluation, RT 2007, held in succession in Baltimore, MD, USA, in May 2007. The workshops had complementary evaluation efforts; CLEAR for the evaluation of human activities, events, and relationships in multiple multimodal data domains; and RT for the evaluation of speech transcription-related technologies from meeting room audio collections. The 35 revised full papers presented from CLEAR 2007 cover 3D person tracking, 2D face detection and tracking, person and vehicle tracking on surveillance data, vehicle and person tracking aerial videos, person identification, head pose estimation, and acoustic event detection. The 15 revised full papers presented from RT 2007 are organized in topical sections on speech-to-text, and speaker diarization.
Download or read book Information Processing in Sensor Networks written by Feng Zhao and published by Springer Science & Business Media. This book was released on 2003-04-10 with total page 688 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the refereed proceedings of the Second International Workshop on Information Processing in Sensor Networks, IPSN 2003, held in Palo Alto, CA, USA, in April 2003. The 23 revised full papers and 21 revised poster papers presented were carefully reviewed and selected from 73 submissions. Among the topics addressed are wireless sensor networks, query processing, decentralized sensor platforms, distributed databases, distributed group management, sensor network design, collaborative signal processing, adhoc sensor networks, distributed algorithms, distributed sensor network control, sensor network resource management, data service middleware, random sensor networks, mobile agents, target tracking, sensor network protocols, large scale sensor networks, and multicast.
Download or read book Advanced Hybrid Information Processing written by Guan Gui and published by Springer Nature. This book was released on 2019-11-28 with total page 476 pages. Available in PDF, EPUB and Kindle. Book excerpt: This two-volume set LNICST 301 -302 constitutes the post-conference proceedings of the Third EAI International Conference on Advanced Hybrid Information Processing, ADHIP 2019, held in Nanjing, China, in September 2019. The 101 papers presented were selected from 237 submissions and focus on hybrid big data processing. Since information processing has acted as an important research domain in science and technology today, it is now to develop deeper and wider use of hybrid information processing, especially information processing for big data. There are more remaining issues waiting for solving, such as classification and systemization of big data, objective tracking and behavior understanding in big multimedia data, encoding and compression of big data.
Download or read book Random Finite Sets for Robot Mapping SLAM written by John Stephen Mullane and published by Springer Science & Business Media. This book was released on 2011-05-19 with total page 161 pages. Available in PDF, EPUB and Kindle. Book excerpt: The monograph written by John Mullane, Ba-Ngu Vo, Martin Adams and Ba-Tuong Vo is devoted to the field of autonomous robot systems, which have been receiving a great deal of attention by the research community in the latest few years. The contents are focused on the problem of representing the environment and its uncertainty in terms of feature based maps. Random Finite Sets are adopted as the fundamental tool to represent a map, and a general framework is proposed for feature management, data association and state estimation. The approaches are tested in a number of experiments on both ground based and marine based facilities.
Download or read book Sound Source Localization written by Richard R. Fay and published by Springer Science & Business Media. This book was released on 2006-05-20 with total page 340 pages. Available in PDF, EPUB and Kindle. Book excerpt: The Springer Handbook of Auditory Research presents a series of compreh- sive and synthetic reviews of the fundamental topics in modern auditory - search. The volumes are aimed at all individuals with interests in hearing research including advanced graduate students, postdoctoral researchers, and clinical investigators. The volumes are intended to introduce new investigators to important aspects of hearing science and to help established investigators to better understand the fundamental theories and data in ?elds of hearing that they may not normally follow closely. Each volume presents a particular topic comprehensively, and each serves as a synthetic overview and guide to the literature. As such, the chapters present neither exhaustive data reviews nor original research that has not yet appeared in peer-reviewed journals. The volumes focus on topics that have developed a solid data and conceptual foundation rather than on those for which a literature is only beginning to develop. New research areas will be covered on a timely basis in the series as they begin to mature.
Download or read book The Oxford Handbook of Applied Bayesian Analysis written by Anthony O' Hagan and published by OUP Oxford. This book was released on 2010-03-18 with total page 924 pages. Available in PDF, EPUB and Kindle. Book excerpt: Bayesian analysis has developed rapidly in applications in the last two decades and research in Bayesian methods remains dynamic and fast-growing. Dramatic advances in modelling concepts and computational technologies now enable routine application of Bayesian analysis using increasingly realistic stochastic models, and this drives the adoption of Bayesian approaches in many areas of science, technology, commerce, and industry. This Handbook explores contemporary Bayesian analysis across a variety of application areas. Chapters written by leading exponents of applied Bayesian analysis showcase the scientific ease and natural application of Bayesian modelling, and present solutions to real, engaging, societally important and demanding problems. The chapters are grouped into five general areas: Biomedical & Health Sciences; Industry, Economics & Finance; Environment & Ecology; Policy, Political & Social Sciences; and Natural & Engineering Sciences, and Appendix material in each touches on key concepts, models, and techniques of the chapter that are also of broader pedagogic and applied interest.
Download or read book Context Aware Human Robot and Human Agent Interaction written by Nadia Magnenat-Thalmann and published by Springer. This book was released on 2015-09-25 with total page 301 pages. Available in PDF, EPUB and Kindle. Book excerpt: This is the first book to describe how Autonomous Virtual Humans and Social Robots can interact with real people, be aware of the environment around them, and react to various situations. Researchers from around the world present the main techniques for tracking and analysing humans and their behaviour and contemplate the potential for these virtual humans and robots to replace or stand in for their human counterparts, tackling areas such as awareness and reactions to real world stimuli and using the same modalities as humans do: verbal and body gestures, facial expressions and gaze to aid seamless human-computer interaction (HCI). The research presented in this volume is split into three sections: ·User Understanding through Multisensory Perception: deals with the analysis and recognition of a given situation or stimuli, addressing issues of facial recognition, body gestures and sound localization. ·Facial and Body Modelling Animation: presents the methods used in modelling and animating faces and bodies to generate realistic motion. ·Modelling Human Behaviours: presents the behavioural aspects of virtual humans and social robots when interacting and reacting to real humans and each other. Context Aware Human-Robot and Human-Agent Interaction would be of great use to students, academics and industry specialists in areas like Robotics, HCI, and Computer Graphics.
