Download or read book Non Parametric Finite Multivariate Mixture Models with Applications written by XIAOTIAN ZHU and published by . This book was released on 2014 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: This research set out to investigate and build upon the foundation for the nonparametric estimation of finite multivariate mixture models given the conditional independence assumption, set forth in a series of studies over the last decade. We proposed a novel formulation of the objective function in terms of penalized smoothed Kullback-Leibler divergence under a reduced parameter space. A special optimization landscape and scheme was discovered in working out the majorizationminimization method for the estimation problem which leads to a closed form of the nonlinearly smoothed majorization-minimization (NSMM) algorithm. We established a sharpened monotonicity property that precisely measures the distance between successive iterates of the algorithm and proved the existence of a solution to the main optimization problem for the first time in literature. The estimation theory for this basic model together with the special optimization scheme can be adapted to the investigation of an important extension of the model that incorporates component-wise independent component analysis (ICA). The NSMMICA algorithm has been developed and a discretized version of it, which interweaves NSMM and weighted FastICA has been implemented in the R package icamix as a model-based clustering tool. We demonstrated the use of the newly developed methods/algorithms by applications in image analysis and unsupervised learning.

Download or read book Finite Mixture Models written by Geoffrey McLachlan and published by John Wiley & Sons. This book was released on 2004-03-22 with total page 419 pages. Available in PDF, EPUB and Kindle. Book excerpt: An up-to-date, comprehensive account of major issues in finitemixture modeling This volume provides an up-to-date account of the theory andapplications of modeling via finite mixture distributions. With anemphasis on the applications of mixture models in both mainstreamanalysis and other areas such as unsupervised pattern recognition,speech recognition, and medical imaging, the book describes theformulations of the finite mixture approach, details itsmethodology, discusses aspects of its implementation, andillustrates its application in many common statisticalcontexts. Major issues discussed in this book include identifiabilityproblems, actual fitting of finite mixtures through use of the EMalgorithm, properties of the maximum likelihood estimators soobtained, assessment of the number of components to be used in themixture, and the applicability of asymptotic theory in providing abasis for the solutions to some of these problems. The author alsoconsiders how the EM algorithm can be scaled to handle the fittingof mixture models to very large databases, as in data miningapplications. This comprehensive, practical guide: * Provides more than 800 references-40% published since 1995 * Includes an appendix listing available mixture software * Links statistical literature with machine learning and patternrecognition literature * Contains more than 100 helpful graphs, charts, and tables Finite Mixture Models is an important resource for both applied andtheoretical statisticians as well as for researchers in the manyareas in which finite mixture models can be used to analyze data.

Download or read book Nonparametric Statistics and Mixture Models written by David R. Hunter and published by World Scientific. This book was released on 2011 with total page 370 pages. Available in PDF, EPUB and Kindle. Book excerpt: This festschrift includes papers authored by many collaborators, colleagues, and students of Professor Thomas P Hettmansperger, who worked in research in nonparametric statistics, rank statistics, robustness, and mixture models during a career that spanned nearly 40 years. It is a broad sample of peer-reviewed, cutting-edge research related to nonparametrics and mixture models.

Download or read book Mixture Models and Applications written by Nizar Bouguila and published by Springer. This book was released on 2019-08-13 with total page 355 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book focuses on recent advances, approaches, theories and applications related to mixture models. In particular, it presents recent unsupervised and semi-supervised frameworks that consider mixture models as their main tool. The chapters considers mixture models involving several interesting and challenging problems such as parameters estimation, model selection, feature selection, etc. The goal of this book is to summarize the recent advances and modern approaches related to these problems. Each contributor presents novel research, a practical study, or novel applications based on mixture models, or a survey of the literature. Reports advances on classic problems in mixture modeling such as parameter estimation, model selection, and feature selection; Present theoretical and practical developments in mixture-based modeling and their importance in different applications; Discusses perspectives and challenging future works related to mixture modeling.

Download or read book Nonparametric Estimation in Multivariate Finite Mixture Models written by Tatiana A. Benaglia and published by . This book was released on 2008 with total page 129 pages. Available in PDF, EPUB and Kindle. Book excerpt: The main goal of this thesis is to provide a complete methodology to analyze finite multivariate mixture models. Our approach is fully nonparametric and it only requires the coordinates to be independent, conditional on the component membership. Since the number of components in the mixture is assumed to be known, we also developed a technique to select the number of components that best fits the model. In addition, we provide some tools to check if the assumption of conditional independence is reasonable. All the methods are evaluated by simulations, and compared with methodology existing in the literature. We also apply our methodology to two real datasets from cognitive psychology.

Download or read book Models and Estimation Algorithms for Nonparametric Finite Mixtures with Conditionally Independent Multivariate Component Densities written by Vy-Thuy-Lynh Hoang and published by . This book was released on 2017 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: Recently several authors have proposed models and estimation algorithms for finite nonparametric multivariate mixtures, whose identifiability is typically not obvious. Among the considered models, the assumption of independent coordinates conditional on the subpopulation from which each observation is drawn is subject of an increasing attention, in view of the theoretical and practical developments it allows, particularly with multiplicity of variables coming into play in the modern statistical framework. In this work we first consider a more general model assuming independence, conditional on the component, of multivariate blocks of coordinates instead of univariate coordinates, allowing for any dependence structure within these blocks. Consequently, the density functions of these blocks are completely multivariate and nonparametric. We present identifiability arguments and introduce for estimation in this model two methodological algorithms whose computational procedures resemble a true EM algorithm but include an additional density estimation step: a fast algorithm showing empirical efficiency without theoretical justification, and a smoothed algorithm possessing a monotony property as any EM algorithm does, but more computationally demanding. We also discuss computationally efficient methods for estimation and derive some strategies. Next, we consider a multivariate extension of the mixture models used in the framework of multiple hypothesis testings, allowing for a new multivariate version of the False Discovery Rate control. We propose a constrained version of our previous algorithm, specifically designed for this model. The behavior of the EM-type algorithms we propose is studied numerically through several Monte Carlo experiments and high dimensional real data, and compared with existing methods in the literature. Finally, the codes of our new algorithms are progressively implemented as new functions in the publicly-available package mixtools for the R statistical software.

Download or read book Mixture Models written by Weixin Yao and published by CRC Press. This book was released on 2024-04-18 with total page 398 pages. Available in PDF, EPUB and Kindle. Book excerpt: Mixture models are a powerful tool for analyzing complex and heterogeneous datasets across many scientific fields, from finance to genomics. Mixture Models: Parametric, Semiparametric, and New Directions provides an up-to-date introduction to these models, their recent developments, and their implementation using R. It fills a gap in the literature by covering not only the basics of finite mixture models, but also recent developments such as semiparametric extensions, robust modeling, label switching, and high-dimensional modeling. Features Comprehensive overview of the methods and applications of mixture models Key topics include hypothesis testing, model selection, estimation methods, and Bayesian approaches Recent developments, such as semiparametric extensions, robust modeling, label switching, and high-dimensional modeling Examples and case studies from such fields as astronomy, biology, genomics, economics, finance, medicine, engineering, and sociology Integrated R code for many of the models, with code and data available in the R Package MixSemiRob Mixture Models: Parametric, Semiparametric, and New Directions is a valuable resource for researchers and postgraduate students from statistics, biostatistics, and other fields. It could be used as a textbook for a course on model-based clustering methods, and as a supplementary text for courses on data mining, semiparametric modeling, and high-dimensional data analysis.

Download or read book Handbook of Mixture Analysis written by Sylvia Fruhwirth-Schnatter and published by CRC Press. This book was released on 2019-01-04 with total page 388 pages. Available in PDF, EPUB and Kindle. Book excerpt: Mixture models have been around for over 150 years, and they are found in many branches of statistical modelling, as a versatile and multifaceted tool. They can be applied to a wide range of data: univariate or multivariate, continuous or categorical, cross-sectional, time series, networks, and much more. Mixture analysis is a very active research topic in statistics and machine learning, with new developments in methodology and applications taking place all the time. The Handbook of Mixture Analysis is a very timely publication, presenting a broad overview of the methods and applications of this important field of research. It covers a wide array of topics, including the EM algorithm, Bayesian mixture models, model-based clustering, high-dimensional data, hidden Markov models, and applications in finance, genomics, and astronomy. Features: Provides a comprehensive overview of the methods and applications of mixture modelling and analysis Divided into three parts: Foundations and Methods; Mixture Modelling and Extensions; and Selected Applications Contains many worked examples using real data, together with computational implementation, to illustrate the methods described Includes contributions from the leading researchers in the field The Handbook of Mixture Analysis is targeted at graduate students and young researchers new to the field. It will also be an important reference for anyone working in this field, whether they are developing new methodology, or applying the models to real scientific problems.

Download or read book Bayesian Nonparametrics written by J.K. Ghosh and published by Springer Science & Business Media. This book was released on 2006-05-11 with total page 311 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book is the first systematic treatment of Bayesian nonparametric methods and the theory behind them. It will also appeal to statisticians in general. The book is primarily aimed at graduate students and can be used as the text for a graduate course in Bayesian non-parametrics.

Download or read book Nonlinear Mixture Models A Bayesian Approach written by Tatiana V Tatarinova and published by World Scientific. This book was released on 2014-12-30 with total page 296 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book, written by two mathematicians from the University of Southern California, provides a broad introduction to the important subject of nonlinear mixture models from a Bayesian perspective. It contains background material, a brief description of Markov chain theory, as well as novel algorithms and their applications. It is self-contained and unified in presentation, which makes it ideal for use as an advanced textbook by graduate students and as a reference for independent researchers. The explanations in the book are detailed enough to capture the interest of the curious reader, and complete enough to provide the necessary background material needed to go further into the subject and explore the research literature.In this book the authors present Bayesian methods of analysis for nonlinear, hierarchical mixture models, with a finite, but possibly unknown, number of components. These methods are then applied to various problems including population pharmacokinetics and gene expression analysis. In population pharmacokinetics, the nonlinear mixture model, based on previous clinical data, becomes the prior distribution for individual therapy. For gene expression data, one application included in the book is to determine which genes should be associated with the same component of the mixture (also known as a clustering problem). The book also contains examples of computer programs written in BUGS. This is the first book of its kind to cover many of the topics in this field.

Download or read book Finite Mixture and Markov Switching Models written by Sylvia Frühwirth-Schnatter and published by Springer Science & Business Media. This book was released on 2006-11-24 with total page 506 pages. Available in PDF, EPUB and Kindle. Book excerpt: The past decade has seen powerful new computational tools for modeling which combine a Bayesian approach with recent Monte simulation techniques based on Markov chains. This book is the first to offer a systematic presentation of the Bayesian perspective of finite mixture modelling. The book is designed to show finite mixture and Markov switching models are formulated, what structures they imply on the data, their potential uses, and how they are estimated. Presenting its concepts informally without sacrificing mathematical correctness, it will serve a wide readership including statisticians as well as biologists, economists, engineers, financial and market researchers.

Download or read book Mixtures written by Kerrie L. Mengersen and published by John Wiley & Sons. This book was released on 2011-05-03 with total page 357 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book uses the EM (expectation maximization) algorithm to simultaneously estimate the missing data and unknown parameter(s) associated with a data set. The parameters describe the component distributions of the mixture; the distributions may be continuous or discrete. The editors provide a complete account of the applications, mathematical structure and statistical analysis of finite mixture distributions along with MCMC computational methods, together with a range of detailed discussions covering the applications of the methods and features chapters from the leading experts on the subject. The applications are drawn from scientific discipline, including biostatistics, computer science, ecology and finance. This area of statistics is important to a range of disciplines, and its methodology attracts interest from researchers in the fields in which it can be applied.

Download or read book Finite Bivariate and Multivariate Beta Mixture Models Learning and Applications written by Narges Manouchehri and published by . This book was released on 2020 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: Finite mixture models have been revealed to provide flexibility for data clustering. They have demonstrated high competence and potential to capture hidden structure in data. Modern technological progresses, growing volumes and varieties of generated data, revolutionized computers and other related factors are contributing to produce large scale data. This fact enhances the significance of finding reliable and adaptable models which can analyze bigger, more complex data to identify latent patterns, deliver faster and more accurate results and make decisions with minimal human interaction. Adopting the finest and most accurate distribution that appropriately represents the mixture components is critical. The most widely adopted generative model has been the Gaussian mixture. In numerous real-world applications, however, when the nature and structure of data are non-Gaussian, this modelling fails. One of the other crucial issues when using mixtures is determination of the model complexity or number of mixture components. Minimum message length (MML) is one of the main techniques in frequentist frameworks to tackle this challenging issue. In this work, we have designed and implemented a finite mixture model, using the bivariate and multivariate Beta distributions for cluster analysis and demonstrated its flexibility in describing the intrinsic characteristics of the observed data. In addition, we have applied our estimation and model selection algorithms to synthetic and real datasets. Most importantly, we considered interesting applications such as in image segmentation, software modules defect prediction, spam detection and occupancy estimation in smart buildings.

Download or read book Mixture Models written by Bruce G. Lindsay and published by IMS. This book was released on 1995 with total page 184 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Mixture Model Based Classification written by Paul D. McNicholas and published by CRC Press. This book was released on 2016-10-04 with total page 212 pages. Available in PDF, EPUB and Kindle. Book excerpt: "This is a great overview of the field of model-based clustering and classification by one of its leading developers. McNicholas provides a resource that I am certain will be used by researchers in statistics and related disciplines for quite some time. The discussion of mixtures with heavy tails and asymmetric distributions will place this text as the authoritative, modern reference in the mixture modeling literature." (Douglas Steinley, University of Missouri) Mixture Model-Based Classification is the first monograph devoted to mixture model-based approaches to clustering and classification. This is both a book for established researchers and newcomers to the field. A history of mixture models as a tool for classification is provided and Gaussian mixtures are considered extensively, including mixtures of factor analyzers and other approaches for high-dimensional data. Non-Gaussian mixtures are considered, from mixtures with components that parameterize skewness and/or concentration, right up to mixtures of multiple scaled distributions. Several other important topics are considered, including mixture approaches for clustering and classification of longitudinal data as well as discussion about how to define a cluster Paul D. McNicholas is the Canada Research Chair in Computational Statistics at McMaster University, where he is a Professor in the Department of Mathematics and Statistics. His research focuses on the use of mixture model-based approaches for classification, with particular attention to clustering applications, and he has published extensively within the field. He is an associate editor for several journals and has served as a guest editor for a number of special issues on mixture models.

Download or read book Finite Mixture Models written by Igor Vladimir Cadez and published by . This book was released on 2002 with total page 434 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Essays on finite mixture models written by Abram van Dijk and published by Rozenberg Publishers. This book was released on 2009 with total page 138 pages. Available in PDF, EPUB and Kindle. Book excerpt: Finite mixture distributions are a weighted average of a finite number of distributions. The latter are usually called the mixture components. The weights are usually described by a multinomial distribution and are sometimes called mixing proportions. The mixture components may be the same type of distributions with di®erent parameter values but they may also be completely different distributions. Therefore, finite mixture distributions are very °exible for modeling data. They are frequently used as a building block within many modern econometric models. The specification of the mixture distribution depends on the modeling problem at hand. In this thesis, we introduce new applications of finite mixtures to deal with several di®erent modeling issues. Each chapter of the thesis focusses on a specific modeling issue. The parameters of some of the resulting models can be estimated using standard techniques but for some of the chapters we need to develop new estimation and inference methods. To illustrate how the methods can be applied, we analyze at least one empirical data set for each approach. These data sets cover a wide range of research fields, such as macroeconomics, marketing, and political science. We show the usefulness of the methods and, in some cases, the improvement over previous methods in the literature.