Download or read book Some Contributions to Particle Markov Chain Monte Carlo Algorithms written by Adam Persing and published by . This book was released on 2013 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Particle Markov Chain Monte Carlo written by and published by . This book was released on 2004 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: Markov chain Monte Carlo (MCMC) and sequential Monte Carlo (SMC) methods have emerged as the two main tools to sample from high-dimensional probability distributions. Although asymptotic convergence of MCMC algorithms is ensured under weak assumptions, the performance of these latters is unreliable when the proposal distributions used to explore the space are poorly chosen and/or if highly correlated variables are updated independently. In this thesis we propose a new Monte Carlo framework in which we build efficient high-dimensional proposal distributions using SMC methods. This allows us to design effective MCMC algorithms in complex scenarios where standard strategies fail. We demonstrate these algorithms on a number of example problems, including simulated tempering, nonlinear non-Gaussian state-space model, and protein folding.

Download or read book Markov Chain Monte Carlo Simulations and Their Statistical Analysis written by Bernd A Berg and published by World Scientific Publishing Company. This book was released on 2004-10-01 with total page 380 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book teaches modern Markov chain Monte Carlo (MC) simulation techniques step by step. The material should be accessible to advanced undergraduate students and is suitable for a course. It ranges from elementary statistics concepts (the theory behind MC simulations), through conventional Metropolis and heat bath algorithms, autocorrelations and the analysis of the performance of MC algorithms, to advanced topics including the multicanonical approach, cluster algorithms and parallel computing. Therefore, it is also of interest to researchers in the field. The book relates the theory directly to Web-based computer code. This allows readers to get quickly started with their own simulations and to verify many numerical examples easily. The present code is in Fortran 77, for which compilers are freely available. The principles taught are important for users of other programming languages, like C or C++.

Download or read book Sequential Monte Carlo Methods in Practice written by Arnaud Doucet and published by Springer Science & Business Media. This book was released on 2013-03-09 with total page 590 pages. Available in PDF, EPUB and Kindle. Book excerpt: Monte Carlo methods are revolutionizing the on-line analysis of data in many fileds. They have made it possible to solve numerically many complex, non-standard problems that were previously intractable. This book presents the first comprehensive treatment of these techniques.

Download or read book Markov Chain Monte Carlo Innovations And Applications written by Wilfrid S Kendall and published by World Scientific. This book was released on 2005-11-08 with total page 239 pages. Available in PDF, EPUB and Kindle. Book excerpt: Markov Chain Monte Carlo (MCMC) originated in statistical physics, but has spilled over into various application areas, leading to a corresponding variety of techniques and methods. That variety stimulates new ideas and developments from many different places, and there is much to be gained from cross-fertilization. This book presents five expository essays by leaders in the field, drawing from perspectives in physics, statistics and genetics, and showing how different aspects of MCMC come to the fore in different contexts. The essays derive from tutorial lectures at an interdisciplinary program at the Institute for Mathematical Sciences, Singapore, which exploited the exciting ways in which MCMC spreads across different disciplines.

Download or read book Accelerating Monte Carlo methods for Bayesian inference in dynamical models written by Johan Dahlin and published by Linköping University Electronic Press. This book was released on 2016-03-22 with total page 139 pages. Available in PDF, EPUB and Kindle. Book excerpt: Making decisions and predictions from noisy observations are two important and challenging problems in many areas of society. Some examples of applications are recommendation systems for online shopping and streaming services, connecting genes with certain diseases and modelling climate change. In this thesis, we make use of Bayesian statistics to construct probabilistic models given prior information and historical data, which can be used for decision support and predictions. The main obstacle with this approach is that it often results in mathematical problems lacking analytical solutions. To cope with this, we make use of statistical simulation algorithms known as Monte Carlo methods to approximate the intractable solution. These methods enjoy well-understood statistical properties but are often computational prohibitive to employ. The main contribution of this thesis is the exploration of different strategies for accelerating inference methods based on sequential Monte Carlo (SMC) and Markov chain Monte Carlo (MCMC). That is, strategies for reducing the computational effort while keeping or improving the accuracy. A major part of the thesis is devoted to proposing such strategies for the MCMC method known as the particle Metropolis-Hastings (PMH) algorithm. We investigate two strategies: (i) introducing estimates of the gradient and Hessian of the target to better tailor the algorithm to the problem and (ii) introducing a positive correlation between the point-wise estimates of the target. Furthermore, we propose an algorithm based on the combination of SMC and Gaussian process optimisation, which can provide reasonable estimates of the posterior but with a significant decrease in computational effort compared with PMH. Moreover, we explore the use of sparseness priors for approximate inference in over-parametrised mixed effects models and autoregressive processes. This can potentially be a practical strategy for inference in the big data era. Finally, we propose a general method for increasing the accuracy of the parameter estimates in non-linear state space models by applying a designed input signal. Borde Riksbanken höja eller sänka reporäntan vid sitt nästa möte för att nå inflationsmålet? Vilka gener är förknippade med en viss sjukdom? Hur kan Netflix och Spotify veta vilka filmer och vilken musik som jag vill lyssna på härnäst? Dessa tre problem är exempel på frågor där statistiska modeller kan vara användbara för att ge hjälp och underlag för beslut. Statistiska modeller kombinerar teoretisk kunskap om exempelvis det svenska ekonomiska systemet med historisk data för att ge prognoser av framtida skeenden. Dessa prognoser kan sedan användas för att utvärdera exempelvis vad som skulle hända med inflationen i Sverige om arbetslösheten sjunker eller hur värdet på mitt pensionssparande förändras när Stockholmsbörsen rasar. Tillämpningar som dessa och många andra gör statistiska modeller viktiga för många delar av samhället. Ett sätt att ta fram statistiska modeller bygger på att kontinuerligt uppdatera en modell allteftersom mer information samlas in. Detta angreppssätt kallas för Bayesiansk statistik och är särskilt användbart när man sedan tidigare har bra insikter i modellen eller tillgång till endast lite historisk data för att bygga modellen. En nackdel med Bayesiansk statistik är att de beräkningar som krävs för att uppdatera modellen med den nya informationen ofta är mycket komplicerade. I sådana situationer kan man istället simulera utfallet från miljontals varianter av modellen och sedan jämföra dessa mot de historiska observationerna som finns till hands. Man kan sedan medelvärdesbilda över de varianter som gav bäst resultat för att på så sätt ta fram en slutlig modell. Det kan därför ibland ta dagar eller veckor för att ta fram en modell. Problemet blir särskilt stort när man använder mer avancerade modeller som skulle kunna ge bättre prognoser men som tar för lång tid för att bygga. I denna avhandling använder vi ett antal olika strategier för att underlätta eller förbättra dessa simuleringar. Vi föreslår exempelvis att ta hänsyn till fler insikter om systemet och därmed minska antalet varianter av modellen som behöver undersökas. Vi kan således redan utesluta vissa modeller eftersom vi har en bra uppfattning om ungefär hur en bra modell ska se ut. Vi kan också förändra simuleringen så att den enklare rör sig mellan olika typer av modeller. På detta sätt utforskas rymden av alla möjliga modeller på ett mer effektivt sätt. Vi föreslår ett antal olika kombinationer och förändringar av befintliga metoder för att snabba upp anpassningen av modellen till observationerna. Vi visar att beräkningstiden i vissa fall kan minska ifrån några dagar till någon timme. Förhoppningsvis kommer detta i framtiden leda till att man i praktiken kan använda mer avancerade modeller som i sin tur resulterar i bättre prognoser och beslut.

Download or read book Handbook of Markov Chain Monte Carlo written by Steve Brooks and published by CRC Press. This book was released on 2011-05-10 with total page 620 pages. Available in PDF, EPUB and Kindle. Book excerpt: Since their popularization in the 1990s, Markov chain Monte Carlo (MCMC) methods have revolutionized statistical computing and have had an especially profound impact on the practice of Bayesian statistics. Furthermore, MCMC methods have enabled the development and use of intricate models in an astonishing array of disciplines as diverse as fisherie

Download or read book Some Contributions to the Theory and Methodology of Markov Chain Monte Carlo written by S. J. Livingstone and published by . This book was released on 2016 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Machine learning using approximate inference written by Christian Andersson Naesseth and published by Linköping University Electronic Press. This book was released on 2018-11-27 with total page 39 pages. Available in PDF, EPUB and Kindle. Book excerpt: Automatic decision making and pattern recognition under uncertainty are difficult tasks that are ubiquitous in our everyday life. The systems we design, and technology we develop, requires us to coherently represent and work with uncertainty in data. Probabilistic models and probabilistic inference gives us a powerful framework for solving this problem. Using this framework, while enticing, results in difficult-to-compute integrals and probabilities when conditioning on the observed data. This means we have a need for approximate inference, methods that solves the problem approximately using a systematic approach. In this thesis we develop new methods for efficient approximate inference in probabilistic models. There are generally two approaches to approximate inference, variational methods and Monte Carlo methods. In Monte Carlo methods we use a large number of random samples to approximate the integral of interest. With variational methods, on the other hand, we turn the integration problem into that of an optimization problem. We develop algorithms of both types and bridge the gap between them. First, we present a self-contained tutorial to the popular sequential Monte Carlo (SMC) class of methods. Next, we propose new algorithms and applications based on SMC for approximate inference in probabilistic graphical models. We derive nested sequential Monte Carlo, a new algorithm particularly well suited for inference in a large class of high-dimensional probabilistic models. Then, inspired by similar ideas we derive interacting particle Markov chain Monte Carlo to make use of parallelization to speed up approximate inference for universal probabilistic programming languages. After that, we show how we can make use of the rejection sampling process when generating gamma distributed random variables to speed up variational inference. Finally, we bridge the gap between SMC and variational methods by developing variational sequential Monte Carlo, a new flexible family of variational approximations.

Download or read book Markov Chain Monte Carlo Simulations and Their Statistical Analysis written by Bernd A. Berg and published by World Scientific. This book was released on 2004 with total page 380 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book teaches modern Markov chain Monte Carlo (MC) simulation techniques step by step. The material should be accessible to advanced undergraduate students and is suitable for a course. It ranges from elementary statistics concepts (the theory behind MC simulations), through conventional Metropolis and heat bath algorithms, autocorrelations and the analysis of the performance of MC algorithms, to advanced topics including the multicanonical approach, cluster algorithms and parallel computing. Therefore, it is also of interest to researchers in the field. The book relates the theory directly to Web-based computer code. This allows readers to get quickly started with their own simulations and to verify many numerical examples easily. The present code is in Fortran 77, for which compilers are freely available. The principles taught are important for users of other programming languages, like C or C++.

Download or read book Some Contributions to the Theory and Methodology of Markov Chain Monte Carlo written by Samuel Livingstone and published by . This book was released on 2016 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Markov Chain Monte Carlo in a Dynamical System of Information Theoretic Particles written by Tokunbo Ogunfunmi and published by . This book was released on 2019 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: In Bayesian learning, the posterior probability density of a model parameter is estimated from the likelihood function and the prior probability of the parameter. The posterior probability density estimate is refined as more evidence becomes available. However, any non-trivial Bayesian model requires the computation of an intractable integral to obtain the probability density function (PDF) of the evidence. Markov Chain Monte Carlo (MCMC) is a well-known algorithm that solves this problem by directly generating the samples of the posterior distribution without computing this intractable integral. We present a novel perspective of the MCMC algorithm which views the samples of a probability distribution as a dynamical system of Information Theoretic particles in an Information Theoretic field. As our algorithm probes this field with a test particle, it is subjected to Information Forces from other Information Theoretic particles in this field. We use Information Theoretic Learning (ITL) techniques based on R√©nyi,Äôs Œ±-Entropy function to derive an equation for the gradient of the Information Potential energy of the dynamical system of Information Theoretic particles. Using this equation, we compute the Hamiltonian of the dynamical system from the Information Potential energy and the kinetic energy. The Hamiltonian is used to generate the Markovian state trajectories of the system.

Download or read book Bayesian Filtering and Smoothing written by Simo Särkkä and published by Cambridge University Press. This book was released on 2013-09-05 with total page 255 pages. Available in PDF, EPUB and Kindle. Book excerpt: A unified Bayesian treatment of the state-of-the-art filtering, smoothing, and parameter estimation algorithms for non-linear state space models.

Download or read book Advanced Markov Chain Monte Carlo Methods written by Faming Liang and published by Wiley. This book was released on 2010-08-23 with total page 378 pages. Available in PDF, EPUB and Kindle. Book excerpt: Markov Chain Monte Carlo (MCMC) methods are now an indispensable tool in scientific computing. This book discusses recent developments of MCMC methods with an emphasis on those making use of past sample information during simulations. The application examples are drawn from diverse fields such as bioinformatics, machine learning, social science, combinatorial optimization, and computational physics. Key Features: Expanded coverage of the stochastic approximation Monte Carlo and dynamic weighting algorithms that are essentially immune to local trap problems. A detailed discussion of the Monte Carlo Metropolis-Hastings algorithm that can be used for sampling from distributions with intractable normalizing constants. Up-to-date accounts of recent developments of the Gibbs sampler. Comprehensive overviews of the population-based MCMC algorithms and the MCMC algorithms with adaptive proposals. This book can be used as a textbook or a reference book for a one-semester graduate course in statistics, computational biology, engineering, and computer sciences. Applied or theoretical researchers will also find this book beneficial.

Download or read book Geometrically Constructed Markov Chain Monte Carlo Study of Quantum Spin phonon Complex Systems written by Hidemaro Suwa and published by Springer Science & Business Media. This book was released on 2013-11-05 with total page 135 pages. Available in PDF, EPUB and Kindle. Book excerpt: In this thesis, novel Monte Carlo methods for precisely calculating the critical phenomena of the effectively frustrated quantum spin system are developed and applied to the critical phenomena of the spin-Peierls systems. Three significant methods are introduced for the first time: a new optimization algorithm of the Markov chain transition kernel based on the geometric weight-allocation approach, the extension of the worm (directed-loop) algorithm to nonconserved particles, and the combination with the level spectroscopy. Utilizing these methods, the phase diagram of the one-dimensional XXZ spin-Peierls system is elucidated. Furthermore, the multi-chain and two-dimensional spin-Peierls systems with interchain lattice interaction are investigated. The unbiased simulation shows that the interesting quantum phase transition between the 1D-like liquid phase and the macroscopically-degenerated dimer phase occurs on the fully-frustrated parameter line that separates the doubly-degenerated dimer phases in the two-dimensional phase diagram. The spin-phonon interaction in the spin-Peierls system introduces the spin frustration, which usually hinders the quantum Monte Carlo analysis, owing to the notorious negative sign problem. In this thesis, the author has succeeded in precisely calculating the critical phenomena of the effectively frustrated quantum spin system by means of the quantum Monte Carlo method without the negative sign.

Download or read book An Introduction to Sequential Monte Carlo written by Nicolas Chopin and published by Springer Nature. This book was released on 2020-10-01 with total page 378 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book provides a general introduction to Sequential Monte Carlo (SMC) methods, also known as particle filters. These methods have become a staple for the sequential analysis of data in such diverse fields as signal processing, epidemiology, machine learning, population ecology, quantitative finance, and robotics. The coverage is comprehensive, ranging from the underlying theory to computational implementation, methodology, and diverse applications in various areas of science. This is achieved by describing SMC algorithms as particular cases of a general framework, which involves concepts such as Feynman-Kac distributions, and tools such as importance sampling and resampling. This general framework is used consistently throughout the book. Extensive coverage is provided on sequential learning (filtering, smoothing) of state-space (hidden Markov) models, as this remains an important application of SMC methods. More recent applications, such as parameter estimation of these models (through e.g. particle Markov chain Monte Carlo techniques) and the simulation of challenging probability distributions (in e.g. Bayesian inference or rare-event problems), are also discussed. The book may be used either as a graduate text on Sequential Monte Carlo methods and state-space modeling, or as a general reference work on the area. Each chapter includes a set of exercises for self-study, a comprehensive bibliography, and a “Python corner,” which discusses the practical implementation of the methods covered. In addition, the book comes with an open source Python library, which implements all the algorithms described in the book, and contains all the programs that were used to perform the numerical experiments.

Download or read book Consistency and Convergence Rate of Markov Chain Quasi Monte Carlo with Examples written by Su Chen and published by Stanford University. This book was released on 2011 with total page 124 pages. Available in PDF, EPUB and Kindle. Book excerpt: Markov Chain Monte Carlo methods have been widely used in various scientific disciplines for generation of samples from distributions that are difficult to simulate directly. The random numbers driving Markov Chain Monte Carlo algorithms are modeled as independent $\mathcal{U}[0,1)$ random variables. The class of distributions that could be simulated are largely broadened by using Markov Chain Monte Carlo. Quasi-Monte Carlo, on the other hand, aims to improve the accuracy of estimation of an integral over the multidimensional unit cube. By using more carefully balanced inputs, under some smoothness conditions the estimation error is converging at a higher rate than plain Monte Carlo. We would like to combine these two techniques, so that we can sample more accurately from a larger class of distributions. This method, called Markov Chain quasi-Monte Carlo (MCQMC), is the main topic of this work. We are going to replace the IID driving sequence used in MCMC algorithms by a deterministic sequence which is designed to be more uniform. Previously the justification for MCQMC is proved only for finite state space case. We are going to extend those results to some Markov Chains on continuous state spaces. We also explore the convergence rate of MCQMC under stronger assumptions. Lastly we present some numerical results for demonstration of MCQMC's performance. From these examples, the empirical benefits of more balanced sequences are significant.