Download or read book Computing Rare event Probabilities for Affine Models and General State Space Markov Processes written by Xiaowei Zhang and published by Stanford University. This book was released on 2011 with total page 129 pages. Available in PDF, EPUB and Kindle. Book excerpt: Rare-event simulation concerns computing small probabilities, i.e. rare-event probabilities. This dissertation investigates efficient simulation algorithms based on importance sampling for computing rare-event probabilities for different models, and establishes their efficiency via asymptotic analysis. The first part discusses asymptotic behavior of affine models. Stochastic stability of affine jump diffusions are carefully studied. In particular, positive recurrence, ergodicity, and exponential ergodicity are established for such processes under various conditions via a Foster-Lyapunov type approach. The stationary distribution is characterized in terms of its characteristic function. Furthermore, the large deviations behavior of affine point processes are explicitly computed, based on which a logarithmically efficient importance sampling algorithm is proposed for computing rare-event probabilities for affine point processes. The second part is devoted to a much more general setting, i.e. general state space Markov processes. The current state-of-the-art algorithm for computing rare-event probabilities in this context heavily relies on the solution of a certain eigenvalue problem, which is often unavailable in closed form unless certain special structure is present (e.g. affine structure for affine models). To circumvent this difficulty, assuming the existence of a regenerative structure, we propose a bootstrap-based algorithm that conducts the importance sampling on the regenerative cycle-path space instead of the original one-step transition kernel. The efficiency of this algorithm is also discussed.
Download or read book Computing Rare event Probabilities for Affine Models and General State Space Markov Processes written by Xiaowei Zhang and published by . This book was released on 2011 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: Rare-event simulation concerns computing small probabilities, i.e. rare-event probabilities. This dissertation investigates efficient simulation algorithms based on importance sampling for computing rare-event probabilities for different models, and establishes their efficiency via asymptotic analysis. The first part discusses asymptotic behavior of affine models. Stochastic stability of affine jump diffusions are carefully studied. In particular, positive recurrence, ergodicity, and exponential ergodicity are established for such processes under various conditions via a Foster-Lyapunov type approach. The stationary distribution is characterized in terms of its characteristic function. Furthermore, the large deviations behavior of affine point processes are explicitly computed, based on which a logarithmically efficient importance sampling algorithm is proposed for computing rare-event probabilities for affine point processes. The second part is devoted to a much more general setting, i.e. general state space Markov processes. The current state-of-the-art algorithm for computing rare-event probabilities in this context heavily relies on the solution of a certain eigenvalue problem, which is often unavailable in closed form unless certain special structure is present (e.g. affine structure for affine models). To circumvent this difficulty, assuming the existence of a regenerative structure, we propose a bootstrap-based algorithm that conducts the importance sampling on the regenerative cycle-path space instead of the original one-step transition kernel. The efficiency of this algorithm is also discussed.
Download or read book Rare Event Simulation using Monte Carlo Methods written by Gerardo Rubino and published by John Wiley & Sons. This book was released on 2009-03-18 with total page 278 pages. Available in PDF, EPUB and Kindle. Book excerpt: In a probabilistic model, a rare event is an event with a very small probability of occurrence. The forecasting of rare events is a formidable task but is important in many areas. For instance a catastrophic failure in a transport system or in a nuclear power plant, the failure of an information processing system in a bank, or in the communication network of a group of banks, leading to financial losses. Being able to evaluate the probability of rare events is therefore a critical issue. Monte Carlo Methods, the simulation of corresponding models, are used to analyze rare events. This book sets out to present the mathematical tools available for the efficient simulation of rare events. Importance sampling and splitting are presented along with an exposition of how to apply these tools to a variety of fields ranging from performance and dependability evaluation of complex systems, typically in computer science or in telecommunications, to chemical reaction analysis in biology or particle transport in physics. Graduate students, researchers and practitioners who wish to learn and apply rare event simulation techniques will find this book beneficial.
Download or read book Simulation and the Monte Carlo Method written by Reuven Y. Rubinstein and published by John Wiley & Sons. This book was released on 2016-10-21 with total page 432 pages. Available in PDF, EPUB and Kindle. Book excerpt: This accessible new edition explores the major topics in Monte Carlo simulation that have arisen over the past 30 years and presents a sound foundation for problem solving Simulation and the Monte Carlo Method, Third Edition reflects the latest developments in the field and presents a fully updated and comprehensive account of the state-of-the-art theory, methods and applications that have emerged in Monte Carlo simulation since the publication of the classic First Edition over more than a quarter of a century ago. While maintaining its accessible and intuitive approach, this revised edition features a wealth of up-to-date information that facilitates a deeper understanding of problem solving across a wide array of subject areas, such as engineering, statistics, computer science, mathematics, and the physical and life sciences. The book begins with a modernized introduction that addresses the basic concepts of probability, Markov processes, and convex optimization. Subsequent chapters discuss the dramatic changes that have occurred in the field of the Monte Carlo method, with coverage of many modern topics including: Markov Chain Monte Carlo, variance reduction techniques such as importance (re-)sampling, and the transform likelihood ratio method, the score function method for sensitivity analysis, the stochastic approximation method and the stochastic counter-part method for Monte Carlo optimization, the cross-entropy method for rare events estimation and combinatorial optimization, and application of Monte Carlo techniques for counting problems. An extensive range of exercises is provided at the end of each chapter, as well as a generous sampling of applied examples. The Third Edition features a new chapter on the highly versatile splitting method, with applications to rare-event estimation, counting, sampling, and optimization. A second new chapter introduces the stochastic enumeration method, which is a new fast sequential Monte Carlo method for tree search. In addition, the Third Edition features new material on: • Random number generation, including multiple-recursive generators and the Mersenne Twister • Simulation of Gaussian processes, Brownian motion, and diffusion processes • Multilevel Monte Carlo method • New enhancements of the cross-entropy (CE) method, including the “improved” CE method, which uses sampling from the zero-variance distribution to find the optimal importance sampling parameters • Over 100 algorithms in modern pseudo code with flow control • Over 25 new exercises Simulation and the Monte Carlo Method, Third Edition is an excellent text for upper-undergraduate and beginning graduate courses in stochastic simulation and Monte Carlo techniques. The book also serves as a valuable reference for professionals who would like to achieve a more formal understanding of the Monte Carlo method. Reuven Y. Rubinstein, DSc, was Professor Emeritus in the Faculty of Industrial Engineering and Management at Technion-Israel Institute of Technology. He served as a consultant at numerous large-scale organizations, such as IBM, Motorola, and NEC. The author of over 100 articles and six books, Dr. Rubinstein was also the inventor of the popular score-function method in simulation analysis and generic cross-entropy methods for combinatorial optimization and counting. Dirk P. Kroese, PhD, is a Professor of Mathematics and Statistics in the School of Mathematics and Physics of The University of Queensland, Australia. He has published over 100 articles and four books in a wide range of areas in applied probability and statistics, including Monte Carlo methods, cross-entropy, randomized algorithms, tele-traffic c theory, reliability, computational statistics, applied probability, and stochastic modeling.
Download or read book Basics of Applied Stochastic Processes written by Richard Serfozo and published by Springer Science & Business Media. This book was released on 2009-01-24 with total page 452 pages. Available in PDF, EPUB and Kindle. Book excerpt: Stochastic processes are mathematical models of random phenomena that evolve according to prescribed dynamics. Processes commonly used in applications are Markov chains in discrete and continuous time, renewal and regenerative processes, Poisson processes, and Brownian motion. This volume gives an in-depth description of the structure and basic properties of these stochastic processes. A main focus is on equilibrium distributions, strong laws of large numbers, and ordinary and functional central limit theorems for cost and performance parameters. Although these results differ for various processes, they have a common trait of being limit theorems for processes with regenerative increments. Extensive examples and exercises show how to formulate stochastic models of systems as functions of a system’s data and dynamics, and how to represent and analyze cost and performance measures. Topics include stochastic networks, spatial and space-time Poisson processes, queueing, reversible processes, simulation, Brownian approximations, and varied Markovian models. The technical level of the volume is between that of introductory texts that focus on highlights of applied stochastic processes, and advanced texts that focus on theoretical aspects of processes.
Download or read book Dissertation Abstracts International written by and published by . This book was released on 2006 with total page 862 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Graphical Models Exponential Families and Variational Inference written by Martin J. Wainwright and published by Now Publishers Inc. This book was released on 2008 with total page 324 pages. Available in PDF, EPUB and Kindle. Book excerpt: The core of this paper is a general set of variational principles for the problems of computing marginal probabilities and modes, applicable to multivariate statistical models in the exponential family.
Download or read book Markov Chains and Dependability Theory written by Gerardo Rubino and published by Cambridge University Press. This book was released on 2014-06-12 with total page 287 pages. Available in PDF, EPUB and Kindle. Book excerpt: Covers fundamental and applied results of Markov chain analysis for the evaluation of dependability metrics, for graduate students and researchers.
Download or read book Stochastic Hybrid Systems written by Christos G. Cassandras and published by CRC Press. This book was released on 2018-10-03 with total page 300 pages. Available in PDF, EPUB and Kindle. Book excerpt: Because they incorporate both time- and event-driven dynamics, stochastic hybrid systems (SHS) have become ubiquitous in a variety of fields, from mathematical finance to biological processes to communication networks to engineering. Comprehensively integrating numerous cutting-edge studies, Stochastic Hybrid Systems presents a captivating treatment of some of the most ambitious types of dynamic systems. Cohesively edited by leading experts in the field, the book introduces the theoretical basics, computational methods, and applications of SHS. It first discusses the underlying principles behind SHS and the main design limitations of SHS. Building on these fundamentals, the authoritative contributors present methods for computer calculations that apply SHS analysis and synthesis techniques in practice. The book concludes with examples of systems encountered in a wide range of application areas, including molecular biology, communication networks, and air traffic management. It also explains how to resolve practical problems associated with these systems. Stochastic Hybrid Systems achieves an ideal balance between a theoretical treatment of SHS and practical considerations. The book skillfully explores the interaction of physical processes with computerized equipment in an uncertain environment, enabling a better understanding of sophisticated as well as everyday devices and processes.
Download or read book Stochastic Networks written by Frank Kelly and published by Cambridge University Press. This book was released on 2014-02-27 with total page 233 pages. Available in PDF, EPUB and Kindle. Book excerpt: A compact, highly-motivated introduction to some of the stochastic models found useful in the study of communications networks.
Download or read book Elements of Causal Inference written by Jonas Peters and published by MIT Press. This book was released on 2017-11-29 with total page 289 pages. Available in PDF, EPUB and Kindle. Book excerpt: A concise and self-contained introduction to causal inference, increasingly important in data science and machine learning. The mathematization of causality is a relatively recent development, and has become increasingly important in data science and machine learning. This book offers a self-contained and concise introduction to causal models and how to learn them from data. After explaining the need for causal models and discussing some of the principles underlying causal inference, the book teaches readers how to use causal models: how to compute intervention distributions, how to infer causal models from observational and interventional data, and how causal ideas could be exploited for classical machine learning problems. All of these topics are discussed first in terms of two variables and then in the more general multivariate case. The bivariate case turns out to be a particularly hard problem for causal learning because there are no conditional independences as used by classical methods for solving multivariate cases. The authors consider analyzing statistical asymmetries between cause and effect to be highly instructive, and they report on their decade of intensive research into this problem. The book is accessible to readers with a background in machine learning or statistics, and can be used in graduate courses or as a reference for researchers. The text includes code snippets that can be copied and pasted, exercises, and an appendix with a summary of the most important technical concepts.
Download or read book Handbook of Monte Carlo Methods written by Dirk P. Kroese and published by John Wiley & Sons. This book was released on 2013-06-06 with total page 627 pages. Available in PDF, EPUB and Kindle. Book excerpt: A comprehensive overview of Monte Carlo simulation that explores the latest topics, techniques, and real-world applications More and more of today’s numerical problems found in engineering and finance are solved through Monte Carlo methods. The heightened popularity of these methods and their continuing development makes it important for researchers to have a comprehensive understanding of the Monte Carlo approach. Handbook of Monte Carlo Methods provides the theory, algorithms, and applications that helps provide a thorough understanding of the emerging dynamics of this rapidly-growing field. The authors begin with a discussion of fundamentals such as how to generate random numbers on a computer. Subsequent chapters discuss key Monte Carlo topics and methods, including: Random variable and stochastic process generation Markov chain Monte Carlo, featuring key algorithms such as the Metropolis-Hastings method, the Gibbs sampler, and hit-and-run Discrete-event simulation Techniques for the statistical analysis of simulation data including the delta method, steady-state estimation, and kernel density estimation Variance reduction, including importance sampling, latin hypercube sampling, and conditional Monte Carlo Estimation of derivatives and sensitivity analysis Advanced topics including cross-entropy, rare events, kernel density estimation, quasi Monte Carlo, particle systems, and randomized optimization The presented theoretical concepts are illustrated with worked examples that use MATLAB®, a related Web site houses the MATLAB® code, allowing readers to work hands-on with the material and also features the author's own lecture notes on Monte Carlo methods. Detailed appendices provide background material on probability theory, stochastic processes, and mathematical statistics as well as the key optimization concepts and techniques that are relevant to Monte Carlo simulation. Handbook of Monte Carlo Methods is an excellent reference for applied statisticians and practitioners working in the fields of engineering and finance who use or would like to learn how to use Monte Carlo in their research. It is also a suitable supplement for courses on Monte Carlo methods and computational statistics at the upper-undergraduate and graduate levels.
Download or read book Ambit Stochastics written by Ole E. Barndorff-Nielsen and published by Springer. This book was released on 2018-11-01 with total page 402 pages. Available in PDF, EPUB and Kindle. Book excerpt: Drawing on advanced probability theory, Ambit Stochastics is used to model stochastic processes which depend on both time and space. This monograph, the first on the subject, provides a reference for this burgeoning field, complete with the applications that have driven its development. Unique to Ambit Stochastics are ambit sets, which allow the delimitation of space-time to a zone of interest, and ambit fields, which are particularly well-adapted to modelling stochastic volatility or intermittency. These attributes lend themselves notably to applications in the statistical theory of turbulence and financial econometrics. In addition to the theory and applications of Ambit Stochastics, the book also contains new theory on the simulation of ambit fields and a comprehensive stochastic integration theory for Volterra processes in a non-semimartingale context. Written by pioneers in the subject, this book will appeal to researchers and graduate students interested in empirical stochastic modelling.
Download or read book Probability Theory STAT310 MATH230 written by Amir Dembo and published by . This book was released on 2014-10-24 with total page 384 pages. Available in PDF, EPUB and Kindle. Book excerpt: Probability Theory: STAT310/MATH230By Amir Dembo
Download or read book Mathematics for Machine Learning written by Marc Peter Deisenroth and published by Cambridge University Press. This book was released on 2020-04-23 with total page 392 pages. Available in PDF, EPUB and Kindle. Book excerpt: The fundamental mathematical tools needed to understand machine learning include linear algebra, analytic geometry, matrix decompositions, vector calculus, optimization, probability and statistics. These topics are traditionally taught in disparate courses, making it hard for data science or computer science students, or professionals, to efficiently learn the mathematics. This self-contained textbook bridges the gap between mathematical and machine learning texts, introducing the mathematical concepts with a minimum of prerequisites. It uses these concepts to derive four central machine learning methods: linear regression, principal component analysis, Gaussian mixture models and support vector machines. For students and others with a mathematical background, these derivations provide a starting point to machine learning texts. For those learning the mathematics for the first time, the methods help build intuition and practical experience with applying mathematical concepts. Every chapter includes worked examples and exercises to test understanding. Programming tutorials are offered on the book's web site.
Download or read book Foundations of Probabilistic Programming written by Gilles Barthe and published by Cambridge University Press. This book was released on 2020-12-03 with total page 583 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book provides an overview of the theoretical underpinnings of modern probabilistic programming and presents applications in e.g., machine learning, security, and approximate computing. Comprehensive survey chapters make the material accessible to graduate students and non-experts. This title is also available as Open Access on Cambridge Core.
Download or read book Applied Stochastic Processes and Control for Jump Diffusions written by Floyd B. Hanson and published by SIAM. This book was released on 2007-01-01 with total page 472 pages. Available in PDF, EPUB and Kindle. Book excerpt: This self-contained, practical, entry-level text integrates the basic principles of applied mathematics, applied probability, and computational science for a clear presentation of stochastic processes and control for jump diffusions in continuous time. The author covers the important problem of controlling these systems and, through the use of a jump calculus construction, discusses the strong role of discontinuous and nonsmooth properties versus random properties in stochastic systems.
