Download or read book Nonparametric Perspectives on Empirical Bayes written by Nikolaos Ignatiadis and published by . This book was released on 2022 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: In an empirical Bayes analysis, we use data from repeated sampling to imitate inferences made by an oracle Bayesian with extensive knowledge of the data-generating distribution. Existing results provide a comprehensive characterization of when and why empirical Bayes point estimates accurately recover oracle Bayes behavior--in particular when the likelihood of the individual statistical problems is known and all problems are relevant to each other. In this thesis, we build upon advances in the theory of nonparametric statistics, machine learning, and computation to make three-fold contributions to the empirical Bayes literature: 1) We develop flexible and practical confidence intervals that provide asymptotic frequentist coverage of empirical Bayes estimands, such as the posterior mean or the local false sign rate. The coverage statements hold even when the estimands are only partially identified or when empirical Bayes point estimates converge very slowly. 2) We show that it is possible to achieve near-Bayes optimal mean squared error for the estimation of n effect sizes in the setting where both the prior and the per-problem likelihood are unknown. The requirement of our method is that we have access to replicated data, that is, each effect size of interest is estimated from K> 1 noisy observations. 3) We tackle the issue of relevance in empirical Bayes estimation of effect sizes. We propose a method that shrinks toward a per-problem location determined by a machine learning model prediction of the effect given side-information. We establish an extension to the classic result of James-Stein, whereby our proposed estimator dominates the sample mean for each problem under quadratic risk; even if the side-information contains no information about the true effects, or the machine learning model is arbitrarily miscalibrated. Taken together, these results broaden the applicability of empirical Bayes methods in areas such as genomics, and large scale experimentation, and demonstrate that it is fruitful to revisit traditional ideas in the empirical Bayes literature through a modern lens. The above results largely draw upon the following papers: Ignatiadis and Wager (2019, 2022) and Ignatiadis, Saha, Sun, and Muralidharan (2021).

Download or read book Bayesian Nonparametrics written by J.K. Ghosh and published by Springer Science & Business Media. This book was released on 2006-05-11 with total page 311 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book is the first systematic treatment of Bayesian nonparametric methods and the theory behind them. It will also appeal to statisticians in general. The book is primarily aimed at graduate students and can be used as the text for a graduate course in Bayesian non-parametrics.

Download or read book Unobserved Heterogeneity in Income Dynamics written by Jiaying Gu and published by . This book was released on 2014 with total page 31 pages. Available in PDF, EPUB and Kindle. Book excerpt: Empirical Bayes methods for Gaussian compound decision problems involving longitudinal data are considered. The new convex optimization formulation of the nonparametric (Kiefer-Wolfowitz) maximum likelihood estimator for mixture models is employed to construct nonparametric Bayes rules for compound decisions. The methods are first illustrated with some simulation examples and then with an application to models of income dynamics. Using PSID data we estimate a simple dynamic model of earnings that incorporates bivariate heterogeneity in intercept and variance of the innovation process. Profile likelihood is employed to estimate an AR(1) parameter controlling the persistence of the innovations. We find that persistence is relatively modest, p ̂= 0.48, when we permit heterogeneity in variances. Evidence of negative dependence between individual intercepts and variances is revealed by the nonparametric estimation of the mixing distribution, and has important consequences for forecasting future income trajectories.

Download or read book Efficient and Adaptive Estimation for Semiparametric Models written by Peter J. Bickel and published by Springer. This book was released on 1998-06-01 with total page 588 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book deals with estimation in situations in which there is believed to be enough information to model parametrically some, but not all of the features of a data set. Such models have arisen in a wide context in recent years, and involve new nonlinear estimation procedures. Statistical models of this type are directly applicable to fields such as economics, epidemiology, and astronomy.

Download or read book Bayesian Data Analysis Third Edition written by Andrew Gelman and published by CRC Press. This book was released on 2013-11-01 with total page 677 pages. Available in PDF, EPUB and Kindle. Book excerpt: Now in its third edition, this classic book is widely considered the leading text on Bayesian methods, lauded for its accessible, practical approach to analyzing data and solving research problems. Bayesian Data Analysis, Third Edition continues to take an applied approach to analysis using up-to-date Bayesian methods. The authors—all leaders in the statistics community—introduce basic concepts from a data-analytic perspective before presenting advanced methods. Throughout the text, numerous worked examples drawn from real applications and research emphasize the use of Bayesian inference in practice. New to the Third Edition Four new chapters on nonparametric modeling Coverage of weakly informative priors and boundary-avoiding priors Updated discussion of cross-validation and predictive information criteria Improved convergence monitoring and effective sample size calculations for iterative simulation Presentations of Hamiltonian Monte Carlo, variational Bayes, and expectation propagation New and revised software code The book can be used in three different ways. For undergraduate students, it introduces Bayesian inference starting from first principles. For graduate students, the text presents effective current approaches to Bayesian modeling and computation in statistics and related fields. For researchers, it provides an assortment of Bayesian methods in applied statistics. Additional materials, including data sets used in the examples, solutions to selected exercises, and software instructions, are available on the book’s web page.

Download or read book Fundamentals of Nonparametric Bayesian Inference written by Subhashis Ghosal and published by Cambridge University Press. This book was released on 2017-06-26 with total page 671 pages. Available in PDF, EPUB and Kindle. Book excerpt: Bayesian nonparametrics comes of age with this landmark text synthesizing theory, methodology and computation.

Download or read book Large Scale Inference written by Bradley Efron and published by Cambridge University Press. This book was released on 2012-11-29 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: We live in a new age for statistical inference, where modern scientific technology such as microarrays and fMRI machines routinely produce thousands and sometimes millions of parallel data sets, each with its own estimation or testing problem. Doing thousands of problems at once is more than repeated application of classical methods. Taking an empirical Bayes approach, Bradley Efron, inventor of the bootstrap, shows how information accrues across problems in a way that combines Bayesian and frequentist ideas. Estimation, testing and prediction blend in this framework, producing opportunities for new methodologies of increased power. New difficulties also arise, easily leading to flawed inferences. This book takes a careful look at both the promise and pitfalls of large-scale statistical inference, with particular attention to false discovery rates, the most successful of the new statistical techniques. Emphasis is on the inferential ideas underlying technical developments, illustrated using a large number of real examples.

Download or read book Bayesian Nonparametrics written by Nils Lid Hjort and published by Cambridge University Press. This book was released on 2010-04-12 with total page 309 pages. Available in PDF, EPUB and Kindle. Book excerpt: Bayesian nonparametrics works - theoretically, computationally. The theory provides highly flexible models whose complexity grows appropriately with the amount of data. Computational issues, though challenging, are no longer intractable. All that is needed is an entry point: this intelligent book is the perfect guide to what can seem a forbidding landscape. Tutorial chapters by Ghosal, Lijoi and Prünster, Teh and Jordan, and Dunson advance from theory, to basic models and hierarchical modeling, to applications and implementation, particularly in computer science and biostatistics. These are complemented by companion chapters by the editors and Griffin and Quintana, providing additional models, examining computational issues, identifying future growth areas, and giving links to related topics. This coherent text gives ready access both to underlying principles and to state-of-the-art practice. Specific examples are drawn from information retrieval, NLP, machine vision, computational biology, biostatistics, and bioinformatics.

Download or read book Data Gathering Analysis and Protection of Privacy Through Randomized Response Techniques Qualitative and Quantitative Human Traits written by and published by Elsevier. This book was released on 2016-04-20 with total page 545 pages. Available in PDF, EPUB and Kindle. Book excerpt: Data Gathering, Analysis and Protection of Privacy through Randomized Response Techniques: Qualitative and Quantitative Human Traits tackles how to gather and analyze data relating to stigmatizing human traits. S.L. Warner invented RRT and published it in JASA, 1965. In the 50 years since, the subject has grown tremendously, with continued growth. This book comprehensively consolidates the literature to commemorate the inception of RR. Brings together all relevant aspects of randomized response and indirect questioning Tackles how to gather and analyze data relating to stigmatizing human traits Gives an encyclopedic coverage of the topic Covers recent developments and extrapolates to future trends

Download or read book The Bayesian Choice written by Christian P. Robert and published by Springer Science & Business Media. This book was released on 2013-04-17 with total page 444 pages. Available in PDF, EPUB and Kindle. Book excerpt: This graduate-level textbook covers both the basic ideas of statistical theory, and also some of the more modern and advanced topics of Bayesian statistics, such as complete class theorems, the Stein effect, hierarchical and empirical Bayes modelling, Monte Carlo integration, and Gibbs sampling. In translating the book from the original French, the author has taken the opportunity to add and update material, and to include many problems and exercises for students.

Download or read book A Comparison of the Bayesian and Frequentist Approaches to Estimation written by Francisco J. Samaniego and published by Springer Science & Business Media. This book was released on 2010-06-14 with total page 235 pages. Available in PDF, EPUB and Kindle. Book excerpt: The main theme of this monograph is “comparative statistical inference. ” While the topics covered have been carefully selected (they are, for example, restricted to pr- lems of statistical estimation), my aim is to provide ideas and examples which will assist a statistician, or a statistical practitioner, in comparing the performance one can expect from using either Bayesian or classical (aka, frequentist) solutions in - timation problems. Before investing the hours it will take to read this monograph, one might well want to know what sets it apart from other treatises on comparative inference. The two books that are closest to the present work are the well-known tomes by Barnett (1999) and Cox (2006). These books do indeed consider the c- ceptual and methodological differences between Bayesian and frequentist methods. What is largely absent from them, however, are answers to the question: “which - proach should one use in a given problem?” It is this latter issue that this monograph is intended to investigate. There are many books on Bayesian inference, including, for example, the widely used texts by Carlin and Louis (2008) and Gelman, Carlin, Stern and Rubin (2004). These books differ from the present work in that they begin with the premise that a Bayesian treatment is called for and then provide guidance on how a Bayesian an- ysis should be executed. Similarly, there are many books written from a classical perspective.

Download or read book Statistical Decision Theory and Bayesian Analysis written by James O. Berger and published by Springer Science & Business Media. This book was released on 2013-03-14 with total page 633 pages. Available in PDF, EPUB and Kindle. Book excerpt: In this new edition the author has added substantial material on Bayesian analysis, including lengthy new sections on such important topics as empirical and hierarchical Bayes analysis, Bayesian calculation, Bayesian communication, and group decision making. With these changes, the book can be used as a self-contained introduction to Bayesian analysis. In addition, much of the decision-theoretic portion of the text was updated, including new sections covering such modern topics as minimax multivariate (Stein) estimation.

Download or read book Empirical Bayes and Likelihood Inference written by S.E. Ahmed and published by Springer Science & Business Media. This book was released on 2012-12-06 with total page 242 pages. Available in PDF, EPUB and Kindle. Book excerpt: Bayesian and such approaches to inference have a number of points of close contact, especially from an asymptotic point of view. Both emphasize the construction of interval estimates of unknown parameters. In this volume, researchers present recent work on several aspects of Bayesian, likelihood and empirical Bayes methods, presented at a workshop held in Montreal, Canada. The goal of the workshop was to explore the linkages among the methods, and to suggest new directions for research in the theory of inference.

Download or read book The Analysis of Gene Expression Data written by Giovanni Parmigiani and published by Springer Science & Business Media. This book was released on 2006-04-11 with total page 511 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book presents practical approaches for the analysis of data from gene expression micro-arrays. It describes the conceptual and methodological underpinning for a statistical tool and its implementation in software. The book includes coverage of various packages that are part of the Bioconductor project and several related R tools. The materials presented cover a range of software tools designed for varied audiences.

Download or read book Bayesian Data Analysis Second Edition written by Andrew Gelman and published by CRC Press. This book was released on 2003-07-29 with total page 717 pages. Available in PDF, EPUB and Kindle. Book excerpt: Incorporating new and updated information, this second edition of THE bestselling text in Bayesian data analysis continues to emphasize practice over theory, describing how to conceptualize, perform, and critique statistical analyses from a Bayesian perspective. Its world-class authors provide guidance on all aspects of Bayesian data analysis and include examples of real statistical analyses, based on their own research, that demonstrate how to solve complicated problems. Changes in the new edition include: Stronger focus on MCMC Revision of the computational advice in Part III New chapters on nonlinear models and decision analysis Several additional applied examples from the authors' recent research Additional chapters on current models for Bayesian data analysis such as nonlinear models, generalized linear mixed models, and more Reorganization of chapters 6 and 7 on model checking and data collection Bayesian computation is currently at a stage where there are many reasonable ways to compute any given posterior distribution. However, the best approach is not always clear ahead of time. Reflecting this, the new edition offers a more pluralistic presentation, giving advice on performing computations from many perspectives while making clear the importance of being aware that there are different ways to implement any given iterative simulation computation. The new approach, additional examples, and updated information make Bayesian Data Analysis an excellent introductory text and a reference that working scientists will use throughout their professional life.

Download or read book Statistical Parametric Mapping The Analysis of Functional Brain Images written by William D. Penny and published by Elsevier. This book was released on 2011-04-28 with total page 689 pages. Available in PDF, EPUB and Kindle. Book excerpt: In an age where the amount of data collected from brain imaging is increasing constantly, it is of critical importance to analyse those data within an accepted framework to ensure proper integration and comparison of the information collected. This book describes the ideas and procedures that underlie the analysis of signals produced by the brain. The aim is to understand how the brain works, in terms of its functional architecture and dynamics. This book provides the background and methodology for the analysis of all types of brain imaging data, from functional magnetic resonance imaging to magnetoencephalography. Critically, Statistical Parametric Mapping provides a widely accepted conceptual framework which allows treatment of all these different modalities. This rests on an understanding of the brain's functional anatomy and the way that measured signals are caused experimentally. The book takes the reader from the basic concepts underlying the analysis of neuroimaging data to cutting edge approaches that would be difficult to find in any other source. Critically, the material is presented in an incremental way so that the reader can understand the precedents for each new development. This book will be particularly useful to neuroscientists engaged in any form of brain mapping; who have to contend with the real-world problems of data analysis and understanding the techniques they are using. It is primarily a scientific treatment and a didactic introduction to the analysis of brain imaging data. It can be used as both a textbook for students and scientists starting to use the techniques, as well as a reference for practicing neuroscientists. The book also serves as a companion to the software packages that have been developed for brain imaging data analysis. An essential reference and companion for users of the SPM software Provides a complete description of the concepts and procedures entailed by the analysis of brain images Offers full didactic treatment of the basic mathematics behind the analysis of brain imaging data Stands as a compendium of all the advances in neuroimaging data analysis over the past decade Adopts an easy to understand and incremental approach that takes the reader from basic statistics to state of the art approaches such as Variational Bayes Structured treatment of data analysis issues that links different modalities and models Includes a series of appendices and tutorial-style chapters that makes even the most sophisticated approaches accessible

Download or read book Computer Age Statistical Inference written by Bradley Efron and published by Cambridge University Press. This book was released on 2016-07-21 with total page 496 pages. Available in PDF, EPUB and Kindle. Book excerpt: The twenty-first century has seen a breathtaking expansion of statistical methodology, both in scope and in influence. 'Big data', 'data science', and 'machine learning' have become familiar terms in the news, as statistical methods are brought to bear upon the enormous data sets of modern science and commerce. How did we get here? And where are we going? This book takes us on an exhilarating journey through the revolution in data analysis following the introduction of electronic computation in the 1950s. Beginning with classical inferential theories - Bayesian, frequentist, Fisherian - individual chapters take up a series of influential topics: survival analysis, logistic regression, empirical Bayes, the jackknife and bootstrap, random forests, neural networks, Markov chain Monte Carlo, inference after model selection, and dozens more. The distinctly modern approach integrates methodology and algorithms with statistical inference. The book ends with speculation on the future direction of statistics and data science.