Download or read book Large scale Inference Using Non parametric Mixtures written by Xiangjie Xue and published by . This book was released on 2021 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: A new approach to solving large-scale problems using non-parametric mixtures is proposed. The new approach not only takes the advantage of the great flexibility in nonparametric mixture methods and the fast computation of the non-parametric maximum likelihood estimate of a mixing distribution using the constrained Newton method proposed by Wang (2007), but it is also able to make use of the common features among observations in order for a more efficient and accurate estimation. This new approach is then applied to several practical fields. In the context of multiple hypothesis testing, a new method is proposed to compute the NPMLE given a fixed probability at the location of the null effect, and then is extended to estimate the proportion of null effects based on various threshold functions. Distance-based counterparts under the Cramér-von Mises and the Anderson-Darling distance are also introduced. Furthermore, modifications are also made to the likelihood- and distancebased methods, and hence they can be used in large-scale computation. A new procedure that controls the false discovery rate, based on the estimated null proportion and its estimated mixing distribution, is also introduced. Numerical studies show that the estimators of the null proportion using the non-parametric maximum likelihood estimators and their minimum distance counterparts (the non-parametric minimum distance estimators) perform well and the proposed controlling procedure makes more rejections than existing methods given a pre-specified level. A new method based on this new approach is also proposed for covariance matrix estimation. A new covariance matrix estimator is constructed using the empirical Bayes on the sample correlation coefficients or the transformed sample correlation coefficients. The estimated density required by the proposed estimator can be computed using the non-parametric maximum likelihood estimators or the non-parametric minimum distance estimators. Estimation under the sparsity assumption is also discussed. The numerical studies using the simulated and the real world datasets all suggest that the proposed covariance matrix estimator performs well and can be applied to a wide range of covariance structures.
Download or read book Large Scale Inference written by Bradley Efron and published by Cambridge University Press. This book was released on 2012-11-29 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: We live in a new age for statistical inference, where modern scientific technology such as microarrays and fMRI machines routinely produce thousands and sometimes millions of parallel data sets, each with its own estimation or testing problem. Doing thousands of problems at once is more than repeated application of classical methods. Taking an empirical Bayes approach, Bradley Efron, inventor of the bootstrap, shows how information accrues across problems in a way that combines Bayesian and frequentist ideas. Estimation, testing and prediction blend in this framework, producing opportunities for new methodologies of increased power. New difficulties also arise, easily leading to flawed inferences. This book takes a careful look at both the promise and pitfalls of large-scale statistical inference, with particular attention to false discovery rates, the most successful of the new statistical techniques. Emphasis is on the inferential ideas underlying technical developments, illustrated using a large number of real examples.
Download or read book Nonparametric Statistics and Mixture Models written by David R. Hunter and published by World Scientific. This book was released on 2011 with total page 370 pages. Available in PDF, EPUB and Kindle. Book excerpt: This festschrift includes papers authored by many collaborators, colleagues, and students of Professor Thomas P Hettmansperger, who worked in research in nonparametric statistics, rank statistics, robustness, and mixture models during a career that spanned nearly 40 years. It is a broad sample of peer-reviewed, cutting-edge research related to nonparametrics and mixture models.
Download or read book Nonparametric Inference written by Z. Govindarajulu and published by World Scientific Publishing Company Incorporated. This book was released on 2007-01-01 with total page 669 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book provides a solid foundation on nonparametric inference for students taking a graduate course in nonparametric statistics and serves as an easily accessible source for researchers in the area. With the exception of some sections requiring familiarity with measure theory, readers with an advanced calculus background will be comfortable with the material.
Download or read book Nonparametric Inference on Manifolds written by Abhishek Bhattacharya and published by Cambridge University Press. This book was released on 2012-04-05 with total page 252 pages. Available in PDF, EPUB and Kindle. Book excerpt: Ideal for statisticians, this book will also interest probabilists, mathematicians, computer scientists, and morphometricians with mathematical training. It presents a systematic introduction to a general nonparametric theory of statistics on manifolds, with emphasis on manifolds of shapes. The theory has important applications in medical diagnostics, image analysis and machine vision.
Download or read book Fundamentals of Nonparametric Bayesian Inference written by Subhashis Ghosal and published by Cambridge University Press. This book was released on 2017-06-26 with total page 671 pages. Available in PDF, EPUB and Kindle. Book excerpt: Explosive growth in computing power has made Bayesian methods for infinite-dimensional models - Bayesian nonparametrics - a nearly universal framework for inference, finding practical use in numerous subject areas. Written by leading researchers, this authoritative text draws on theoretical advances of the past twenty years to synthesize all aspects of Bayesian nonparametrics, from prior construction to computation and large sample behavior of posteriors. Because understanding the behavior of posteriors is critical to selecting priors that work, the large sample theory is developed systematically, illustrated by various examples of model and prior combinations. Precise sufficient conditions are given, with complete proofs, that ensure desirable posterior properties and behavior. Each chapter ends with historical notes and numerous exercises to deepen and consolidate the reader's understanding, making the book valuable for both graduate students and researchers in statistics and machine learning, as well as in application areas such as econometrics and biostatistics.
Download or read book Non standard Parametric Statistical Inference written by Russell Cheng and published by Oxford University Press. This book was released on 2017 with total page 431 pages. Available in PDF, EPUB and Kindle. Book excerpt: This research monograph gives a unified view of non-standard estimation problems. It provides an overall mathematical framework, but also draws together and studies in detail a large number of practical problems, previously only treated separately, offering solution methods and numerical procedures for each.
Download or read book Handbook of Multiple Comparisons written by Xinping Cui and published by CRC Press. This book was released on 2021-11-18 with total page 418 pages. Available in PDF, EPUB and Kindle. Book excerpt: Written by experts that include originators of some key ideas, chapters in the Handbook of Multiple Testing cover multiple comparison problems big and small, with guidance toward error rate control and insights on how principles developed earlier can be applied to current and emerging problems. Some highlights of the coverages are as follows. Error rate control is useful for controlling the incorrect decision rate. Chapter 1 introduces Tukey's original multiple comparison error rates and point to how they have been applied and adapted to modern multiple comparison problems as discussed in the later chapters. Principles endure. While the closed testing principle is more familiar, Chapter 4 shows the partitioning principle can derive confidence sets for multiple tests, which may become important as the profession goes beyond making decisions based on p-values. Multiple comparisons of treatment efficacy often involve multiple doses and endpoints. Chapter 12 on multiple endpoints explains how different choices of endpoint types lead to different multiplicity adjustment strategies, while Chapter 11 on the MCP-Mod approach is particularly useful for dose-finding. To assess efficacy in clinical trials with multiple doses and multiple endpoints, the reader can see the traditional approach in Chapter 2, the Graphical approach in Chapter 5, and the multivariate approach in Chapter 3. Personalized/precision medicine based on targeted therapies, already a reality, naturally leads to analysis of efficacy in subgroups. Chapter 13 draws attention to subtle logical issues in inferences on subgroups and their mixtures, with a principled solution that resolves these issues. This chapter has implication toward meeting the ICHE9R1 Estimands requirement. Besides the mere multiple testing methodology itself, the handbook also covers related topics like the statistical task of model selection in Chapter 7 or the estimation of the proportion of true null hypotheses (or, in other words, the signal prevalence) in Chapter 8. It also contains decision-theoretic considerations regarding the admissibility of multiple tests in Chapter 6. The issue of selected inference is addressed in Chapter 9. Comparison of responses can involve millions of voxels in medical imaging or SNPs in genome-wide association studies (GWAS). Chapter 14 and Chapter 15 provide state of the art methods for large scale simultaneous inference in these settings.
Download or read book Large Scale Knowledge Resources Construction and Application written by Takenobu Tokunaga and published by Springer Science & Business Media. This book was released on 2008-02-08 with total page 375 pages. Available in PDF, EPUB and Kindle. Book excerpt: Atthestartofthe21stcentury,wearenowwellonthewaytowardsaknowled- intensive society, in which knowledge plays ever more important roles. Thus, research interest should inevitably shift from information to knowledge, with the problems of building, organizing, maintaining and utilizing knowledge - coming centralissues in a wide varietyof ?elds. The 21stCentury COE program “Framework for Systematization and Application of Large-scale Knowledge - sources (COE-LKR)” conducted by the Tokyo Institute of Technology is one of several early attempts worldwide to address these important issues. Inspired by this project, LKR2008 aimed at bringing together diverse contributions in cognitive science, computer science, education and linguistics to explore design, construction, extension, maintenance, validation and application of knowledge. Respondingtoourcallforpapers,wereceived38submissionfromavarietyof researchareas.EachpaperwasreviewedbythreeProgramCommitteemembers. Since we were aiming at an interdisciplinary conference covering a wide range of topics concerning large-scale knowledge resources (LKR), each paper was assigned a reviewer from a topic area outside the main thrust of the paper. This reviewer was asked to assess whether the authors described the moti- tion and importance of their work in a comprehensible manner even for readers in other research areas. Following a rigorous reviewing process, we accepted 14 regular papers and 12 poster papers.
Download or read book Bayesian Nonparametrics for Causal Inference and Missing Data written by Michael J. Daniels and published by CRC Press. This book was released on 2023-08-23 with total page 263 pages. Available in PDF, EPUB and Kindle. Book excerpt: Bayesian Nonparametrics for Causal Inference and Missing Data provides an overview of flexible Bayesian nonparametric (BNP) methods for modeling joint or conditional distributions and functional relationships, and their interplay with causal inference and missing data. This book emphasizes the importance of making untestable assumptions to identify estimands of interest, such as missing at random assumption for missing data and unconfoundedness for causal inference in observational studies. Unlike parametric methods, the BNP approach can account for possible violations of assumptions and minimize concerns about model misspecification. The overall strategy is to first specify BNP models for observed data and then to specify additional uncheckable assumptions to identify estimands of interest. The book is divided into three parts. Part I develops the key concepts in causal inference and missing data and reviews relevant concepts in Bayesian inference. Part II introduces the fundamental BNP tools required to address causal inference and missing data problems. Part III shows how the BNP approach can be applied in a variety of case studies. The datasets in the case studies come from electronic health records data, survey data, cohort studies, and randomized clinical trials. Features • Thorough discussion of both BNP and its interplay with causal inference and missing data • How to use BNP and g-computation for causal inference and non-ignorable missingness • How to derive and calibrate sensitivity parameters to assess sensitivity to deviations from uncheckable causal and/or missingness assumptions • Detailed case studies illustrating the application of BNP methods to causal inference and missing data • R code and/or packages to implement BNP in causal inference and missing data problems The book is primarily aimed at researchers and graduate students from statistics and biostatistics. It will also serve as a useful practical reference for mathematically sophisticated epidemiologists and medical researchers.
Download or read book Nonparametric Inference for High Dimensional Data written by Subhadeep Mukhopadhyay and published by . This book was released on 2013 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: Learning from data, especially 'Big Data', is becoming increasingly popular under names such as Data Mining, Data Science, Machine Learning, Statistical Learning and High Dimensional Data Analysis. In this dissertation we propose a new related field, which we call 'United Nonparametric Data Science' - applied statistics with "just in time" theory. It integrates the practice of traditional and novel statistical methods for nonparametric exploratory data modeling, and it is applicable to teaching introductory statistics courses that are closer to modern frontiers of scientific research. Our framework includes small data analysis (combining traditional and modern nonparametric statistical inference), big and high dimensional data analysis (by statistical modeling methods that extend our unified framework for small data analysis). The first part of the dissertation (Chapters 2 and 3) has been oriented by the goal of developing a new theoretical foundation to unify many cultures of statistical science and statistical learning methods using mid-distribution function, custom made orthonormal score function, comparison density, copula density, LP moments and comoments. It is also examined how this elegant theory yields solution to many important applied problems. In the second part (Chapter 4) we extend the traditional empirical likelihood (EL), a versatile tool for nonparametric inference, in the high dimensional context. We introduce a modified version of the EL method that is computationally simpler and applicable to a large class of "large p small n" problems, allowing p to grow faster than n. This is an important step in generalizing the EL in high dimensions beyond the p ≤ n threshold where the standard EL and its existing variants fail. We also present detailed theoretical study of the proposed method. The electronic version of this dissertation is accessible from http://hdl.handle.net/1969.1/149430
Download or read book Parametric and Nonparametric Inference from Record Breaking Data written by Sneh Gulati and published by . This book was released on 2014-01-15 with total page 128 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Prior Processes and Their Applications written by Eswar G. Phadia and published by Springer. This book was released on 2016-07-27 with total page 337 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book presents a systematic and comprehensive treatment of various prior processes that have been developed over the past four decades for dealing with Bayesian approach to solving selected nonparametric inference problems. This revised edition has been substantially expanded to reflect the current interest in this area. After an overview of different prior processes, it examines the now pre-eminent Dirichlet process and its variants including hierarchical processes, then addresses new processes such as dependent Dirichlet, local Dirichlet, time-varying and spatial processes, all of which exploit the countable mixture representation of the Dirichlet process. It subsequently discusses various neutral to right type processes, including gamma and extended gamma, beta and beta-Stacy processes, and then describes the Chinese Restaurant, Indian Buffet and infinite gamma-Poisson processes, which prove to be very useful in areas such as machine learning, information retrieval and featural modeling. Tailfree and Polya tree and their extensions form a separate chapter, while the last two chapters present the Bayesian solutions to certain estimation problems pertaining to the distribution function and its functional based on complete data as well as right censored data. Because of the conjugacy property of some of these processes, most solutions are presented in closed form. However, the current interest in modeling and treating large-scale and complex data also poses a problem – the posterior distribution, which is essential to Bayesian analysis, is invariably not in a closed form, making it necessary to resort to simulation. Accordingly, the book also introduces several computational procedures, such as the Gibbs sampler, Blocked Gibbs sampler and slice sampling, highlighting essential steps of algorithms while discussing specific models. In addition, it features crucial steps of proofs and derivations, explains the relationships between different processes and provides further clarifications to promote a deeper understanding. Lastly, it includes a comprehensive list of references, equipping readers to explore further on their own.
Download or read book Statistical Inference for High dimensional Nonparametric Models written by Jie Li and published by . This book was released on 2021 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Fundamental Statistical Inference written by Marc S. Paolella and published by John Wiley & Sons. This book was released on 2018-06-19 with total page 584 pages. Available in PDF, EPUB and Kindle. Book excerpt: A hands-on approach to statistical inference that addresses the latest developments in this ever-growing field This clear and accessible book for beginning graduate students offers a practical and detailed approach to the field of statistical inference, providing complete derivations of results, discussions, and MATLAB programs for computation. It emphasizes details of the relevance of the material, intuition, and discussions with a view towards very modern statistical inference. In addition to classic subjects associated with mathematical statistics, topics include an intuitive presentation of the (single and double) bootstrap for confidence interval calculations, shrinkage estimation, tail (maximal moment) estimation, and a variety of methods of point estimation besides maximum likelihood, including use of characteristic functions, and indirect inference. Practical examples of all methods are given. Estimation issues associated with the discrete mixtures of normal distribution, and their solutions, are developed in detail. Much emphasis throughout is on non-Gaussian distributions, including details on working with the stable Paretian distribution and fast calculation of the noncentral Student's t. An entire chapter is dedicated to optimization, including development of Hessian-based methods, as well as heuristic/genetic algorithms that do not require continuity, with MATLAB codes provided. The book includes both theory and nontechnical discussions, along with a substantial reference to the literature, with an emphasis on alternative, more modern approaches. The recent literature on the misuse of hypothesis testing and p-values for model selection is discussed, and emphasis is given to alternative model selection methods, though hypothesis testing of distributional assumptions is covered in detail, notably for the normal distribution. Presented in three parts—Essential Concepts in Statistics; Further Fundamental Concepts in Statistics; and Additional Topics—Fundamental Statistical Inference: A Computational Approach offers comprehensive chapters on: Introducing Point and Interval Estimation; Goodness of Fit and Hypothesis Testing; Likelihood; Numerical Optimization; Methods of Point Estimation; Q-Q Plots and Distribution Testing; Unbiased Point Estimation and Bias Reduction; Analytic Interval Estimation; Inference in a Heavy-Tailed Context; The Method of Indirect Inference; and, as an appendix, A Review of Fundamental Concepts in Probability Theory, the latter to keep the book self-contained, and giving material on some advanced subjects such as saddlepoint approximations, expected shortfall in finance, calculation with the stable Paretian distribution, and convergence theorems and proofs.
Download or read book Large Scale Inverse Problems written by Mike Cullen and published by Walter de Gruyter. This book was released on 2013-08-29 with total page 216 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book is thesecond volume of a three volume series recording the "Radon Special Semester 2011 on Multiscale Simulation & Analysis in Energy and the Environment" that took placein Linz, Austria, October 3-7, 2011. This volume addresses the common ground in the mathematical and computational procedures required for large-scale inverse problems and data assimilation in forefront applications. The solution of inverse problems is fundamental to a wide variety of applications such as weather forecasting, medical tomography, and oil exploration. Regularisation techniques are needed to ensure solutions of sufficient quality to be useful, and soundly theoretically based. This book addresses the common techniques required for all the applications, and is thus truly interdisciplinary. Thiscollection of surveyarticlesfocusses onthe large inverse problems commonly arising in simulation and forecasting in the earth sciences. For example, operational weather forecasting models have between 107 and 108 degrees of freedom. Even so, these degrees of freedom represent grossly space-time averaged properties of the atmosphere. Accurate forecasts require accurate initial conditions. With recent developments in satellite data, there are between 106 and 107 observations each day. However, while these also represent space-time averaged properties, the averaging implicit in the measurements is quite different from that used in the models. In atmosphere and ocean applications, there is a physically-based model available which can be used to regularise the problem. We assume that there is a set of observations with known error characteristics available over a period of time. The basic deterministic technique is to fit a model trajectory to the observations over a period of time to within the observation error. Since the model is not perfect the model trajectory has to be corrected, which defines the data assimilation problem. The stochastic view can be expressed by using an ensemble of model trajectories, and calculating corrections to both the mean value and the spread which allow the observations to be fitted by each ensemble member. In other areas of earth science, only the structure of the model formulation itself is known and the aim is to use the past observation history to determine the unknown model parameters. The book records the achievements of Workshop2 "Large-Scale Inverse Problems and Applications in the Earth Sciences". Itinvolves experts in the theory of inverse problems together with experts working on both theoretical and practical aspects of the techniques by which large inverse problems arise in the earth sciences.
Download or read book Proceedings of the Third SIAM International Conference on Data Mining written by Daniel Barbara and published by SIAM. This book was released on 2003-01-01 with total page 368 pages. Available in PDF, EPUB and Kindle. Book excerpt: The third SIAM International Conference on Data Mining provided an open forum for the presentation, discussion and development of innovative algorithms, software and theories for data mining applications and data intensive computation. This volume includes 21 research papers.
