Download or read book Shrinkage Estimation written by Dominique Fourdrinier and published by Springer. This book was released on 2018-11-27 with total page 339 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book provides a coherent framework for understanding shrinkage estimation in statistics. The term refers to modifying a classical estimator by moving it closer to a target which could be known a priori or arise from a model. The goal is to construct estimators with improved statistical properties. The book focuses primarily on point and loss estimation of the mean vector of multivariate normal and spherically symmetric distributions. Chapter 1 reviews the statistical and decision theoretic terminology and results that will be used throughout the book. Chapter 2 is concerned with estimating the mean vector of a multivariate normal distribution under quadratic loss from a frequentist perspective. In Chapter 3 the authors take a Bayesian view of shrinkage estimation in the normal setting. Chapter 4 introduces the general classes of spherically and elliptically symmetric distributions. Point and loss estimation for these broad classes are studied in subsequent chapters. In particular, Chapter 5 extends many of the results from Chapters 2 and 3 to spherically and elliptically symmetric distributions. Chapter 6 considers the general linear model with spherically symmetric error distributions when a residual vector is available. Chapter 7 then considers the problem of estimating a location vector which is constrained to lie in a convex set. Much of the chapter is devoted to one of two types of constraint sets, balls and polyhedral cones. In Chapter 8 the authors focus on loss estimation and data-dependent evidence reports. Appendices cover a number of technical topics including weakly differentiable functions; examples where Stein’s identity doesn’t hold; Stein’s lemma and Stokes’ theorem for smooth boundaries; harmonic, superharmonic and subharmonic functions; and modified Bessel functions.
Download or read book Shrinkage Estimation for Mean and Covariance Matrices written by Hisayuki Tsukuma and published by Springer Nature. This book was released on 2020-04-16 with total page 119 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book provides a self-contained introduction to shrinkage estimation for matrix-variate normal distribution models. More specifically, it presents recent techniques and results in estimation of mean and covariance matrices with a high-dimensional setting that implies singularity of the sample covariance matrix. Such high-dimensional models can be analyzed by using the same arguments as for low-dimensional models, thus yielding a unified approach to both high- and low-dimensional shrinkage estimations. The unified shrinkage approach not only integrates modern and classical shrinkage estimation, but is also required for further development of the field. Beginning with the notion of decision-theoretic estimation, this book explains matrix theory, group invariance, and other mathematical tools for finding better estimators. It also includes examples of shrinkage estimators for improving standard estimators, such as least squares, maximum likelihood, and minimum risk invariant estimators, and discusses the historical background and related topics in decision-theoretic estimation of parameter matrices. This book is useful for researchers and graduate students in various fields requiring data analysis skills as well as in mathematical statistics.
Download or read book Penalty Shrinkage and Pretest Strategies written by S. Ejaz Ahmed and published by Springer Science & Business Media. This book was released on 2013-12-11 with total page 122 pages. Available in PDF, EPUB and Kindle. Book excerpt: The objective of this book is to compare the statistical properties of penalty and non-penalty estimation strategies for some popular models. Specifically, it considers the full model, submodel, penalty, pretest and shrinkage estimation techniques for three regression models before presenting the asymptotic properties of the non-penalty estimators and their asymptotic distributional efficiency comparisons. Further, the risk properties of the non-penalty estimators and penalty estimators are explored through a Monte Carlo simulation study. Showcasing examples based on real datasets, the book will be useful for students and applied researchers in a host of applied fields. The book’s level of presentation and style make it accessible to a broad audience. It offers clear, succinct expositions of each estimation strategy. More importantly, it clearly describes how to use each estimation strategy for the problem at hand. The book is largely self-contained, as are the individual chapters, so that anyone interested in a particular topic or area of application may read only that specific chapter. The book is specially designed for graduate students who want to understand the foundations and concepts underlying penalty and non-penalty estimation and its applications. It is well-suited as a textbook for senior undergraduate and graduate courses surveying penalty and non-penalty estimation strategies, and can also be used as a reference book for a host of related subjects, including courses on meta-analysis. Professional statisticians will find this book to be a valuable reference work, since nearly all chapters are self-contained.
Download or read book Post Shrinkage Strategies in Statistical and Machine Learning for High Dimensional Data written by Syed Ejaz Ahmed and published by CRC Press. This book was released on 2023-05-25 with total page 409 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book presents some post-estimation and predictions strategies for the host of useful statistical models with applications in data science. It combines statistical learning and machine learning techniques in a unique and optimal way. It is well-known that machine learning methods are subject to many issues relating to bias, and consequently the mean squared error and prediction error may explode. For this reason, we suggest shrinkage strategies to control the bias by combining a submodel selected by a penalized method with a model with many features. Further, the suggested shrinkage methodology can be successfully implemented for high dimensional data analysis. Many researchers in statistics and medical sciences work with big data. They need to analyse this data through statistical modelling. Estimating the model parameters accurately is an important part of the data analysis. This book may be a repository for developing improve estimation strategies for statisticians. This book will help researchers and practitioners for their teaching and advanced research, and is an excellent textbook for advanced undergraduate and graduate courses involving shrinkage, statistical, and machine learning. The book succinctly reveals the bias inherited in machine learning method and successfully provides tools, tricks and tips to deal with the bias issue. Expertly sheds light on the fundamental reasoning for model selection and post estimation using shrinkage and related strategies. This presentation is fundamental, because shrinkage and other methods appropriate for model selection and estimation problems and there is a growing interest in this area to fill the gap between competitive strategies. Application of these strategies to real life data set from many walks of life. Analytical results are fully corroborated by numerical work and numerous worked examples are included in each chapter with numerous graphs for data visualization. The presentation and style of the book clearly makes it accessible to a broad audience. It offers rich, concise expositions of each strategy and clearly describes how to use each estimation strategy for the problem at hand. This book emphasizes that statistics/statisticians can play a dominant role in solving Big Data problems, and will put them on the precipice of scientific discovery. The book contributes novel methodologies for HDDA and will open a door for continued research in this hot area. The practical impact of the proposed work stems from wide applications. The developed computational packages will aid in analyzing a broad range of applications in many walks of life.
Download or read book Rank Based Methods for Shrinkage and Selection written by A. K. Md. Ehsanes Saleh and published by John Wiley & Sons. This book was released on 2022-04-12 with total page 484 pages. Available in PDF, EPUB and Kindle. Book excerpt: Rank-Based Methods for Shrinkage and Selection A practical and hands-on guide to the theory and methodology of statistical estimation based on rank Robust statistics is an important field in contemporary mathematics and applied statistical methods. Rank-Based Methods for Shrinkage and Selection: With Application to Machine Learning describes techniques to produce higher quality data analysis in shrinkage and subset selection to obtain parsimonious models with outlier-free prediction. This book is intended for statisticians, economists, biostatisticians, data scientists and graduate students. Rank-Based Methods for Shrinkage and Selection elaborates on rank-based theory and application in machine learning to robustify the least squares methodology. It also includes: Development of rank theory and application of shrinkage and selection Methodology for robust data science using penalized rank estimators Theory and methods of penalized rank dispersion for ridge, LASSO and Enet Topics include Liu regression, high-dimension, and AR(p) Novel rank-based logistic regression and neural networks Problem sets include R code to demonstrate its use in machine learning
Download or read book Improving Efficiency by Shrinkage written by Marvin Gruber and published by Routledge. This book was released on 2017-11-01 with total page 648 pages. Available in PDF, EPUB and Kindle. Book excerpt: Offers a treatment of different kinds of James-Stein and ridge regression estimators from a frequentist and Bayesian point of view. The book explains and compares estimators analytically as well as numerically and includes Mathematica and Maple programs used in numerical comparison.;College or university bookshops may order five or more copies at a special student rate, available on request.
Download or read book Shrinkage Estimation of a Linear Regression written by Kazuhiro Ohtani and published by . This book was released on 2000 with total page 182 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book deals with shrinkage regression estimators obtained by shrinking the ordinary least squares (OLS) estimator towards the origin. The author's main concern is to compare the sampling properties of a family of Stein-rule estimators with those of a family of minimum mean squared error estimators. In this book, the author deals with shrinkage regression estimators obtained by shrinking the ordinary least squares (OLS) estimator towards the origin. In particular, he deals with a family of Stein-rule (SR) estimators and a family of minimum mean squared error (MMSE) estimators.
Download or read book High Dimensional Covariance Matrix Estimation Shrinkage Toward a Diagonal Target written by Mr. Sakai Ando and published by International Monetary Fund. This book was released on 2023-12-08 with total page 32 pages. Available in PDF, EPUB and Kindle. Book excerpt: This paper proposes a novel shrinkage estimator for high-dimensional covariance matrices by extending the Oracle Approximating Shrinkage (OAS) of Chen et al. (2009) to target the diagonal elements of the sample covariance matrix. We derive the closed-form solution of the shrinkage parameter and show by simulation that, when the diagonal elements of the true covariance matrix exhibit substantial variation, our method reduces the Mean Squared Error, compared with the OAS that targets an average variance. The improvement is larger when the true covariance matrix is sparser. Our method also reduces the Mean Squared Error for the inverse of the covariance matrix.
Download or read book Shrinkage Estimation in Nonparametric Bayesian Survival Analysis written by Kamta Rai and published by . This book was released on 1979 with total page 40 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Generalized Linear Models with Random Effects written by Youngjo Lee and published by CRC Press. This book was released on 2006-07-13 with total page 411 pages. Available in PDF, EPUB and Kindle. Book excerpt: Since their introduction in 1972, generalized linear models (GLMs) have proven useful in the generalization of classical normal models. Presenting methods for fitting GLMs with random effects to data, Generalized Linear Models with Random Effects: Unified Analysis via H-likelihood explores a wide range of applications, including combining information over trials (meta-analysis), analysis of frailty models for survival data, genetic epidemiology, and analysis of spatial and temporal models with correlated errors. Written by pioneering authorities in the field, this reference provides an introduction to various theories and examines likelihood inference and GLMs. The authors show how to extend the class of GLMs while retaining as much simplicity as possible. By maximizing and deriving other quantities from h-likelihood, they also demonstrate how to use a single algorithm for all members of the class, resulting in a faster algorithm as compared to existing alternatives. Complementing theory with examples, many of which can be run by using the code supplied on the accompanying CD, this book is beneficial to statisticians and researchers involved in the above applications as well as quality-improvement experiments and missing-data analysis.
Download or read book Analytic Methods in Systems and Software Testing written by Ron S. Kenett and published by John Wiley & Sons. This book was released on 2018-06-20 with total page 568 pages. Available in PDF, EPUB and Kindle. Book excerpt: A comprehensive treatment of systems and software testing using state of the art methods and tools This book provides valuable insights into state of the art software testing methods and explains, with examples, the statistical and analytic methods used in this field. Numerous examples are used to provide understanding in applying these methods to real-world problems. Leading authorities in applied statistics, computer science, and software engineering present state-of-the-art methods addressing challenges faced by practitioners and researchers involved in system and software testing. Methods include: machine learning, Bayesian methods, graphical models, experimental design, generalized regression, and reliability modeling. Analytic Methods in Systems and Software Testing presents its comprehensive collection of methods in four parts: Part I: Testing Concepts and Methods; Part II: Statistical Models; Part III: Testing Infrastructures; and Part IV: Testing Applications. It seeks to maintain a focus on analytic methods, while at the same time offering a contextual landscape of modern engineering, in order to introduce related statistical and probabilistic models used in this domain. This makes the book an incredibly useful tool, offering interesting insights on challenges in the field for researchers and practitioners alike. Compiles cutting-edge methods and examples of analytical approaches to systems and software testing from leading authorities in applied statistics, computer science, and software engineering Combines methods and examples focused on the analytic aspects of systems and software testing Covers logistic regression, machine learning, Bayesian methods, graphical models, experimental design, generalized regression, and reliability models Written by leading researchers and practitioners in the field, from diverse backgrounds including research, business, government, and consulting Stimulates research at the theoretical and practical level Analytic Methods in Systems and Software Testing is an excellent advanced reference directed toward industrial and academic readers whose work in systems and software development approaches or surpasses existing frontiers of testing and validation procedures. It will also be valuable to post-graduate students in computer science and mathematics.
Download or read book Theory of Ridge Regression Estimation with Applications written by A. K. Md. Ehsanes Saleh and published by John Wiley & Sons. This book was released on 2019-01-08 with total page 380 pages. Available in PDF, EPUB and Kindle. Book excerpt: A guide to the systematic analytical results for ridge, LASSO, preliminary test, and Stein-type estimators with applications Theory of Ridge Regression Estimation with Applications offers a comprehensive guide to the theory and methods of estimation. Ridge regression and LASSO are at the center of all penalty estimators in a range of standard models that are used in many applied statistical analyses. Written by noted experts in the field, the book contains a thorough introduction to penalty and shrinkage estimation and explores the role that ridge, LASSO, and logistic regression play in the computer intensive area of neural network and big data analysis. Designed to be accessible, the book presents detailed coverage of the basic terminology related to various models such as the location and simple linear models, normal and rank theory-based ridge, LASSO, preliminary test and Stein-type estimators. The authors also include problem sets to enhance learning. This book is a volume in the Wiley Series in Probability and Statistics series that provides essential and invaluable reading for all statisticians. This important resource: Offers theoretical coverage and computer-intensive applications of the procedures presented Contains solutions and alternate methods for prediction accuracy and selecting model procedures Presents the first book to focus on ridge regression and unifies past research with current methodology Uses R throughout the text and includes a companion website containing convenient data sets Written for graduate students, practitioners, and researchers in various fields of science, Theory of Ridge Regression Estimation with Applications is an authoritative guide to the theory and methodology of statistical estimation.
Download or read book Sequential Shrinkage Estimation written by David MacLeod Nickerson and published by . This book was released on 1985 with total page 304 pages. Available in PDF, EPUB and Kindle. Book excerpt: This dissertation is concerned with sequential estimation of the multivariate normal mean, estimation of the regression coefficient in a normal linear regression model, and estimation of the difference of mean vectors of two multivariate normal distributions in the presence of unknown and possibly unequal variance-covariance matrices. For estimating the p(>3) variate normal mean, we consider two different situations. In one case, the covariance matrix is known up to a multiplicative constant; in the other situation, it is entirely unknown but diagonal. In both cases, the sample mean is the maximum likelihood estimator of the population mean. When the covariance matrix is known up to a multiplicative constant, a class of James- Stein estimators is developed which dominates the sample mean under sequential sampling schemes of M. Ghosh, B.K. Sinha, and N. Mukhopadhyay (1976 Journal of Multivariate Statistics 6j, 281-294). Asymptotic risk expansions of the sample mean vector and James-Stein estimators are provided up to the second order term. Additionally, in this case, some Monte Carlo simulation is done to compare the risks of the sample mean vector, the James-Stein estimators, and a rival class of estimators. In the second case, a class of James-Stein estimators is given which dominates the sample mean asymptotically by considering second order risk expansions. The next case is concerned with estimation of regression parameters in a Gauss-Markoff setup. Here the classical estimator of the regression coefficient is the least squares estimator, and the sampling scheme used is that of N. Mukhopadhyay (1974 Journal of the Indian Statistical Association 12, 39-43). Once again, a class of James-Stein estimators that dominates the least squares estimator is developed, and asymptotic risk expansion is given for both the least squares and James-Stein estimators. Finally, we consider the estimation of the difference of two normal mean vectors, and the sampling schemes developed in 1984 at the Institute of Applied Mathematics National Tsing Hua University by R. Chou and W. Hwang. A class of James-Stein estimators that dominates the difference of sample mean vectors is given. Asymptotic risk expansions are also provided.
Download or read book Shrinkage for Stabilizing the Detection of Changepoints in Covariances for High Dimensional Data written by Mounir Zahnouni and published by GRIN Verlag. This book was released on 2024-04-11 with total page 75 pages. Available in PDF, EPUB and Kindle. Book excerpt: Diploma Thesis from the year 2012 in the subject Mathematics, grade: 1,0, University of Kaiserslautern (Fakultät für Mathematik), language: English, abstract: In mathematical statistics, detecting changes in parameters of real-life data series, known as change-point problems, is crucial. Originating in quality control during the 1950s, these problems have widespread applications today, spanning fields like economics, finance, medicine, and geology. In finance, fluctuations in asset returns can violate assumptions of constant variance, leading to inaccurate forecasts. Chapter 2 briefly discusses the univariate case, focusing on detecting changes in mean and variance parameters over time. The Cumulative Sums (CUSUM) test statistics, derived from likelihood ratios, serve as change-point estimators. However, their asymptotic distribution complexity and slow convergence limit applicability to small sample sizes. Nevertheless, asymptotic quantiles help determine if changes have occurred. Chapter 3 extends this analysis to the multivariate case, specifically addressing changes in covariance matrices. Estimating the covariance matrix, particularly in scenarios with many variables and few observations, poses challenges. Shrinkage estimators, like the Ledoit-Wolf (LW) estimator, offer improvements over sample covariance matrices, especially in small sample sizes. The Rao-Blackwell theorem leads to the development of the Rao-Blackwellized Ledoit-Wolf (RBLW) estimator, enhancing performance under Gaussian assumptions. A simulation study in Chapter 5 demonstrates the effectiveness of using these shrinkage estimators in detecting change-points, resulting in improved test power and accuracy. However, due to the absence of an asymptotic distribution for the test statistics, quantiles must be obtained through simulation.
Download or read book Theory of Point Estimation written by Erich L. Lehmann and published by Springer Science & Business Media. This book was released on 2006-05-02 with total page 610 pages. Available in PDF, EPUB and Kindle. Book excerpt: This second, much enlarged edition by Lehmann and Casella of Lehmann's classic text on point estimation maintains the outlook and general style of the first edition. All of the topics are updated, while an entirely new chapter on Bayesian and hierarchical Bayesian approaches is provided, and there is much new material on simultaneous estimation. Each chapter concludes with a Notes section which contains suggestions for further study. This is a companion volume to the second edition of Lehmann's "Testing Statistical Hypotheses".
Download or read book Encyclopedia of Financial Models written by Frank J. Fabozzi and published by John Wiley & Sons. This book was released on 2012-09-12 with total page 832 pages. Available in PDF, EPUB and Kindle. Book excerpt: Volume 2 of the Encyclopedia of Financial Models The need for serious coverage of financial modeling has never been greater, especially with the size, diversity, and efficiency of modern capital markets. With this in mind, the Encyclopedia of Financial Models has been created to help a broad spectrum of individuals—ranging from finance professionals to academics and students—understand financial modeling and make use of the various models currently available. Incorporating timely research and in-depth analysis, Volume 2 of the Encyclopedia of Financial Models covers both established and cutting-edge models and discusses their real-world applications. Edited by Frank Fabozzi, this volume includes contributions from global financial experts as well as academics with extensive consulting experience in this field. Organized alphabetically by category, this reliable resource consists of forty-four informative entries and provides readers with a balanced understanding of today's dynamic world of financial modeling. Volume 2 explores Equity Models and Valuation, Factor Models for Portfolio Construction, Financial Econometrics, Financial Modeling Principles, Financial Statements Analysis, Finite Mathematics for Financial Modeling, and Model Risk and Selection Emphasizes both technical and implementation issues, providing researchers, educators, students, and practitioners with the necessary background to deal with issues related to financial modeling The 3-Volume Set contains coverage of the fundamentals and advances in financial modeling and provides the mathematical and statistical techniques needed to develop and test financial models Financial models have become increasingly commonplace, as well as complex. They are essential in a wide range of financial endeavors, and the Encyclopedia of Financial Models will help put them in perspective.
Download or read book Nonparametric Function Estimation Modeling and Simulation written by James R. Thompson and published by SIAM. This book was released on 1990-01-01 with total page 317 pages. Available in PDF, EPUB and Kindle. Book excerpt: Topics emphasized in this book include nonparametric density estimation, multi-dimensional data analysis, cancer progression, chaos theory, and parallel based algorithms.
