Download or read book Estimating Loss Function Parameters written by Graham Elliott and published by . This book was released on 2003 with total page 68 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Investigation of Techniques to Estimate Rainfall loss Parameters for Illinois written by Linda S. Weiss and published by . This book was released on 1987 with total page 278 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Robustness of Consistent Loss Functions for Multinomial Outcome Models written by Suchan Vivatsethachai and published by . This book was released on 2021 with total page 98 pages. Available in PDF, EPUB and Kindle. Book excerpt: Maximum likelihood estimation, which uses the logarithmic loss function, is the default method used to estimate latent parameters consistently in multinomial outcome models. However, it is sensitive to even a tiny fraction of corruption in the training data. Alternatively, other loss functions in the family of strictly consistent loss functions can be used to consistently estimate model parameters. In this thesis, we study the robustness properties of different loss functions in the family, mainly the logarithmic loss function, the quadratic loss function, and the spherical loss function. We introduce two notions of robustness properties of loss functions. A loss function is partially robust if its corresponding influence function, a proxy for the bias from corruption, has bounded 2-norm. On the other hand, a loss function is strongly robust if the 2-norm of the bias itself is bounded. When some mild assumptions are met, the quadratic loss function can be shown to be both partially robust and strongly robust, while the logarithmic loss function is not. We also demonstrate that the behaviors of each loss function agree with their theoretical properties when used to estimate parameter in two synthetic models: a price-purchase model and a multinomial logit with intercepts model for two products. This thesis thus not only advocates more use of the quadratic loss function in parameter estimation of multinomial outcome models but also serves as a framework to conduct future research of the cross section between the robustness of loss functions and the consistency of parameter estimation.
Download or read book Shrinkage Estimation written by Dominique Fourdrinier and published by Springer. This book was released on 2018-11-27 with total page 339 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book provides a coherent framework for understanding shrinkage estimation in statistics. The term refers to modifying a classical estimator by moving it closer to a target which could be known a priori or arise from a model. The goal is to construct estimators with improved statistical properties. The book focuses primarily on point and loss estimation of the mean vector of multivariate normal and spherically symmetric distributions. Chapter 1 reviews the statistical and decision theoretic terminology and results that will be used throughout the book. Chapter 2 is concerned with estimating the mean vector of a multivariate normal distribution under quadratic loss from a frequentist perspective. In Chapter 3 the authors take a Bayesian view of shrinkage estimation in the normal setting. Chapter 4 introduces the general classes of spherically and elliptically symmetric distributions. Point and loss estimation for these broad classes are studied in subsequent chapters. In particular, Chapter 5 extends many of the results from Chapters 2 and 3 to spherically and elliptically symmetric distributions. Chapter 6 considers the general linear model with spherically symmetric error distributions when a residual vector is available. Chapter 7 then considers the problem of estimating a location vector which is constrained to lie in a convex set. Much of the chapter is devoted to one of two types of constraint sets, balls and polyhedral cones. In Chapter 8 the authors focus on loss estimation and data-dependent evidence reports. Appendices cover a number of technical topics including weakly differentiable functions; examples where Stein’s identity doesn’t hold; Stein’s lemma and Stokes’ theorem for smooth boundaries; harmonic, superharmonic and subharmonic functions; and modified Bessel functions.
Download or read book Hierarchical Modeling and Analysis for Spatial Data written by Sudipto Banerjee and published by CRC Press. This book was released on 2003-12-17 with total page 470 pages. Available in PDF, EPUB and Kindle. Book excerpt: Among the many uses of hierarchical modeling, their application to the statistical analysis of spatial and spatio-temporal data from areas such as epidemiology And environmental science has proven particularly fruitful. Yet to date, the few books that address the subject have been either too narrowly focused on specific aspects of spatial analysis,
Download or read book Bayesian Methods for Hackers written by Cameron Davidson-Pilon and published by Addison-Wesley Professional. This book was released on 2015-09-30 with total page 551 pages. Available in PDF, EPUB and Kindle. Book excerpt: Master Bayesian Inference through Practical Examples and Computation–Without Advanced Mathematical Analysis Bayesian methods of inference are deeply natural and extremely powerful. However, most discussions of Bayesian inference rely on intensely complex mathematical analyses and artificial examples, making it inaccessible to anyone without a strong mathematical background. Now, though, Cameron Davidson-Pilon introduces Bayesian inference from a computational perspective, bridging theory to practice–freeing you to get results using computing power. Bayesian Methods for Hackers illuminates Bayesian inference through probabilistic programming with the powerful PyMC language and the closely related Python tools NumPy, SciPy, and Matplotlib. Using this approach, you can reach effective solutions in small increments, without extensive mathematical intervention. Davidson-Pilon begins by introducing the concepts underlying Bayesian inference, comparing it with other techniques and guiding you through building and training your first Bayesian model. Next, he introduces PyMC through a series of detailed examples and intuitive explanations that have been refined after extensive user feedback. You’ll learn how to use the Markov Chain Monte Carlo algorithm, choose appropriate sample sizes and priors, work with loss functions, and apply Bayesian inference in domains ranging from finance to marketing. Once you’ve mastered these techniques, you’ll constantly turn to this guide for the working PyMC code you need to jumpstart future projects. Coverage includes • Learning the Bayesian “state of mind” and its practical implications • Understanding how computers perform Bayesian inference • Using the PyMC Python library to program Bayesian analyses • Building and debugging models with PyMC • Testing your model’s “goodness of fit” • Opening the “black box” of the Markov Chain Monte Carlo algorithm to see how and why it works • Leveraging the power of the “Law of Large Numbers” • Mastering key concepts, such as clustering, convergence, autocorrelation, and thinning • Using loss functions to measure an estimate’s weaknesses based on your goals and desired outcomes • Selecting appropriate priors and understanding how their influence changes with dataset size • Overcoming the “exploration versus exploitation” dilemma: deciding when “pretty good” is good enough • Using Bayesian inference to improve A/B testing • Solving data science problems when only small amounts of data are available Cameron Davidson-Pilon has worked in many areas of applied mathematics, from the evolutionary dynamics of genes and diseases to stochastic modeling of financial prices. His contributions to the open source community include lifelines, an implementation of survival analysis in Python. Educated at the University of Waterloo and at the Independent University of Moscow, he currently works with the online commerce leader Shopify.
Download or read book Principles of Signal Detection and Parameter Estimation written by Bernard C. Levy and published by Springer Science & Business Media. This book was released on 2008-07-07 with total page 647 pages. Available in PDF, EPUB and Kindle. Book excerpt: This textbook provides a comprehensive and current understanding of signal detection and estimation, including problems and solutions for each chapter. Signal detection plays an important role in fields such as radar, sonar, digital communications, image processing, and failure detection. The book explores both Gaussian detection and detection of Markov chains, presenting a unified treatment of coding and modulation topics. Addresses asymptotic of tests with the theory of large deviations, and robust detection. This text is appropriate for students of Electrical Engineering in graduate courses in Signal Detection and Estimation.
Download or read book Optimal Two Stage Procedures for Estimating Functions of Parameters in Reliability and Queueing Models written by Kevin Edward Burns and published by . This book was released on 1998 with total page 156 pages. Available in PDF, EPUB and Kindle. Book excerpt: In this dissertation, we consider the problem of estimating functions of parameters found in reliability and queueing models. The problem is to allocate a fixed sampling budget among the populations with the goal of minimizing the mean squared error (MSF) of the estimator. We consider the reliability model with three components such that the probability the system works is f(u1,u2,u3) = u1(u2+u3), and the mean waiting time of the M/G/I queue. For each of these models, we consider a set of sample sizes referred to as a first-allocation procedure which minimizes the first-order approximation to the MSE. Since the first-order allocation procedure depends on the unknown parameters in the model, we propose a two-stage procedure in which we first use a fraction of the sampling budget to estimate the unknown parameters and then allocate the remaining budget based on the initial sample. We show that the difference between the MSE for the two-stage procedure and the minimum MSE obtained using the optimal set of sample sizes from the first-allocation procedure goes to zero as the budget goes to infinity. Simulations are used to demonstrate the asymptotic optimality results for the two stage procedures. The empirical studies show that the two stage estimation procedures work well for reasonable sample sizes.
Download or read book Breakthroughs in Statistics written by Samuel Kotz and published by Springer Science & Business Media. This book was released on 2013-12-01 with total page 576 pages. Available in PDF, EPUB and Kindle. Book excerpt: Volume III includes more selections of articles that have initiated fundamental changes in statistical methodology. It contains articles published before 1980 that were overlooked in the previous two volumes plus articles from the 1980's - all of them chosen after consulting many of today's leading statisticians.
Download or read book Better Deep Learning written by Jason Brownlee and published by Machine Learning Mastery. This book was released on 2018-12-13 with total page 575 pages. Available in PDF, EPUB and Kindle. Book excerpt: Deep learning neural networks have become easy to define and fit, but are still hard to configure. Discover exactly how to improve the performance of deep learning neural network models on your predictive modeling projects. With clear explanations, standard Python libraries, and step-by-step tutorial lessons, you’ll discover how to better train your models, reduce overfitting, and make more accurate predictions.
Download or read book Statistical Decision Theory and Related Topics III written by Shanti S. Gupta and published by Academic Press. This book was released on 2014-05-10 with total page 551 pages. Available in PDF, EPUB and Kindle. Book excerpt: Statistical Decision Theory and Related Topics III, Volume 2 is a collection of papers presented at the Third Purdue Symposium on Statistical Decision Theory and Related Topics, held at Purdue University in June 1981. The symposium brought together many prominent leaders and a number of younger researchers in statistical decision theory and related areas. This volume contains the research papers presented at the symposium and includes works on general decision theory, multiple decision theory, optimum experimental design, sequential and adaptive inference, Bayesian analysis, robustness, and large sample theory. These research areas have seen rapid developments since the preceding Purdue Symposium in 1976, developments reflected by the variety and depth of the works in this volume. Statisticians and mathematicians will find the book very insightful.
Download or read book System Parameter Identification written by Badong Chen and published by Newnes. This book was released on 2013-07-17 with total page 266 pages. Available in PDF, EPUB and Kindle. Book excerpt: Recently, criterion functions based on information theoretic measures (entropy, mutual information, information divergence) have attracted attention and become an emerging area of study in signal processing and system identification domain. This book presents a systematic framework for system identification and information processing, investigating system identification from an information theory point of view. The book is divided into six chapters, which cover the information needed to understand the theory and application of system parameter identification. The authors’ research provides a base for the book, but it incorporates the results from the latest international research publications. Named a 2013 Notable Computer Book for Information Systems by Computing Reviews One of the first books to present system parameter identification with information theoretic criteria so readers can track the latest developments Contains numerous illustrative examples to help the reader grasp basic methods
Download or read book Parameter Estimation in Engineering and Science written by James Vere Beck and published by James Beck. This book was released on 1977 with total page 540 pages. Available in PDF, EPUB and Kindle. Book excerpt: Introduction to and survey of parameter estimation; Probability; Introduction to statistics; Parameter estimation methods; Introduction to linear estimation; Matrix analysis for linear parameter estimation; Minimization of sum of squares functions for models nonlinear in parameters; Design of optimal experiments.
Download or read book On Mimimax Parameter Estimation with Loss Functions that Exhibit a Product Structure written by David John Stelte and published by . This book was released on 1973 with total page 110 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Ensemble Machine Learning written by Cha Zhang and published by Springer Science & Business Media. This book was released on 2012-02-17 with total page 332 pages. Available in PDF, EPUB and Kindle. Book excerpt: It is common wisdom that gathering a variety of views and inputs improves the process of decision making, and, indeed, underpins a democratic society. Dubbed “ensemble learning” by researchers in computational intelligence and machine learning, it is known to improve a decision system’s robustness and accuracy. Now, fresh developments are allowing researchers to unleash the power of ensemble learning in an increasing range of real-world applications. Ensemble learning algorithms such as “boosting” and “random forest” facilitate solutions to key computational issues such as face recognition and are now being applied in areas as diverse as object tracking and bioinformatics. Responding to a shortage of literature dedicated to the topic, this volume offers comprehensive coverage of state-of-the-art ensemble learning techniques, including the random forest skeleton tracking algorithm in the Xbox Kinect sensor, which bypasses the need for game controllers. At once a solid theoretical study and a practical guide, the volume is a windfall for researchers and practitioners alike.
Download or read book Breakthroughs in Statistics written by Samuel Kotz and published by Springer Science & Business Media. This book was released on 2012-12-06 with total page 665 pages. Available in PDF, EPUB and Kindle. Book excerpt: This is a two volume collection of seminal papers in the statistical sciences written during the past 100 years. These papers have each had an outstanding influence on the development of statistical theory and practice over the last century. Each paper is preceded by an introduction written by an authority in the field providing background information and assessing its influence. Readers will enjoy a fresh outlook on now well-established features of statistical techniques and philosophy by becoming acquainted with the ways they have been developed. It is hoped that some readers will be stimulated to study some of the references provided in the Introductions (and also in the papers themselves) and so attain a deeper background knowledge of the basis of their work.
Download or read book Financial Risk Management with Bayesian Estimation of GARCH Models written by David Ardia and published by Springer Science & Business Media. This book was released on 2008-05-08 with total page 206 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book presents in detail methodologies for the Bayesian estimation of sing- regime and regime-switching GARCH models. These models are widespread and essential tools in n ancial econometrics and have, until recently, mainly been estimated using the classical Maximum Likelihood technique. As this study aims to demonstrate, the Bayesian approach o ers an attractive alternative which enables small sample results, robust estimation, model discrimination and probabilistic statements on nonlinear functions of the model parameters. The author is indebted to numerous individuals for help in the preparation of this study. Primarily, I owe a great debt to Prof. Dr. Philippe J. Deschamps who inspired me to study Bayesian econometrics, suggested the subject, guided me under his supervision and encouraged my research. I would also like to thank Prof. Dr. Martin Wallmeier and my colleagues of the Department of Quantitative Economics, in particular Michael Beer, Roberto Cerratti and Gilles Kaltenrieder, for their useful comments and discussions. I am very indebted to my friends Carlos Ord as Criado, Julien A. Straubhaar, J er ^ ome Ph. A. Taillard and Mathieu Vuilleumier, for their support in the elds of economics, mathematics and statistics. Thanks also to my friend Kevin Barnes who helped with my English in this work. Finally, I am greatly indebted to my parents and grandparents for their support and encouragement while I was struggling with the writing of this thesis.
