Download or read book Variable Selection and Parameter Estimation for Normal Linear Models written by Peter James Kempthorne and published by . This book was released on 1983 with total page 332 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Variable selection and parameter estimation for normal linear regression models written by Peter J. Kempthorne and published by . This book was released on 1985 with total page 159 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Variable Selection and Parameter Estimation for Normal Linear Regression Models written by Peter James Kempthorne and published by . This book was released on 1986 with total page 159 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Variable Selection by Regularization Methods for Generalized Mixed Models written by Andreas Groll and published by Cuvillier Verlag. This book was released on 2011-12-13 with total page 175 pages. Available in PDF, EPUB and Kindle. Book excerpt: A regression analysis describes the dependency of random variables in the form of a functional relationship. One distinguishes between the dependent response variable and one or more independent influence variables. There is a variety of model classes and inference methods available, ranging from the conventional linear regression model up to recent non- and semiparametric regression models. The so-called generalized regression models form a methodically consistent framework incorporating many regression approaches with response variables that are not necessarily normally distributed, including the conventional linear regression model based on the normal distribution assumption as a special case. When repeated measurements are modeled in addition to fixed effects also random effects or coefficients can be included. Such models are known as Random Effects Models or Mixed Models. As a consequence, regression procedures are applicable extremely versatile and consider very different problems. In this dissertation regularization techniques for generalized mixed models are developed that are able to perform variable selection. These techniques are especially appropriate when many potential influence variables are present and existing approaches tend to fail. First of all a componentwise boosting technique for generalized linear mixed models is presented which is based on the likelihood function and works by iteratively fitting the residuals using weak learners. The complexity of the resulting estimator is determined by information criteria. For the estimation of variance components two approaches are considered, an estimator resulting from maximizing the profile likelihood, and an estimator which can be calculated using an approximative EM-algorithm. Then the boosting concept is extended to mixed models with ordinal response variables. Two different types of ordered models are considered, the threshold model, also known as cumulative model, and the sequential model. Both are based on the assumption that the observed response variable results from a categorized version of a latent metric variable. In the further course of the thesis the boosting approach is extended to additive predictors. The unknown functions to be estimated are expanded in B-spline basis functions, whose smoothness is controlled by penalty terms. Finally, a suitable L1-regularization technique for generalized linear models is presented, which is based on a combination of Fisher scoring and gradient optimization. Extensive simulation studies and numerous applications illustrate the competitiveness of the methods constructed in this thesis compared to conventional approaches. For the calculation of standard errors bootstrap methods are used.

Download or read book Advanced Linear Models written by Shein-Chung Chow and published by Routledge. This book was released on 2018-05-04 with total page 552 pages. Available in PDF, EPUB and Kindle. Book excerpt: This work details the statistical inference of linear models including parameter estimation, hypothesis testing, confidence intervals, and prediction. The authors discuss the application of statistical theories and methodologies to various linear models such as the linear regression model, the analysis of variance model, the analysis of covariance model, and the variance components model.

Download or read book Parameter Estimation and Hypothesis Testing in Linear Models written by Karl-Rudolf Koch and published by Springer Science & Business Media. This book was released on 2013-03-09 with total page 344 pages. Available in PDF, EPUB and Kindle. Book excerpt: A treatment of estimating unknown parameters, testing hypotheses and estimating confidence intervals in linear models. Readers will find here presentations of the Gauss-Markoff model, the analysis of variance, the multivariate model, the model with unknown variance and covariance components and the regression model as well as the mixed model for estimating random parameters. A chapter on the robust estimation of parameters and several examples have been added to this second edition. The necessary theorems of vector and matrix algebra and the probability distributions of test statistics are derived so as to make this book self-contained. Geodesy students as well as those in the natural sciences and engineering will find the emphasis on the geodetic application of statistical models extremely useful.

Download or read book Theory of Linear Models written by Bent Jorgensen and published by Routledge. This book was released on 2019-01-14 with total page 241 pages. Available in PDF, EPUB and Kindle. Book excerpt: Providing a self-contained exposition of the theory of linear models, this treatise strikes a compromise between theory and practice, providing a sound theoretical basis while putting the theory to work in important cases.

Download or read book Introduction to Linear Regression Analysis written by Douglas C. Montgomery and published by Wiley-Interscience. This book was released on 2001-04-16 with total page 680 pages. Available in PDF, EPUB and Kindle. Book excerpt: A comprehensive and thoroughly up-to-date look at regression analysis-still the most widely used technique in statistics today As basic to statistics as the Pythagorean theorem is to geometry, regression analysis is a statistical technique for investigating and modeling the relationship between variables. With far-reaching applications in almost every field, regression analysis is used in engineering, the physical and chemical sciences, economics, management, life and biological sciences, and the social sciences. Clearly balancing theory with applications, Introduction to Linear Regression Analysis describes conventional uses of the technique, as well as less common ones, placing linear regression in the practical context of today's mathematical and scientific research. Beginning with a general introduction to regression modeling, including typical applications, the book then outlines a host of technical tools that form the linear regression analytical arsenal, including: basic inference procedures and introductory aspects of model adequacy checking; how transformations and weighted least squares can be used to resolve problems of model inadequacy; how to deal with influential observations; and polynomial regression models and their variations. Succeeding chapters include detailed coverage of: ? Indicator variables, making the connection between regression and analysis-of-variance modelss ? Variable selection and model-building techniques ? The multicollinearity problem, including its sources, harmful effects, diagnostics, and remedial measures ? Robust regression techniques, including M-estimators, Least Median of Squares, and S-estimation ? Generalized linear models The book also includes material on regression models with autocorrelated errors, bootstrapping regression estimates, classification and regression trees, and regression model validation. Topics not usually found in a linear regression textbook, such as nonlinear regression and generalized linear models, yet critical to engineering students and professionals, have also been included. The new critical role of the computer in regression analysis is reflected in the book's expanded discussion of regression diagnostics, where major analytical procedures now available in contemporary software packages, such as SAS, Minitab, and S-Plus, are detailed. The Appendix now includes ample background material on the theory of linear models underlying regression analysis. Data sets from the book, extensive problem solutions, and software hints are available on the ftp site. For other Wiley books by Doug Montgomery, visit our website at www.wiley.com/college/montgomery.

Download or read book Multivariate General Linear Models written by Richard F. Haase and published by SAGE. This book was released on 2011-11-23 with total page 225 pages. Available in PDF, EPUB and Kindle. Book excerpt: This title provides an integrated introduction to multivariate multiple regression analysis (MMR) and multivariate analysis of variance (MANOVA). It defines the key steps in analyzing linear model data and introduces multivariate linear model analysis as a generalization of the univariate model. Richard F. Haase focuses on multivariate measures of association for four common multivariate test statistics, presents a flexible method for testing hypotheses on models, and emphasizes the multivariate procedures attributable to Wilks, Pillai, Hotelling, and Roy.

Download or read book Generalized Linear Models for Bounded and Limited Quantitative Variables written by Michael Smithson and published by SAGE Publications. This book was released on 2019-09-09 with total page 136 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book introduces researchers and students to the concepts and generalized linear models for analyzing quantitative random variables that have one or more bounds. Examples of bounded variables include the percentage of a population eligible to vote (bounded from 0 to 100), or reaction time in milliseconds (bounded below by 0). The human sciences deal in many variables that are bounded. Ignoring bounds can result in misestimation and improper statistical inference. Michael Smithson and Yiyun Shou's book brings together material on the analysis of limited and bounded variables that is scattered across the literature in several disciplines, and presents it in a style that is both more accessible and up-to-date. The authors provide worked examples in each chapter using real datasets from a variety of disciplines. The software used for the examples include R, SAS, and Stata. The data, software code, and detailed explanations of the example models are available on an accompanying website.

Download or read book Essays on Robust Model Selection and Model Averaging for Linear Models written by Le Chang and published by . This book was released on 2017 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: Model selection is central to all applied statistical work. Selecting the variables for use in a regression model is one important example of model selection. This thesis is a collection of essays on robust model selection procedures and model averaging for linear regression models. In the first essay, we propose robust Akaike information criteria (AIC) for MM-estimation and an adjusted robust scale based AIC for M and MM-estimation. Our proposed model selection criteria can maintain their robust properties in the presence of a high proportion of outliers and the outliers in the covariates. We compare our proposed criteria with other robust model selection criteria discussed in previous literature. Our simulation studies demonstrate a significant outperformance of robust AIC based on MM-estimation in the presence of outliers in the covariates. The real data example also shows a better performance of robust AIC based on MM-estimation. The second essay focuses on robust versions of the "Least Absolute Shrinkage and Selection Operator" (lasso). The adaptive lasso is a method for performing simultaneous parameter estimation and variable selection. The adaptive weights used in its penalty term mean that the adaptive lasso achieves the oracle property. In this essay, we propose an extension of the adaptive lasso named the Tukey-lasso. By using Tukey's biweight criterion, instead of squared loss, the Tukey-lasso is resistant to outliers in both the response and covariates. Importantly, we demonstrate that the Tukey-lasso also enjoys the oracle property. A fast accelerated proximal gradient (APG) algorithm is proposed and implemented for computing the Tukey-lasso. Our extensive simulations show that the Tukey-lasso, implemented with the APG algorithm, achieves very reliable results, including for high-dimensional data where p>n. In the presence of outliers, the Tukey-lasso is shown to offer substantial improvements in performance compared to the adaptive lasso and other robust implementations of the lasso. Real data examples further demonstrate the utility of the Tukey-lasso. In many statistical analyses, a single model is used for statistical inference, ignoring the process that leads to the model being selected. To account for this model uncertainty, many model averaging procedures have been proposed. In the last essay, we propose an extension of a bootstrap model averaging approach, called bootstrap lasso averaging (BLA). BLA utilizes the lasso for model selection. This is in contrast to other forms of bootstrap model averaging that use AIC or Bayesian information criteria (BIC). The use of the lasso improves the computation speed and allows BLA to be applied even when the number of variables p is larger than the sample size n. Extensive simulations confirm that BLA has outstanding finite sample performance, in terms of both variable and prediction accuracies, compared with traditional model selection and model averaging methods. Several real data examples further demonstrate an improved out-of-sample predictive performance of BLA.

Download or read book Alternative Methods of Variable Selection in Linear Regression Models for Incomplete Multivariate Normal Data written by Xiaowei Yang and published by . This book was released on 2002 with total page 500 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Applying Generalized Linear Models written by James K. Lindsey and published by Springer Science & Business Media. This book was released on 2008-01-15 with total page 265 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book describes how generalised linear modelling procedures can be used in many different fields, without becoming entangled in problems of statistical inference. The author shows the unity of many of the commonly used models and provides readers with a taste of many different areas, such as survival models, time series, and spatial analysis, and of their unity. As such, this book will appeal to applied statisticians and to scientists having a basic grounding in modern statistics. With many exercises at the end of each chapter, it will equally constitute an excellent text for teaching applied statistics students and non- statistics majors. The reader is assumed to have knowledge of basic statistical principles, whether from a Bayesian, frequentist, or direct likelihood point of view, being familiar at least with the analysis of the simpler normal linear models, regression and ANOVA.

Download or read book Generalized Linear Models written by P. McCullagh and published by Routledge. This book was released on 2019-01-22 with total page 361 pages. Available in PDF, EPUB and Kindle. Book excerpt: The success of the first edition of Generalized Linear Models led to the updated Second Edition, which continues to provide a definitive unified, treatment of methods for the analysis of diverse types of data. Today, it remains popular for its clarity, richness of content and direct relevance to agricultural, biological, health, engineering, and ot

Download or read book An Introduction to Generalized Linear Models written by Annette J. Dobson and published by CRC Press. This book was released on 2018-04-17 with total page 354 pages. Available in PDF, EPUB and Kindle. Book excerpt: An Introduction to Generalized Linear Models, Fourth Edition provides a cohesive framework for statistical modelling, with an emphasis on numerical and graphical methods. This new edition of a bestseller has been updated with new sections on non-linear associations, strategies for model selection, and a Postface on good statistical practice. Like its predecessor, this edition presents the theoretical background of generalized linear models (GLMs) before focusing on methods for analyzing particular kinds of data. It covers Normal, Poisson, and Binomial distributions; linear regression models; classical estimation and model fitting methods; and frequentist methods of statistical inference. After forming this foundation, the authors explore multiple linear regression, analysis of variance (ANOVA), logistic regression, log-linear models, survival analysis, multilevel modeling, Bayesian models, and Markov chain Monte Carlo (MCMC) methods. Introduces GLMs in a way that enables readers to understand the unifying structure that underpins them Discusses common concepts and principles of advanced GLMs, including nominal and ordinal regression, survival analysis, non-linear associations and longitudinal analysis Connects Bayesian analysis and MCMC methods to fit GLMs Contains numerous examples from business, medicine, engineering, and the social sciences Provides the example code for R, Stata, and WinBUGS to encourage implementation of the methods Offers the data sets and solutions to the exercises online Describes the components of good statistical practice to improve scientific validity and reproducibility of results. Using popular statistical software programs, this concise and accessible text illustrates practical approaches to estimation, model fitting, and model comparisons.

Download or read book Linear Models in Statistics written by Alvin C. Rencher and published by John Wiley & Sons. This book was released on 2008-01-07 with total page 690 pages. Available in PDF, EPUB and Kindle. Book excerpt: The essential introduction to the theory and application of linear models—now in a valuable new edition Since most advanced statistical tools are generalizations of the linear model, it is neces-sary to first master the linear model in order to move forward to more advanced concepts. The linear model remains the main tool of the applied statistician and is central to the training of any statistician regardless of whether the focus is applied or theoretical. This completely revised and updated new edition successfully develops the basic theory of linear models for regression, analysis of variance, analysis of covariance, and linear mixed models. Recent advances in the methodology related to linear mixed models, generalized linear models, and the Bayesian linear model are also addressed. Linear Models in Statistics, Second Edition includes full coverage of advanced topics, such as mixed and generalized linear models, Bayesian linear models, two-way models with empty cells, geometry of least squares, vector-matrix calculus, simultaneous inference, and logistic and nonlinear regression. Algebraic, geometrical, frequentist, and Bayesian approaches to both the inference of linear models and the analysis of variance are also illustrated. Through the expansion of relevant material and the inclusion of the latest technological developments in the field, this book provides readers with the theoretical foundation to correctly interpret computer software output as well as effectively use, customize, and understand linear models. This modern Second Edition features: New chapters on Bayesian linear models as well as random and mixed linear models Expanded discussion of two-way models with empty cells Additional sections on the geometry of least squares Updated coverage of simultaneous inference The book is complemented with easy-to-read proofs, real data sets, and an extensive bibliography. A thorough review of the requisite matrix algebra has been addedfor transitional purposes, and numerous theoretical and applied problems have been incorporated with selected answers provided at the end of the book. A related Web site includes additional data sets and SAS® code for all numerical examples. Linear Model in Statistics, Second Edition is a must-have book for courses in statistics, biostatistics, and mathematics at the upper-undergraduate and graduate levels. It is also an invaluable reference for researchers who need to gain a better understanding of regression and analysis of variance.

Download or read book Parameter Estimation in Engineering and Science written by James Vere Beck and published by James Beck. This book was released on 1977 with total page 540 pages. Available in PDF, EPUB and Kindle. Book excerpt: Introduction to and survey of parameter estimation; Probability; Introduction to statistics; Parameter estimation methods; Introduction to linear estimation; Matrix analysis for linear parameter estimation; Minimization of sum of squares functions for models nonlinear in parameters; Design of optimal experiments.