Download or read book Asymptotic Properties of Nonlinear Least Squares Estimates in Stochastic Regression Models written by Stanford University. Department of Statistics and published by . This book was released on 1990 with total page 12 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Robust Methods and Asymptotic Theory in Nonlinear Econometrics written by H. J. Bierens and published by Springer Science & Business Media. This book was released on 2012-12-06 with total page 211 pages. Available in PDF, EPUB and Kindle. Book excerpt: This Lecture Note deals with asymptotic properties, i.e. weak and strong consistency and asymptotic normality, of parameter estimators of nonlinear regression models and nonlinear structural equations under various assumptions on the distribution of the data. The estimation methods involved are nonlinear least squares estimation (NLLSE), nonlinear robust M-estimation (NLRME) and non linear weighted robust M-estimation (NLWRME) for the regression case and nonlinear two-stage least squares estimation (NL2SLSE) and a new method called minimum information estimation (MIE) for the case of structural equations. The asymptotic properties of the NLLSE and the two robust M-estimation methods are derived from further elaborations of results of Jennrich. Special attention is payed to the comparison of the asymptotic efficiency of NLLSE and NLRME. It is shown that if the tails of the error distribution are fatter than those of the normal distribution NLRME is more efficient than NLLSE. The NLWRME method is appropriate if the distributions of both the errors and the regressors have fat tails. This study also improves and extends the NL2SLSE theory of Amemiya. The method involved is a variant of the instrumental variables method, requiring at least as many instrumental variables as parameters to be estimated. The new MIE method requires less instrumental variables. Asymptotic normality can be derived by employing only one instrumental variable and consistency can even be proved with out using any instrumental variables at all.

Download or read book Asymptotic Theory of Nonlinear Regression written by A.A. Ivanov and published by Springer Science & Business Media. This book was released on 2013-04-17 with total page 333 pages. Available in PDF, EPUB and Kindle. Book excerpt: Let us assume that an observation Xi is a random variable (r.v.) with values in 1 1 (1R1 , 8 ) and distribution Pi (1R1 is the real line, and 8 is the cr-algebra of its Borel subsets). Let us also assume that the unknown distribution Pi belongs to a 1 certain parametric family {Pi() , () E e}. We call the triple £i = {1R1 , 8 , Pi(), () E e} a statistical experiment generated by the observation Xi. n We shall say that a statistical experiment £n = {lRn, 8 , P; ,() E e} is the product of the statistical experiments £i, i = 1, ... ,n if PO' = P () X ... X P () (IRn 1 n n is the n-dimensional Euclidean space, and 8 is the cr-algebra of its Borel subsets). In this manner the experiment £n is generated by n independent observations X = (X1, ... ,Xn). In this book we study the statistical experiments £n generated by observations of the form j = 1, ... ,n. (0.1) Xj = g(j, (}) + cj, c c In (0.1) g(j, (}) is a non-random function defined on e , where e is the closure in IRq of the open set e ~ IRq, and C j are independent r. v .-s with common distribution function (dJ.) P not depending on ().

Download or read book Stochastic Approximation and Nonlinear Regression written by Arthur E. Albert and published by MIT Press (MA). This book was released on 2003-02-01 with total page 220 pages. Available in PDF, EPUB and Kindle. Book excerpt: This monograph addresses the problem of "real-time" curve fitting in the presence of noise, from the computational and statistical viewpoints. It examines the problem of nonlinear regression, where observations are made on a time series whose mean-value function is known except for a vector parameter. In contrast to the traditional formulation, data are imagined to arrive in temporal succession. The estimation is carried out in real time so that, at each instant, the parameter estimate fully reflects all available data.Specifically, the monograph focuses on estimator sequences of the so-called differential correction type. The term "differential correction" refers to the fact that the difference between the components of the updated and previous estimators is proportional to the difference between the current observation and the value that would be predicted by the regression function if the previous estimate were in fact the true value of the unknown vector parameter. The vector of proportionality factors (which is generally time varying and can depend upon previous estimates) is called the "gain" or "smoothing" vector.The main purpose of this research is to relate the large-sample statistical behavior of such estimates (consistency, rate of convergence, large-sample distribution theory, asymptotic efficiency) to the properties of the regression function and the choice of smoothing vectors. Furthermore, consideration is given to the tradeoff that can be effected between computational simplicity and statistical efficiency through the choice of gains.Part I deals with the special cases of an unknown scalar parameter-discussing probability-one and mean-square convergence, rates of mean-square convergence, and asymptotic distribution theory of the estimators for various choices of the smoothing sequence. Part II examines the probability-one and mean-square convergence of the estimators in the vector case for various choices of smoothing vectors. Examples are liberally sprinkled throughout the book. Indeed, the last chapter is devoted entirely to the discussion of examples at varying levels of generality.If one views the stochastic approximation literature as a study in the asymptotic behavior of solutions to a certain class of nonlinear first-order difference equations with stochastic driving terms, then the results of this monograph also serve to extend and complement many of the results in that literature, which accounts for the authors' choice of title.The book is written at the first-year graduate level, although this level of maturity is not required uniformly. Certainly the reader should understand the concept of a limit both in the deterministic and probabilistic senses (i.e., almost sure and quadratic mean convergence). This much will assure a comfortable journey through the first fourth of the book. Chapters 4 and 5 require an acquaintance with a few selected central limit theorems. A familiarity with the standard techniques of large-sample theory will also prove useful but is not essential. Part II, Chapters 6 through 9, is couched in the language of matrix algebra, but none of the "classical" results used are deep. The reader who appreciates the elementary properties of eigenvalues, eigenvectors, and matrix norms will feel at home.MIT Press Research Monograph No. 42

Download or read book Asymptotic Properties of Nonlinear Least Squares Estimators in a Replicated Time Series Model written by Jeremy Sin-hing Wu and published by . This book was released on 1982 with total page 246 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book On the Asymptotic Properties of Parameter Estimates in a Regression Model with Non Normally Distributed Errors written by John L. Maryak and published by . This book was released on 1987 with total page 5 pages. Available in PDF, EPUB and Kindle. Book excerpt: The usual assumption of normality for the error terms of a regression model is often untenable. When this assumption is dropped, it may be difficult to characterize parameter estimates for the model. For example, it is stated that if the regression errors are non-normal, one is not even sure of their (e.g., the generalized least squares parameter estimates') asymptotic properties. A partial answer presents an asymptotic distribution theory for Kalman filter estimates for cases where the random terms of the state space model are not necessarily Gaussian. Certain of these asymptotic distribution results are also discussed in the context of model validation (diagnostic checking). Keywords: Random coefficient regression, State-space model, Non-Gaussian, Kalman filters, Reprints. (JHD).

Download or read book Asymptotic properties of least squares estimators in semimartingale regression models written by Norbert Christopeit and published by . This book was released on 1985 with total page 14 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Asymptotic properties of least squares estimators in regression models with forecast feedback written by Michael Mohr and published by . This book was released on 1989 with total page 25 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Some Properties of the Least Squares Estimator in Regression Analysis when the Independent Variables are Stochastic written by P. K. Bhattacharya (Mathematician) and published by . This book was released on 1961 with total page 32 pages. Available in PDF, EPUB and Kindle. Book excerpt: For the linear regression of y on x observations the loss in estimating the true regression function by another function is considered as a loss function. For the loss function, it is shown under certain conditions that if the class of estimates which are linear in y's and have bounded risk is non-empty, then the estimate obtained by the method of least squares belongs to this class and has uniformly minimum risk in this class. A necessary and sufficient condition on the distribution function of x observations is obtained for this class to be non-empty, which unfortunately is not easy to verify in particular cases and is violated in a ver simple situation. owever, by a sequential modification of the sampling scheme, this condition may always be satisfied at the cost of an arbitrarily small increase in the expected sa ple size. I T IS ALSO SHOWN UNDER CERTAIN FURTHER C NDITIONS ON THE FAMILY OF ADMISSIBLE DISTRIB TIONS THAT THE LEAST SQUARES ESTIMATOR IS MINIMAX IN THE CLASS OF ALL ESTIMATORS. (Author).

Download or read book Regression Analysis Under A Priori Parameter Restrictions written by Pavel S. Knopov and published by Springer Science & Business Media. This book was released on 2011-09-28 with total page 245 pages. Available in PDF, EPUB and Kindle. Book excerpt: This monograph focuses on the construction of regression models with linear and non-linear constrain inequalities from the theoretical point of view. Unlike previous publications, this volume analyses the properties of regression with inequality constrains, investigating the flexibility of inequality constrains and their ability to adapt in the presence of additional a priori information The implementation of inequality constrains improves the accuracy of models, and decreases the likelihood of errors. Based on the obtained theoretical results, a computational technique for estimation and prognostication problems is suggested. This approach lends itself to numerous applications in various practical problems, several of which are discussed in detail The book is useful resource for graduate students, PhD students, as well as for researchers who specialize in applied statistics and optimization. This book may also be useful to specialists in other branches of applied mathematics, technology, econometrics and finance

Download or read book On Asymptotic Properties of the Least Squares Estimates in a Stationary Random Field written by and published by . This book was released on 1999 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: A particular two dimensional model in a stationary random field, which has a wide applications in statistical signal processing and in texture classifications, is considered. We prove the consistency and also obtain the asymptotic distributions of the least squares estimators of the different model parameters. It is observed that the asymptotic distribution of the least squares estimators are multivariate normal. Some numerical experiments are performed to see how the asymptotic results work for finite samples. We propose some open problems at the end.

Download or read book Design of Experiments in Nonlinear Models written by Luc Pronzato and published by Springer Science & Business Media. This book was released on 2013-04-10 with total page 404 pages. Available in PDF, EPUB and Kindle. Book excerpt: Design of Experiments in Nonlinear Models: Asymptotic Normality, Optimality Criteria and Small-Sample Properties provides a comprehensive coverage of the various aspects of experimental design for nonlinear models. The book contains original contributions to the theory of optimal experiments that will interest students and researchers in the field. Practitionners motivated by applications will find valuable tools to help them designing their experiments. The first three chapters expose the connections between the asymptotic properties of estimators in parametric models and experimental design, with more emphasis than usual on some particular aspects like the estimation of a nonlinear function of the model parameters, models with heteroscedastic errors, etc. Classical optimality criteria based on those asymptotic properties are then presented thoroughly in a special chapter. Three chapters are dedicated to specific issues raised by nonlinear models. The construction of design criteria derived from non-asymptotic considerations (small-sample situation) is detailed. The connection between design and identifiability/estimability issues is investigated. Several approaches are presented to face the problem caused by the dependence of an optimal design on the value of the parameters to be estimated. A survey of algorithmic methods for the construction of optimal designs is provided.

Download or read book Empirical Estimates in Stochastic Optimization and Identification written by Pavel S. Knopov and published by Springer Science & Business Media. This book was released on 2013-04-17 with total page 256 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book contains problems of stochastic optimization and identification. Results concerning uniform law of large numbers, convergence of approximate estimates of extreme points, as well as empirical estimates of functionals with probability 1 and in probability are presented. Audience: Specialists in stochastic optimization and estimations, postgraduate students, and graduate students studying such topics

Download or read book Dynamic Nonlinear Econometric Models written by Benedikt M. Pötscher and published by Springer Science & Business Media. This book was released on 2013-03-09 with total page 307 pages. Available in PDF, EPUB and Kindle. Book excerpt: Many relationships in economics, and also in other fields, are both dynamic and nonlinear. A major advance in econometrics over the last fifteen years has been the development of a theory of estimation and inference for dy namic nonlinear models. This advance was accompanied by improvements in computer technology that facilitate the practical implementation of such estimation methods. In two articles in Econometric Reviews, i.e., Pötscher and Prucha {1991a,b), we provided -an expository discussion of the basic structure of the asymptotic theory of M-estimators in dynamic nonlinear models and a review of the literature up to the beginning of this decade. Among others, the class of M-estimators contains least mean distance estimators (includ ing maximum likelihood estimators) and generalized method of moment estimators. The present book expands and revises the discussion in those articles. It is geared towards the professional econometrician or statistician. Besides reviewing the literature we also presented in the above men tioned articles a number of then new results. One example is a consis tency result for the case where the identifiable uniqueness condition fails.

Download or read book Asymptotic Properties of S Estimators for Nonlinear Regression Models with de written by Shinichi Sakata and published by . This book was released on 1994 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Asymptotic Properties of Nonlinear Least Squares Estimators when the Parameters are Subject to Equality Constraints written by Enrico Gori and published by . This book was released on with total page 9 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Asymptotic Properties of Some Estimators in Moving Average Models written by Stanford University. Department of Statistics and published by . This book was released on 1975 with total page 318 pages. Available in PDF, EPUB and Kindle. Book excerpt: The author considers estimation procedures for the moving average model of order q. Walker's method uses k sample autocovariances (k> or = q). Assume that k depends on T in such a way that k nears infinity as T nears infinity. The estimates are consistent, asymptotically normal and asymptotically efficient if k = k (T) dominates log T and is dominated by (T sub 1/2). The approach in proving these theorems involves obtaining an explicit form for the components of the inverse of a symmetric matrix with equal elements along its five central diagonals, and zeroes elsewhere. The asymptotic normality follows from a central limit theorem for normalized sums of random variables that are dependent of order k, where k tends to infinity with T. An alternative form of the estimator facilitates the calculations and the analysis of the role of k, without changing the asymptotic properties.