Download or read book Combining Multivariate Adaptive Regression Splines with a Response Surface Methodology for Simulation based Design Optimization written by Scott T. Crino and published by . This book was released on 2006 with total page 374 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Convex Versions of Multivariate Adaptive Regression Splines and Implementations for Complex Optimization Problems written by Dachuan Thomas Shih and published by . This book was released on 2006 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: Multivariate Adaptive Regression Splines (MARS) provide a flexible statistical modeling method that employs forward and backward search algorithms to identify the combination of basis functions that best fits the data. In optimization, MARS has been used successfully to estimate the value function in stochastic dynamic programming, and MARS could be potentially useful in many real world optimization problems where objective (or other) functions need to be estimated from data, such as in simulation optimization. Many optimization methods depend on convexity, but a nonconvex MARS approximation is inherently possible because interaction terms are products of univariate terms. In this dissertation, convex versions of MARS are proposed. In order to ensure MARS convexity, two major modifications are made: (1) coefficients are constrained such that pairs of basis functions are guaranteed to jointly form convex functions; (2) The form of interaction terms is appropriately changed. Finally, MARS convexity can be achieved by the fact that the sum of convex functions is convex. The implementation of MARS for approximating complex optimization functions can involve hundreds to thousands of state or decision variables. In particular, this research studies application to an inventory forecasting stochastic dynamic programming problem and an airline fleet assignment problem. Although one can simply attempt a MARS approximation over all the variables, prior research on the fleet assignment application indicates that many variables have little effect on the objective. Thus, a data mining step to conduct variable selection is needed. This step separates potentially critical variables from clearly redundant ones. In this dissertation, variants of two data mining tools are explored separately and in combination for variable selection: regression trees and multiple testing procedures based on false discovery rate.

Download or read book Dissertation Abstracts International written by and published by . This book was released on 2006 with total page 886 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Multivariate Adaptive Regression Spline Based Framework for Statistically Parsimonious Adaptive Dyanmic Programming written by Subrat Sahu and published by . This book was released on 2011 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: Central to Dynamic Programming (DP) is the 'cost-to-go' or 'future value' function, which is obtained via solving the Bellman's equation, and central to many Approximate Dynamic Programming (ADP) methods is the approximation of the future value function. The exact DP algorithm seeks to compute and store a table consisting of one cost-to-go value for each point in the state space, and its usefulness is limited by the curse of dimensionality, which renders the methodology computationally intractable in the face of real life problems with high-dimensional state spaces and in the face of continuous state variables. ADP methodology seeks to address and redress the issue of the curse of dimensionality by not seeking to compute the future value function exactly and at each point of the state space; rather opting for an approximation of the future value function in the domain of the state space. Existing ADP methodologies have successfully handled 'continuous' state variables through discretization of the state space and estimation of the cost-to-go or future value function and have been challenged in scenarios involving a mix of 'continuous' and 'categorical' or qualitative state variables. The first part of this dissertation research seeks to develop a flexible, nonparametric statistical modeling method which can capture complex nonlinearity in data comprised of a mix of continuous and categorical variables and can be used to approximate future value functions in stochastic dynamic programming (SDP) problems with a mix of continuous and categorical state variables. This dissertation proposes a statistical modeling method, called 'TreeMARS' which combines the versatility of tree-models with the flexibility of multivariate adaptive regression splines (MARS). An extension of the proposed model, called 'Boosted TreeMARS', is also presented. Comparisons are made to the tree-regression model that uses a similar concept, but only permits the use of linear regression at the terminal nodes. Comparisons are presented on a 10-dimensional simulated data set. The second part of the dissertation research, seeking statistical parsimony, proposes a sequential statistical modeling methodology utilizing the 'sequential' concept from Design and Analysis of Computer Experiments (DACE) to make the grid 'only fine enough' for the 'efficient' discretization and then use MARS methods to approximate future value functions. This methodology can be extended in the future to use tree-based MARS models to approximate future value functions involving a mix of continuous and categorical state variables. This sequential grid discretization is nothing but sequential exploration of the state space and this concept of sequential exploration of the state space provides a statistically parsimonious ADP methodology which 'adaptively' captures the important variables from the state space and builds approximations around these quantities while seeking approximation of the future value functions, by using adaptive and flexible modeling.

Download or read book Response Surface Methodology written by Kathleen M. Carley and published by . This book was released on 2004 with total page 26 pages. Available in PDF, EPUB and Kindle. Book excerpt: Abstract: "There is a problem faced by experimenters in many technical fields, where, in general, the response variable of interest is y and there is a set of predictor variables x1, x2, ..., x[subscript k]. For example, in Dynamic Network Analysis (DNA) Response Surface Methodology (RSM) might be useful for sensitivity analysis of various DNA measures for different kinds of random graphs and errors. In Social Network Problems usually the underlying mechanism is not fully understood, and the experimenter must approximate the unknown function g with appropriate empirical model y = f(x1, x2, ..., x[subscript k]) + [epsilon], where the term [epsilon] represents the error in the system. Usually the function f is a first-order or second-order polynomial. This empirical model is called a response surface model. Identifying and fitting from experimental data an appropriate response surface model requires some use of statistical experimental design fundamentals, regression modeling techniques, and optimization methods. All three of these topics are usually combined into Response Surface Methodology (RSM). Also the experimenter may encounter situations where the full model may not be appropriate. Then variable selection or model-building techniques may be used to identify the best subset of regressors to include in a regression model. In our approach we use the simulated annealing method of optimization for searching the best subset of regressors. In some response surface experiments, there can be one or more near-linear dependences among regressor variables in the model. Regression model builders refer to this as multicollinearity among the regressors. Multicollinearity can have serious effects on the estimates of the model parameters and on the general applicability of the final model. The RSM is also extremely useful as an automated tool for model calibration and validation especially for modern computational multi-agent large scale social-networks systems that are becoming heavily used in modeling and simulation of complex social networks. The RSM can be integrated in many large-scale simulation systems such as BioWar, ORA and is currently integrating in Vista, Construct, and DyNet. This report describes the theoretical approach for solving of these problems and the implementation of chosen methods."

Download or read book Uncertainty Quantification in Laminated Composites written by Sudip Dey and published by CRC Press. This book was released on 2018-09-19 with total page 307 pages. Available in PDF, EPUB and Kindle. Book excerpt: Over the last few decades, uncertainty quantification in composite materials and structures has gained a lot of attention from the research community as a result of industrial requirements. This book presents computationally efficient uncertainty quantification schemes following meta-model-based approaches for stochasticity in material and geometric parameters of laminated composite structures. Several metamodels have been studied and comparative results have been presented for different static and dynamic responses. Results for sensitivity analyses are provided for a comprehensive coverage of the relative importance of different material and geometric parameters in the global structural responses.

Download or read book Robust Optimization of Spline Models and Complex Regulatory Networks written by Ayşe Özmen and published by Springer. This book was released on 2016-05-11 with total page 143 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book introduces methods of robust optimization in multivariate adaptive regression splines (MARS) and Conic MARS in order to handle uncertainty and non-linearity. The proposed techniques are implemented and explained in two-model regulatory systems that can be found in the financial sector and in the contexts of banking, environmental protection, system biology and medicine. The book provides necessary background information on multi-model regulatory networks, optimization and regression. It presents the theory of and approaches to robust (conic) multivariate adaptive regression splines - R(C)MARS – and robust (conic) generalized partial linear models – R(C)GPLM – under polyhedral uncertainty. Further, it introduces spline regression models for multi-model regulatory networks and interprets (C)MARS results based on different datasets for the implementation. It explains robust optimization in these models in terms of both the theory and methodology. In this context it studies R(C)MARS results with different uncertainty scenarios for a numerical example. Lastly, the book demonstrates the implementation of the method in a number of applications from the financial, energy, and environmental sectors, and provides an outlook on future research.

Download or read book Spatial Modelling and Failure Analysis of Natural and Engineering Disasters through Data Based Methods volume III written by Faming Huang and published by Frontiers Media SA. This book was released on 2024-09-12 with total page 243 pages. Available in PDF, EPUB and Kindle. Book excerpt: This Research Topic is Volume III of a series. The previous volume can be found here: Spatial Modelling and Failure Analysis of Natural and Engineering Disasters through Data-based Methods - Volume II and Spatial Modelling and Failure Analysis of Natural and Engineering Disasters through Data-based Methods Natural and engineering disasters, which include landslides, rock fall, rainstorm, dam failure, floods, earthquakes, road and building disasters and wildfires, appear as results of the progressive or extreme evolution of climatic, tectonic and geomorphological processes and human engineering activities. It is significant to explore the failure mechanism and carry out spatial modeling of these engineering and natural disasters due to their serious harm to the safety of people's lives and property. The data-based methods, including advanced and successful remote sensing, geographic information systems, machine learning and numerical simulation techniques methods, are promising tools to analyze these complex disasters. Machine Learning models such as neurofuzzy logic, decision tree, artificial neural network, deep learning and evolutionary algorithms are characterized by their abilities to produce knowledge and discover hidden and unknown patterns and trends from large databases, whereas remote sensing and Geographic Information Systems appear as significant technology equipped with tools for data manipulation and advanced mathematical modeling. What is more, the numerical simulation can also be acknowledged as advanced technologies for discovering hidden failure mechanism of disasters. The main objective of this Research Topic is to provide a scientific forum for advancing the successful implementation of Machine Learning (ML) and numerical simulation techniques in operation rules, failure mechanism, spatial and time series prediction, susceptibility mapping, hazard assessment, vulnerability modeling, risk assessment and early warning of complex natural and engineering disasters.

Download or read book Numerical Modelling and Simulation of Metal Processing written by Christof Sommitsch and published by MDPI. This book was released on 2021-08-16 with total page 374 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book deals with metal processing and its numerical modelling and simulation. In total, 21 papers from different distinguished authors have been compiled in this area. Various processes are addressed, including solidification, TIG welding, additive manufacturing, hot and cold rolling, deep drawing, pipe deformation, and galvanizing. Material models are developed at different length scales from atomistic simulation to finite element analysis in order to describe the evolution and behavior of materials during thermal and thermomechanical treatment. Materials under consideration are carbon, Q&T, DP, and stainless steels; ductile iron; and aluminum, nickel-based, and titanium alloys. The developed models and simulations shall help to predict structure evolution, damage, and service behavior of advanced materials.

Download or read book Variants of Multivariate Adaptive Regression Splines MARS written by Diana Luisa Martinez Cepeda and published by . This book was released on 2013 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: Multivariate Adaptive Regression Splines (MARS) is a statistical modeling method used to represent high-dimensional data with interactions. It uses different algorithms to select the terms to be included in the approximation model that best represent the data. In addition, it performs a variable selection, therefore the most significant predictors are shown in the final model. Design and analysis of computer experiments (DACE) is a statistical technique for creating approximations (called metamodels) of computer models. For optimization problems in which there is an unknown function that must be approximated, DACE approach could be applied. In stochastic dynamic programming (SDP) for example, a metamodel can be used to approximate the unknown future value function.The goal of DACE is to efficiently predict the response value of a computer model. MARS has been used as a metamodel in DACE technique. MARS is a flexible model, however in optimization, certain characteristics may be desired, such as a convex or piecewise-linear structure. To satisfy these characteristics, different variants of MARS have been developed. By enabling these variants, MARS modeling facilitates the optimization process. These variations include the ability to model a convex function, a piecewise-linear function and to provide a smoothing option using a quintic routine.DACE has had an enormous contribution for studying complex system, however one of consistent concerns for the researchers is computational time. As researchers seek to study more and more complex systems, corresponding computer models continue to push the limits of computing power. To overcome this drawback, efficient sequential approaches have been studied to reduce the computational effort. This research work focuses its efforts on the development of sequential approaches based on MARS model. The objective is to sequentially update the approximation function using current and new input data points. Additionally, by using less input data points, an accurate prediction of the unknown function could be obtained in a faster manner, and thus the complexity of the model structure is less. This could also facilitate the optimization process.Different case studies are shown in order to test the different MARS variants and sequential MARS approaches proposed in this dissertation. These cases include an inventory forecasting problem, an automotive crash safety design problem and an air pollution SDP problem.

Download or read book Response Surface Methodology written by Raymond H. Myers and published by Wiley-Interscience. This book was released on 1971 with total page 264 pages. Available in PDF, EPUB and Kindle. Book excerpt: The primary objetive of response surface methodology in to aid the statistician and other uers of statistics in applying response surface procedures to appropriate problems in many technical fields. Although methods are emphasized in the boock, a certain amount of theory is presented so that a reader with sufficient baclground in mathematics, especially in the algeba of matrices, can obtain an expourse to the theoretical development. While response surface techniques are widely used, it seems that a need existes for an exposition which contains a considerable amount of the basic material under a single cover. At the time it is felt hist book may create a continued awareness of the basic techniques amog the potential users.

Download or read book Pediatric Injury Biomechanics written by Jeff R. Crandall and published by Springer Science & Business Media. This book was released on 2012-08-15 with total page 357 pages. Available in PDF, EPUB and Kindle. Book excerpt: Pediatric Injury Biomechanics: Archive and Textbook consolidates and describes the current state of the art in pediatric injury biomechanics research in the automotive crash environment. Written by the most respected scientists in the field, the objective of this ground-breaking project is to provide a comprehensive archive and analysis of pediatric injury biomechanics research; to be the go-to reference for the epidemiology of motor vehicle related childhood injury data, pediatric anthropometry, pediatric biomechanical properties, tissue tolerance, and computational models. This book provides essential information needed by researchers working in the field of pediatric injury including those involved in rulemaking activities, injury criteria development, child dummy development, and child injury interventions development. In addition to the text, a companion archive will include valuable information and tools to assist in the identification of gaps in research and future research directions.This living document will be regularly updated with current research and advancements in pediatric injury biomechanics.

Download or read book Handbook of Computational Statistics written by James E. Gentle and published by Springer Science & Business Media. This book was released on 2012-07-06 with total page 1180 pages. Available in PDF, EPUB and Kindle. Book excerpt: The Handbook of Computational Statistics - Concepts and Methods (second edition) is a revision of the first edition published in 2004, and contains additional comments and updated information on the existing chapters, as well as three new chapters addressing recent work in the field of computational statistics. This new edition is divided into 4 parts in the same way as the first edition. It begins with "How Computational Statistics became the backbone of modern data science" (Ch.1): an overview of the field of Computational Statistics, how it emerged as a separate discipline, and how its own development mirrored that of hardware and software, including a discussion of current active research. The second part (Chs. 2 - 15) presents several topics in the supporting field of statistical computing. Emphasis is placed on the need for fast and accurate numerical algorithms, and some of the basic methodologies for transformation, database handling, high-dimensional data and graphics treatment are discussed. The third part (Chs. 16 - 33) focuses on statistical methodology. Special attention is given to smoothing, iterative procedures, simulation and visualization of multivariate data. Lastly, a set of selected applications (Chs. 34 - 38) like Bioinformatics, Medical Imaging, Finance, Econometrics and Network Intrusion Detection highlight the usefulness of computational statistics in real-world applications.

Download or read book Adaptive Regression for Modeling Nonlinear Relationships written by George J. Knafl and published by Springer. This book was released on 2018-06-14 with total page 372 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book presents methods for investigating whether relationships are linear or nonlinear and for adaptively fitting appropriate models when they are nonlinear. Data analysts will learn how to incorporate nonlinearity in one or more predictor variables into regression models for different types of outcome variables. Such nonlinear dependence is often not considered in applied research, yet nonlinear relationships are common and so need to be addressed. A standard linear analysis can produce misleading conclusions, while a nonlinear analysis can provide novel insights into data, not otherwise possible. A variety of examples of the benefits of modeling nonlinear relationships are presented throughout the book. Methods are covered using what are called fractional polynomials based on real-valued power transformations of primary predictor variables combined with model selection based on likelihood cross-validation. The book covers how to formulate and conduct such adaptive fractional polynomial modeling in the standard, logistic, and Poisson regression contexts with continuous, discrete, and counts outcomes, respectively, either univariate or multivariate. The book also provides a comparison of adaptive modeling to generalized additive modeling (GAM) and multiple adaptive regression splines (MARS) for univariate outcomes. The authors have created customized SAS macros for use in conducting adaptive regression modeling. These macros and code for conducting the analyses discussed in the book are available through the first author's website and online via the book’s Springer website. Detailed descriptions of how to use these macros and interpret their output appear throughout the book. These methods can be implemented using other programs.

Download or read book Global Optimization of Nonconvex Piecewise Linear Regression Splines written by Nadia Maria Martinez Cepeda and published by . This book was released on 2013 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: Global optimization has been applied to a wide variety of science and engineering design problems. Although numerous global optimization techniques have been developed and studied for decades, when used for complex systems such as the design of an aircraft or an automobile, the results are impractical or not completely satisfactory. One of the main drawbacks is the computational CPU time required to solve these problems. The majority of design problems require a significant number of experiments or simulations in order to find a globally best solution; however a single simulation can take between seconds and days to finish. One way to address the challenge of reducing these computation times is by building approximation models, known as meta-models or surrogate models. A surrogate model mimics the original model with a reduced number of simulations and has statistical properties that help develop patterns. With a surrogate model, an optimization method can then be applied to locate an optimum in an easier and faster manner; these methods are also well known as surrogate based global optimization methods. In recent years, a number of these types of approaches have been proposed. Some of the most representatives meta-models are: polynomial regression, multivariate adaptive regression splines, radial basis functions, and kriging.The surrogate model used in this study is Multivariate Adaptive Regression Splines (MARS). MARS is a flexible statistical modeling method, particularly useful for high-dimensional problems involving interactions and curvature. MARS terms are based on truncated linear functions, where interaction terms are formed as products. Hence, the univariate terms are piecewise linear, but the interaction terms are not. To enable use of fast mixed integer linear programming methods, the interaction terms of a MARS model are transformed to piecewise linear forms, which are more suitable for optimization. Thus, the purpose of this research is to develop and demonstrate a deterministic global optimization method for a non-convex piecewise linear function generated by a modified version of MARS subject to constraints that include both linear regression models and piecewise linear MARS models. A new mixed integer linear programming (MILP) problem that can optimize the piecewise linear MARS model is formulated by introducing binary integer variables and a new set of inequalities to the model. The MILP problem is then solved by branch-and-bound, which is a widely used algorithm for solving various optimization problems. The MILP problem is adjusted to enable flexibility to handle both continuous and categorical variables. This method is illustrated in an automotive crash safety system design case study for a major US automaker, where satisfactory computational results were obtained. The proposed method is compared with an evolutionary optimization algorithm.

Download or read book Journal of Mechanical Design written by and published by . This book was released on 2008 with total page 818 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book An Investigation of Multivariate Adaptive Regression Splines for Modeling and Analysis of Univariate and Semi multivariate Time Series Systems written by James G. Stevens and published by . This book was released on 1991 with total page 192 pages. Available in PDF, EPUB and Kindle. Book excerpt: