Download or read book Dimension Reduction and Sufficient Graphical Models written by Kyongwon Kim and published by . This book was released on 2020 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: The methods I develop in my thesis are based on linear or nonlinear sufficient dimension reduction. The basic principle of linear sufficient dimension reduction is to extract a small number of linear combinations of predictor variables, which can represent original predictor variables without loss of information on the conditional distribution of response variable given predictor variables. Nonlinear sufficient dimension reduction is a more generalized version of linear sufficient dimension reduction to the nonlinear context. I am focusing on applying sufficient dimension reduction methods into two areas, regression modeling and graphical models. The first project is about statistical inference in regression context after sufficient dimension reduction. Second, I apply nonlinear sufficient dimension reduction method to the well known statistical graphical models in machine learning. These projects have consistency in a context that discovering areas that sufficient dimension reduction can be applied and establishing statistical theory behind their applications. My first project is about post sufficient dimension reduction statistical inference. The methodologies of sufficient dimension reduction have undergone extensive developments in the past three decades. However, there has been a lack of systematic and rigorous development of post dimension reduction inference, which has seriously hindered its applications. The current common practice is to treat the estimated sufficient predictors as the true predictors and use them as the starting point of the downstream statistical inference. However, this naive inference approach would grossly overestimate the confidence level of an interval, or the power of a test, leading to the distorted results. In this project, we develop a general and comprehensive framework of post dimension reduction inference, which can accommodate any dimension reduction method and model building method, as long as their corresponding influence functions are available. Within this general framework, we derive the influence functions and present the explicit post reduction formulas for the combinations of numerous dimension reduction and model building methods. We then develop post reduction inference methods for both confidence interval and hypothesis testing. We investigate the finite-sample performance of our procedures by simulations and a real data analysis. My second project is about applying nonlinear dimension reduction technique to graphical models. We introduce the Sufficient Graphical Model by applying the recently developed nonlinear sufficient dimension reduction techniques to the evaluation of conditional independence. Graphical model is nonparametric in nature, as it does not make distributional assumptions such as the Gaussian or copula Gaussian assumptions. However, unlike fully nonparametric graphical model, which relies on the high-dimensional kernel to characterize a conditional independence, our graphical model is based on a conditional independence given a set of sufficient predictors with a substantially reduced dimension. In this way, we avoid the curse of dimensionality that comes with a high-dimensional kernel. We develop the population-level properties, convergence rate, and consistency of our estimate. By simulation comparisons and an analysis of the DREAM 4 Challenge data set, we demonstrate that our method outperforms the existing methods when the Gaussian or copula Gaussian assumptions are violated, and its performance remains excellent in the high-dimensional setting.
Download or read book Sufficient Dimension Reduction written by Bing Li and published by CRC Press. This book was released on 2018-04-27 with total page 307 pages. Available in PDF, EPUB and Kindle. Book excerpt: Sufficient dimension reduction is a rapidly developing research field that has wide applications in regression diagnostics, data visualization, machine learning, genomics, image processing, pattern recognition, and medicine, because they are fields that produce large datasets with a large number of variables. Sufficient Dimension Reduction: Methods and Applications with R introduces the basic theories and the main methodologies, provides practical and easy-to-use algorithms and computer codes to implement these methodologies, and surveys the recent advances at the frontiers of this field. Features Provides comprehensive coverage of this emerging research field. Synthesizes a wide variety of dimension reduction methods under a few unifying principles such as projection in Hilbert spaces, kernel mapping, and von Mises expansion. Reflects most recent advances such as nonlinear sufficient dimension reduction, dimension folding for tensorial data, as well as sufficient dimension reduction for functional data. Includes a set of computer codes written in R that are easily implemented by the readers. Uses real data sets available online to illustrate the usage and power of the described methods. Sufficient dimension reduction has undergone momentous development in recent years, partly due to the increased demands for techniques to process high-dimensional data, a hallmark of our age of Big Data. This book will serve as the perfect entry into the field for the beginning researchers or a handy reference for the advanced ones. The author Bing Li obtained his Ph.D. from the University of Chicago. He is currently a Professor of Statistics at the Pennsylvania State University. His research interests cover sufficient dimension reduction, statistical graphical models, functional data analysis, machine learning, estimating equations and quasilikelihood, and robust statistics. He is a fellow of the Institute of Mathematical Statistics and the American Statistical Association. He is an Associate Editor for The Annals of Statistics and the Journal of the American Statistical Association.
Download or read book Dimension Reduction and Graphical Models Using Optimal Transport written by Qi Zhang and published by . This book was released on 2023 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: In this dissertation, we explore three topics at the intersection of optimal transport and statistical models, with a focus on dimension reduction and graphical models. In Chapters 3 and 4, we propose novel linear and nonlinear sufficient dimension reduction methods to incorporate distributional objects by analyzing them in metric spaces induced by optimal transport. In Chapter 5, we develop new copula graphical models for multi-attribute data by leveraging the geometry features of the optimal transport map. Below are summaries for each chapter. In Chapter 3, we introduce a flexible linear sufficient dimension reduction (SDR) method for Fréchet regression, where the predictor is modeled in a Euclidean space, and the response object is modeled in a metric space. The framework works for an important case where distributional objects endowed with the Wasserstein metric are treated as the response. The motivation to consider dimension reduction under this setting includes: mitigating the curse of dimensionality caused by high-dimensional predictors and providing a visual inspection tool for regression diagnostics. The basic idea is to first map the metric-space-valued response to a real-valued random variable using a class of functions and then perform classical SDR to the transformed data. Therefore, our approach can turn any existing SDR method for Euclidean data into one for Fréchet regression. The finite-sample performance of the proposed methods is illustrated through simulation studies, and the data visualization aspect is illustrated using the human mortality distribution data. In Chapter 4, we propose a new framework of nonlinear sufficient dimension reduction for cases where both the predictor and the response are distributional data. Our key step is also to build universal kernels on the space of measures, which results in reproducing kernel Hilbert spaces (RKHS) for the predictor and response that are rich enough to characterize conditional independence. We use the Wasserstein distance for univariate distributions, while for multivariate distributions, we resort to the sliced Wasserstein distance. This choice ensures that the metric space possesses similar topological properties to the Wasserstein space while also keeping the negative type of the metric and offering significant computation benefits. Numerical results based on synthetic data show that our method outperforms possible competing methods. The method is applied to several data sets, including fertility and mortality data and Calgary temperature data. In Chapter 5, we propose a novel copula model, called cyclically monotone copula, to relax the Gaussian assumption in the multi-attribute graphical model, which estimates the graph with an edge set that encodes the conditional dependence between vectors. The new copula can efficiently link vector marginals based on the optimal transport theory. The model is more flexible than the classical Gaussian copula model that performs coordinatewise Gaussianization. We establish the concentration inequalities of the estimated covariance matrices and provide conditions for selection consistency using the group graphical lasso estimator. For the setting with high-dimensional attributes, a projected cyclically monotone copula model is proposed to address the curse of dimensionality issues that arise from solving high-dimensional optimal transport problems. We show numerical results based on synthetic data and provide illustrative applications on gene and protein regulatory networks and color texture image data.
Download or read book Sufficient Dimension Reduction written by Bing Li and published by CRC Press. This book was released on 2018-04-27 with total page 362 pages. Available in PDF, EPUB and Kindle. Book excerpt: Sufficient dimension reduction is a rapidly developing research field that has wide applications in regression diagnostics, data visualization, machine learning, genomics, image processing, pattern recognition, and medicine, because they are fields that produce large datasets with a large number of variables. Sufficient Dimension Reduction: Methods and Applications with R introduces the basic theories and the main methodologies, provides practical and easy-to-use algorithms and computer codes to implement these methodologies, and surveys the recent advances at the frontiers of this field. Features Provides comprehensive coverage of this emerging research field. Synthesizes a wide variety of dimension reduction methods under a few unifying principles such as projection in Hilbert spaces, kernel mapping, and von Mises expansion. Reflects most recent advances such as nonlinear sufficient dimension reduction, dimension folding for tensorial data, as well as sufficient dimension reduction for functional data. Includes a set of computer codes written in R that are easily implemented by the readers. Uses real data sets available online to illustrate the usage and power of the described methods. Sufficient dimension reduction has undergone momentous development in recent years, partly due to the increased demands for techniques to process high-dimensional data, a hallmark of our age of Big Data. This book will serve as the perfect entry into the field for the beginning researchers or a handy reference for the advanced ones. The author Bing Li obtained his Ph.D. from the University of Chicago. He is currently a Professor of Statistics at the Pennsylvania State University. His research interests cover sufficient dimension reduction, statistical graphical models, functional data analysis, machine learning, estimating equations and quasilikelihood, and robust statistics. He is a fellow of the Institute of Mathematical Statistics and the American Statistical Association. He is an Associate Editor for The Annals of Statistics and the Journal of the American Statistical Association.
Download or read book Regression Graphics written by R. Dennis Cook and published by John Wiley & Sons. This book was released on 2009-09-25 with total page 378 pages. Available in PDF, EPUB and Kindle. Book excerpt: An exploration of regression graphics through computer graphics. Recent developments in computer technology have stimulated new and exciting uses for graphics in statistical analyses. Regression Graphics, one of the first graduate-level textbooks on the subject, demonstrates how statisticians, both theoretical and applied, can use these exciting innovations. After developing a relatively new regression context that requires few scope-limiting conditions, Regression Graphics guides readers through the process of analyzing regressions graphically and assessing and selecting models. This innovative reference makes use of a wide range of graphical tools, including 2D and 3D scatterplots, 3D binary response plots, and scatterplot matrices. Supplemented by a companion ftp site, it features numerous data sets and applied examples that are used to elucidate the theory. Other important features of this book include: * Extensive coverage of a relatively new regression context based on dimension-reduction subspaces and sufficient summary plots * Graphical regression, an iterative visualization process for constructing sufficient regression views * Graphics for regressions with a binary response * Graphics for model assessment, including residual plots * Net-effects plots for assessing predictor contributions * Graphics for predictor and response transformations * Inverse regression methods * Access to a Web site of supplemental plots, data sets, and 3D color displays. An ideal text for students in graduate-level courses on statistical analysis, Regression Graphics is also an excellent reference for professional statisticians.
Download or read book Dimensionality Reduction Algorithms with Applications to Collaborative Data and Images written by Guobiao Mei and published by . This book was released on 2008 with total page 248 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Dimension Reduction written by Christopher J. C. Burges and published by Now Publishers Inc. This book was released on 2010 with total page 104 pages. Available in PDF, EPUB and Kindle. Book excerpt: We give a tutorial overview of several foundational methods for dimension reduction. We divide the methods into projective methods and methods that model the manifold on which the data lies. For projective methods, we review projection pursuit, principal component analysis (PCA), kernel PCA, probabilistic PCA, canonical correlation analysis (CCA), kernel CCA, Fisher discriminant analysis, oriented PCA, and several techniques for sufficient dimension reduction. For the manifold methods, we review multidimensional scaling (MDS), landmark MDS, Isomap, locally linear embedding, Laplacian eigenmaps, and spectral clustering. Although the review focuses on foundations, we also provide pointers to some more modern techniques. We also describe the correlation dimension as one method for estimating the intrinsic dimension, and we point out that the notion of dimension can be a scale-dependent quantity. The Nystr m method, which links several of the manifold algorithms, is also reviewed. We use a publicly available dataset to illustrate some of the methods. The goal is to provide a self-contained overview of key concepts underlying many of these algorithms, and to give pointers for further reading.
Download or read book Festschrift in Honor of R Dennis Cook written by Efstathia Bura and published by Springer Nature. This book was released on 2021-04-27 with total page 200 pages. Available in PDF, EPUB and Kindle. Book excerpt: In honor of professor and renowned statistician R. Dennis Cook, this festschrift explores his influential contributions to an array of statistical disciplines ranging from experimental design and population genetics, to statistical diagnostics and all areas of regression-related inference and analysis. Since the early 1990s, Prof. Cook has led the development of dimension reduction methodology in three distinct but related regression contexts: envelopes, sufficient dimension reduction (SDR), and regression graphics. In particular, he has made fundamental and pioneering contributions to SDR, inventing or co-inventing many popular dimension reduction methods, such as sliced average variance estimation, the minimum discrepancy approach, model-free variable selection, and sufficient dimension reduction subspaces. A prolific researcher and mentor, Prof. Cook is known for his ability to identify research problems in statistics that are both challenging and important, as well as his deep appreciation for the applied side of statistics. This collection of Prof. Cook's collaborators, colleagues, friends, and former students reflects the broad array of his contributions to the research and instructional arenas of statistics.
Download or read book Sufficient Dimension Reduction Based on Normal and Wishart Inverse Models written by Liliana Forzani and published by . This book was released on 2007 with total page 358 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Graph Representation Learning written by William L. William L. Hamilton and published by Springer Nature. This book was released on 2022-06-01 with total page 141 pages. Available in PDF, EPUB and Kindle. Book excerpt: Graph-structured data is ubiquitous throughout the natural and social sciences, from telecommunication networks to quantum chemistry. Building relational inductive biases into deep learning architectures is crucial for creating systems that can learn, reason, and generalize from this kind of data. Recent years have seen a surge in research on graph representation learning, including techniques for deep graph embeddings, generalizations of convolutional neural networks to graph-structured data, and neural message-passing approaches inspired by belief propagation. These advances in graph representation learning have led to new state-of-the-art results in numerous domains, including chemical synthesis, 3D vision, recommender systems, question answering, and social network analysis. This book provides a synthesis and overview of graph representation learning. It begins with a discussion of the goals of graph representation learning as well as key methodological foundations in graph theory and network analysis. Following this, the book introduces and reviews methods for learning node embeddings, including random-walk-based methods and applications to knowledge graphs. It then provides a technical synthesis and introduction to the highly successful graph neural network (GNN) formalism, which has become a dominant and fast-growing paradigm for deep learning with graph data. The book concludes with a synthesis of recent advancements in deep generative models for graphs—a nascent but quickly growing subset of graph representation learning.
Download or read book Modern Dimension Reduction written by Philip D. Waggoner and published by Cambridge University Press. This book was released on 2021-08-05 with total page 98 pages. Available in PDF, EPUB and Kindle. Book excerpt: Data are not only ubiquitous in society, but are increasingly complex both in size and dimensionality. Dimension reduction offers researchers and scholars the ability to make such complex, high dimensional data spaces simpler and more manageable. This Element offers readers a suite of modern unsupervised dimension reduction techniques along with hundreds of lines of R code, to efficiently represent the original high dimensional data space in a simplified, lower dimensional subspace. Launching from the earliest dimension reduction technique principal components analysis and using real social science data, I introduce and walk readers through application of the following techniques: locally linear embedding, t-distributed stochastic neighbor embedding (t-SNE), uniform manifold approximation and projection, self-organizing maps, and deep autoencoders. The result is a well-stocked toolbox of unsupervised algorithms for tackling the complexities of high dimensional data so common in modern society. All code is publicly accessible on Github.
Download or read book Sufficient Dimension Reduction and Variable Selection written by Xin Chen and published by . This book was released on 2010 with total page 69 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Elements of Dimensionality Reduction and Manifold Learning written by Benyamin Ghojogh and published by Springer Nature. This book was released on 2023-02-02 with total page 617 pages. Available in PDF, EPUB and Kindle. Book excerpt: Dimensionality reduction, also known as manifold learning, is an area of machine learning used for extracting informative features from data for better representation of data or separation between classes. This book presents a cohesive review of linear and nonlinear dimensionality reduction and manifold learning. Three main aspects of dimensionality reduction are covered: spectral dimensionality reduction, probabilistic dimensionality reduction, and neural network-based dimensionality reduction, which have geometric, probabilistic, and information-theoretic points of view to dimensionality reduction, respectively. The necessary background and preliminaries on linear algebra, optimization, and kernels are also explained to ensure a comprehensive understanding of the algorithms. The tools introduced in this book can be applied to various applications involving feature extraction, image processing, computer vision, and signal processing. This book is applicable to a wide audience who would like to acquire a deep understanding of the various ways to extract, transform, and understand the structure of data. The intended audiences are academics, students, and industry professionals. Academic researchers and students can use this book as a textbook for machine learning and dimensionality reduction. Data scientists, machine learning scientists, computer vision scientists, and computer scientists can use this book as a reference. It can also be helpful to statisticians in the field of statistical learning and applied mathematicians in the fields of manifolds and subspace analysis. Industry professionals, including applied engineers, data engineers, and engineers in various fields of science dealing with machine learning, can use this as a guidebook for feature extraction from their data, as the raw data in industry often require preprocessing. The book is grounded in theory but provides thorough explanations and diverse examples to improve the reader’s comprehension of the advanced topics. Advanced methods are explained in a step-by-step manner so that readers of all levels can follow the reasoning and come to a deep understanding of the concepts. This book does not assume advanced theoretical background in machine learning and provides necessary background, although an undergraduate-level background in linear algebra and calculus is recommended.
Download or read book Statistical Modelling by Exponential Families written by Rolf Sundberg and published by Cambridge University Press. This book was released on 2019-08-29 with total page 297 pages. Available in PDF, EPUB and Kindle. Book excerpt: A readable, digestible introduction to essential theory and wealth of applications, with a vast set of examples and numerous exercises.
Download or read book Robust Statistics written by Ricardo A. Maronna and published by John Wiley & Sons. This book was released on 2019-01-04 with total page 466 pages. Available in PDF, EPUB and Kindle. Book excerpt: A new edition of this popular text on robust statistics, thoroughly updated to include new and improved methods and focus on implementation of methodology using the increasingly popular open-source software R. Classical statistics fail to cope well with outliers associated with deviations from standard distributions. Robust statistical methods take into account these deviations when estimating the parameters of parametric models, thus increasing the reliability of fitted models and associated inference. This new, second edition of Robust Statistics: Theory and Methods (with R) presents a broad coverage of the theory of robust statistics that is integrated with computing methods and applications. Updated to include important new research results of the last decade and focus on the use of the popular software package R, it features in-depth coverage of the key methodology, including regression, multivariate analysis, and time series modeling. The book is illustrated throughout by a range of examples and applications that are supported by a companion website featuring data sets and R code that allow the reader to reproduce the examples given in the book. Unlike other books on the market, Robust Statistics: Theory and Methods (with R) offers the most comprehensive, definitive, and up-to-date treatment of the subject. It features chapters on estimating location and scale; measuring robustness; linear regression with fixed and with random predictors; multivariate analysis; generalized linear models; time series; numerical algorithms; and asymptotic theory of M-estimates. Explains both the use and theoretical justification of robust methods Guides readers in selecting and using the most appropriate robust methods for their problems Features computational algorithms for the core methods Robust statistics research results of the last decade included in this 2nd edition include: fast deterministic robust regression, finite-sample robustness, robust regularized regression, robust location and scatter estimation with missing data, robust estimation with independent outliers in variables, and robust mixed linear models. Robust Statistics aims to stimulate the use of robust methods as a powerful tool to increase the reliability and accuracy of statistical modelling and data analysis. It is an ideal resource for researchers, practitioners, and graduate students in statistics, engineering, computer science, and physical and social sciences.
Download or read book Multivariate Observations written by George A. F. Seber and published by John Wiley & Sons. This book was released on 2009-09-25 with total page 718 pages. Available in PDF, EPUB and Kindle. Book excerpt: WILEY-INTERSCIENCE PAPERBACK SERIES The Wiley-Interscience Paperback Series consists of selected books that have been made more accessible to consumers in an effort to increase global appeal and general circulation. With these new unabridged softcover volumes, Wiley hopes to extend the lives of these works by making them available to future generations of statisticians, mathematicians, and scientists. "In recent years many monographs have been published on specialized aspects of multivariate data-analysis–on cluster analysis, multidimensional scaling, correspondence analysis, developments of discriminant analysis, graphical methods, classification, and so on. This book is an attempt to review these newer methods together with the classical theory. . . . This one merits two cheers." –J. C. Gower, Department of Statistics Rothamsted Experimental Station, Harpenden, U.K. Review in Biometrics, June 1987 Multivariate Observations is a comprehensive sourcebook that treats data-oriented techniques as well as classical methods. Emphasis is on principles rather than mathematical detail, and coverage ranges from the practical problems of graphically representing high-dimensional data to the theoretical problems relating to matrices of random variables. Each chapter serves as a self-contained survey of a specific topic. The book includes many numerical examples and over 1,100 references.
Download or read book Introduction to Graphical Modelling written by David Edwards and published by Springer Science & Business Media. This book was released on 2012-12-06 with total page 342 pages. Available in PDF, EPUB and Kindle. Book excerpt: A useful introduction to this topic for both students and researchers, with an emphasis on applications and practicalities rather than on a formal development. It is based on the popular software package for graphical modelling, MIM, freely available for downloading from the Internet. Following a description of some of the basic ideas of graphical modelling, subsequent chapters describe particular families of models, including log-linear models, Gaussian models, and models for mixed discrete and continuous variables. Further chapters cover hypothesis testing and model selection. Chapters 7 and 8 are new to this second edition and describe the use of directed, chain, and other graphs, complete with a summary of recent work on causal inference.
