Download or read book The Effectiveness of Parallel Iterative Algorithms for Solution of Large Sparse Linear Systems written by Robert William Leland and published by . This book was released on 1989 with total page 278 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Iterative Methods for Sparse Linear Systems written by Yousef Saad and published by SIAM. This book was released on 2003-01-01 with total page 546 pages. Available in PDF, EPUB and Kindle. Book excerpt: Since the first edition of this book was published in 1996, tremendous progress has been made in the scientific and engineering disciplines regarding the use of iterative methods for linear systems. The size and complexity of the new generation of linear and nonlinear systems arising in typical applications has grown. Solving the three-dimensional models of these problems using direct solvers is no longer effective. At the same time, parallel computing has penetrated these application areas as it became less expensive and standardized. Iterative methods are easier than direct solvers to implement on parallel computers but require approaches and solution algorithms that are different from classical methods. Iterative Methods for Sparse Linear Systems, Second Edition gives an in-depth, up-to-date view of practical algorithms for solving large-scale linear systems of equations. These equations can number in the millions and are sparse in the sense that each involves only a small number of unknowns. The methods described are iterative, i.e., they provide sequences of approximations that will converge to the solution.
Download or read book Iterative Methods and Preconditioning for Large and Sparse Linear Systems with Applications written by Daniele Bertaccini and published by CRC Press. This book was released on 2018-02-19 with total page 375 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book describes, in a basic way, the most useful and effective iterative solvers and appropriate preconditioning techniques for some of the most important classes of large and sparse linear systems. The solution of large and sparse linear systems is the most time-consuming part for most of the scientific computing simulations. Indeed, mathematical models become more and more accurate by including a greater volume of data, but this requires the solution of larger and harder algebraic systems. In recent years, research has focused on the efficient solution of large sparse and/or structured systems generated by the discretization of numerical models by using iterative solvers.
Download or read book Parallel Algorithms for the Iterative Solution of Large Sparse Linear Systems written by Jürgen Krettmann and published by . This book was released on 1982 with total page 122 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Iterative Methods for Large Linear Systems written by David R. Kincaid and published by Academic Press. This book was released on 2014-05-10 with total page 350 pages. Available in PDF, EPUB and Kindle. Book excerpt: Iterative Methods for Large Linear Systems contains a wide spectrum of research topics related to iterative methods, such as searching for optimum parameters, using hierarchical basis preconditioners, utilizing software as a research tool, and developing algorithms for vector and parallel computers. This book provides an overview of the use of iterative methods for solving sparse linear systems, identifying future research directions in the mainstream of modern scientific computing with an eye to contributions of the past, present, and future. Different iterative algorithms that include the successive overrelaxation (SOR) method, symmetric and unsymmetric SOR methods, local (ad-hoc) SOR scheme, and alternating direction implicit (ADI) method are also discussed. This text likewise covers the block iterative methods, asynchronous iterative procedures, multilevel methods, adaptive algorithms, and domain decomposition algorithms. This publication is a good source for mathematicians and computer scientists interested in iterative methods for large linear systems.
Download or read book Iterative Algorithms for Large Sparse Linear Systems on Parallel Computers written by Loyce Mae Adams and published by . This book was released on 1983 with total page 404 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book A Model of Asynchronous Iterative Algorithms for Solving Large Sparse Linear Systems written by Institute for Computer Applications in Science and Engineering and published by . This book was released on 1984 with total page 34 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Parallel Iterative Solution of Sparse Linear Systems Models and Architectures written by D. A. Reed and published by . This book was released on 1984 with total page 52 pages. Available in PDF, EPUB and Kindle. Book excerpt: "The suitability of different parallel architectures for solving randomly sparse linear systems is discussed. Based on the complexity of task scheduling, one parallel architecture, based on a broadcast bus, is presented and analyzed" -- abstract.
Download or read book Scalable Parallel Algorithms for Sparse Linear Systems written by and published by . This book was released on 1997 with total page 6 pages. Available in PDF, EPUB and Kindle. Book excerpt: Large sparse linear systems occur in many scientific and engineering applications encountered in military and civilian domains. Such systems are typically solved using either iterative or direct methods. We are developing parallel formulations of computationally intensive algorithms that underly these methods. Direct methods for solving sparse linear systems are important because of their generality and robustness. For linear systems arising in certain applications, such as linear programming and some structural engineering applications, they are the only feasible methods. Although highly parallel formulations of dense matrix factorization are well known, it has been a challenge to implement efficient sparse linear system solvers using direct methods, even on moderately parallel computers. We have recently achieved a breakthrough in developing a highly parallel sparse Cholesky factorization algorithm that substantially improves the state of the art in parallel direct solution of sparse linear systems-both in terms of scalability and overall performance. Experiments have shown that this algorithm can easily speedup Cholesky factorization by a factor of at least a few hundred up to 1024 processors, and achieve levels of performance that were unheard of and unimaginable for this problem until very recently.
Download or read book A Parallel Iterative Solver for Large Sparse Linear Systems Enhanced with Randomization and GPU Accelerator and Its Resilience to Soft Errors written by Aygul Jamal and published by . This book was released on 2017 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: In this PhD thesis, we address three challenges faced by linear algebra solvers in the perspective of future exascale systems: accelerating convergence using innovative techniques at the algorithm level, taking advantage of GPU (Graphics Processing Units) accelerators to enhance the performance of computations on hybrid CPU/GPU systems, evaluating the impact of errors in the context of an increasing level of parallelism in supercomputers. We are interested in studying methods that enable us to accelerate convergence and execution time of iterative solvers for large sparse linear systems. The solver specifically considered in this work is the parallel Algebraic Recursive Multilevel Solver (pARMS), which is a distributed-memory parallel solver based on Krylov subspace methods.First we integrate a randomization technique referred to as Random Butterfly Transformations (RBT) that has been successfully applied to remove the cost of pivoting in the solution of dense linear systems. Our objective is to apply this method in the ARMS preconditioner to solve more efficiently the last Schur complement system in the application of the recursive multilevel process in pARMS. The experimental results show an improvement of the convergence and the accuracy. Due to memory concerns for some test problems, we also propose to use a sparse variant of RBT followed by a sparse direct solver (SuperLU), resulting in an improvement of the execution time.Then we explain how a non intrusive approach can be applied to implement GPU computing into the pARMS solver, more especially for the local preconditioning phase that represents a significant part of the time to compute the solution. We compare the CPU-only and hybrid CPU/GPU variant of the solver on several test problems coming from physical applications. The performance results of the hybrid CPU/GPU solver using the ARMS preconditioning combined with RBT, or the ILU(0) preconditioning, show a performance gain of up to 30% on the test problems considered in our experiments.Finally we study the effect of soft fault errors on the convergence of the commonly used flexible GMRES (FGMRES) algorithm which is also used to solve the preconditioned system in pARMS. The test problem in our experiments is an elliptical PDE problem on a regular grid. We consider two types of preconditioners: an incomplete LU factorization with dual threshold (ILUT), and the ARMS preconditioner combined with RBT randomization. We consider two soft fault error modeling approaches where we perturb the matrix-vector multiplication and the application of the preconditioner, and we compare their potential impact on the convergence of the solver.
Download or read book Parallel Algorithms for Matrix Computations written by K. Gallivan and published by SIAM. This book was released on 1990-01-01 with total page 207 pages. Available in PDF, EPUB and Kindle. Book excerpt: Describes a selection of important parallel algorithms for matrix computations. Reviews the current status and provides an overall perspective of parallel algorithms for solving problems arising in the major areas of numerical linear algebra, including (1) direct solution of dense, structured, or sparse linear systems, (2) dense or structured least squares computations, (3) dense or structured eigenvaluen and singular value computations, and (4) rapid elliptic solvers. The book emphasizes computational primitives whose efficient execution on parallel and vector computers is essential to obtain high performance algorithms. Consists of two comprehensive survey papers on important parallel algorithms for solving problems arising in the major areas of numerical linear algebra--direct solution of linear systems, least squares computations, eigenvalue and singular value computations, and rapid elliptic solvers, plus an extensive up-to-date bibliography (2,000 items) on related research.
Download or read book Introduction to Parallel and Vector Solution of Linear Systems written by James M. Ortega and published by Springer Science & Business Media. This book was released on 2013-06-29 with total page 309 pages. Available in PDF, EPUB and Kindle. Book excerpt: Although the origins of parallel computing go back to the last century, it was only in the 1970s that parallel and vector computers became available to the scientific community. The first of these machines-the 64 processor llliac IV and the vector computers built by Texas Instruments, Control Data Corporation, and then CRA Y Research Corporation-had a somewhat limited impact. They were few in number and available mostly to workers in a few government laboratories. By now, however, the trickle has become a flood. There are over 200 large-scale vector computers now installed, not only in government laboratories but also in universities and in an increasing diversity of industries. Moreover, the National Science Foundation's Super computing Centers have made large vector computers widely available to the academic community. In addition, smaller, very cost-effective vector computers are being manufactured by a number of companies. Parallelism in computers has also progressed rapidly. The largest super computers now consist of several vector processors working in parallel. Although the number of processors in such machines is still relatively small (up to 8), it is expected that an increasing number of processors will be added in the near future (to a total of 16 or 32). Moreover, there are a myriad of research projects to build machines with hundreds, thousands, or even more processors. Indeed, several companies are now selling parallel machines, some with as many as hundreds, or even tens of thousands, of processors.
Download or read book Parallel Algorithms for Optimal Control of Large Scale Linear Systems written by Zoran Gajic and published by Springer Science & Business Media. This book was released on 2012-12-06 with total page 462 pages. Available in PDF, EPUB and Kindle. Book excerpt: Parallel Algorithms for Optimal Control of Large Scale Linear Systems is a comprehensive presentation for both linear and bilinear systems. The parallel algorithms presented in this book are applicable to a wider class of practical systems than those served by traditional methods for large scale singularly perturbed and weakly coupled systems based on the power-series expansion methods. It is intended for scientists and advance graduate students in electrical engineering and computer science who deal with parallel algorithms and control systems, especially large scale systems. The material presented is both comprehensive and unique.
Download or read book Iterative Methods for Solving Linear Systems written by Anne Greenbaum and published by SIAM. This book was released on 1997-01-01 with total page 235 pages. Available in PDF, EPUB and Kindle. Book excerpt: Much recent research has concentrated on the efficient solution of large sparse or structured linear systems using iterative methods. A language loaded with acronyms for a thousand different algorithms has developed, and it is often difficult even for specialists to identify the basic principles involved. Here is a book that focuses on the analysis of iterative methods. The author includes the most useful algorithms from a practical point of view and discusses the mathematical principles behind their derivation and analysis. Several questions are emphasized throughout: Does the method converge? If so, how fast? Is it optimal, among a certain class? If not, can it be shown to be near-optimal? The answers are presented clearly, when they are known, and remaining important open questions are laid out for further study. Greenbaum includes important material on the effect of rounding errors on iterative methods that has not appeared in other books on this subject. Additional important topics include a discussion of the open problem of finding a provably near-optimal short recurrence for non-Hermitian linear systems; the relation of matrix properties such as the field of values and the pseudospectrum to the convergence rate of iterative methods; comparison theorems for preconditioners and discussion of optimal preconditioners of specified forms; introductory material on the analysis of incomplete Cholesky, multigrid, and domain decomposition preconditioners, using the diffusion equation and the neutron transport equation as example problems. A small set of recommended algorithms and implementations is included.
Download or read book High Performance Scientific Computing written by Michael W. Berry and published by Springer Science & Business Media. This book was released on 2012-01-18 with total page 351 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book presents the state of the art in parallel numerical algorithms, applications, architectures, and system software. The book examines various solutions for issues of concurrency, scale, energy efficiency, and programmability, which are discussed in the context of a diverse range of applications. Features: includes contributions from an international selection of world-class authorities; examines parallel algorithm-architecture interaction through issues of computational capacity-based codesign and automatic restructuring of programs using compilation techniques; reviews emerging applications of numerical methods in information retrieval and data mining; discusses the latest issues in dense and sparse matrix computations for modern high-performance systems, multicores, manycores and GPUs, and several perspectives on the Spike family of algorithms for solving linear systems; presents outstanding challenges and developing technologies, and puts these in their historical context.
Download or read book Templates for the Solution of Linear Systems written by Richard Barrett and published by SIAM. This book was released on 1994-01-01 with total page 141 pages. Available in PDF, EPUB and Kindle. Book excerpt: In this book, which focuses on the use of iterative methods for solving large sparse systems of linear equations, templates are introduced to meet the needs of both the traditional user and the high-performance specialist. Templates, a description of a general algorithm rather than the executable object or source code more commonly found in a conventional software library, offer whatever degree of customization the user may desire. Templates offer three distinct advantages: they are general and reusable; they are not language specific; and they exploit the expertise of both the numerical analyst, who creates a template reflecting in-depth knowledge of a specific numerical technique, and the computational scientist, who then provides "value-added" capability to the general template description, customizing it for specific needs. For each template that is presented, the authors provide: a mathematical description of the flow of algorithm; discussion of convergence and stopping criteria to use in the iteration; suggestions for applying a method to special matrix types; advice for tuning the template; tips on parallel implementations; and hints as to when and why a method is useful.
Download or read book A Survey of Preconditioned Iterative Methods written by Are Magnus Bruaset and published by CRC Press. This book was released on 1995-05-05 with total page 180 pages. Available in PDF, EPUB and Kindle. Book excerpt: The problem of solving large, sparse, linear systems of algebraic equations is vital in scientific computing, even for applications originating from quite different fields. A Survey of Preconditioned Iterative Methods presents an up to date overview of iterative methods for numerical solution of such systems. Typically, the methods considered are well suited for the kind of systems arising from the discretization of partial differential equations. The focus of this presentation is on the family of Krylov subspace solvers, of which the Conjugate Gradient algorithm is a typical example. In addition to an introduction to the basic principles of such methods, a large number of specific algorithms for symmetric and nonsymmetric problems are discussed. When solving linear systems by iteration, a preconditioner is usually introduced in order to speed up convergence. In many cases, the selection of a proper preconditioner is crucial to the resulting computational performance. For this reason, this book pays special attention to different preconditioning strategies. Although aimed at a wide audience, the presentation assumes that the reader has basic knowledge of linear algebra, and to some extent, of partial differential equations. The comprehensive bibliography in this survey is provides an entry point to the enormous amount of published research in the field of iterative methods.
