Download or read book Stochastic control methods for optimal transportation and probabilistic numerical schemes for PDEs written by Xiaolu Tan and published by . This book was released on 2011 with total page 125 pages. Available in PDF, EPUB and Kindle. Book excerpt: Cette thèse porte sur les méthodes numériques pour les équations aux dérivées partielles (EDP) non-linéaires dégénérées, ainsi que pour des problèmes de contrôle d'EDP non-linéaires résultants d'un nouveau problème de transport optimal. Toutes ces questions sont motivées par des applications en mathématiques financières. La thèse est divisée en quatre parties. Dans une première partie, nous nous intéressons à la condition nécessaire et suffisante de la monotonie du thêta-schéma de différences finies pour l'équation de diffusion en dimension un. Nous donnons la formule explicite dans le cas de l'équation de la chaleur, qui est plus faible que la condition classique de Courant-Friedrichs-Lewy (CFL). Dans une seconde partie, nous considérons une EDP parabolique non-linéaire dégénérée et proposons un schéma de type ''splitting'' pour la résoudre. Ce schéma réunit un schéma probabiliste et un schéma semi-lagrangien. Au final, il peut être considéré comme un schéma Monte-Carlo. Nous donnons un résultat de convergence et également un taux de convergence du schéma. Dans une troisième partie, nous étudions un problème de transport optimal, où la masse est transportée par un processus d'état type ''drift-diffusion'' controllé. Le coût associé est dépendant des trajectoires de processus d'état, de son drift et de son coefficient de diffusion. Le problème de transport consiste à minimiser le coût parmi toutes les dynamiques vérifiant les contraintes initiales et terminales sur les distributions marginales. Nous prouvons une formule de dualité pour ce problème de transport, étendant ainsi la dualité de Kantorovich à notre contexte. La formulation duale maximise une fonction valeur sur l'espace des fonctions continues bornées, et la fonction valeur correspondante à chaque fonction continue bornée est la solution d'un problème de contrôle stochastique optimal. Dans le cas markovien, nous prouvons un principe de programmation dynamique pour ces problèmes de contrôle optimal, proposons un algorithme de gradient projeté pour la résolution numérique du problème dual, et en démontrons la convergence. Enfin dans une quatrième partie, nous continuons à développer l'approche duale pour le problème de transport optimal avec une application à la recherche de bornes de prix sans arbitrage des options sur variance étant donnés les prix des options européennes. Après une première approximation analytique, nous proposons un algorithme de gradient projeté pour approcher la borne et la stratégie statique correspondante en options vanilles.

Download or read book Optimal Control of PDEs under Uncertainty written by Jesús Martínez-Frutos and published by Springer. This book was released on 2018-08-30 with total page 138 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book provides a direct and comprehensive introduction to theoretical and numerical concepts in the emerging field of optimal control of partial differential equations (PDEs) under uncertainty. The main objective of the book is to offer graduate students and researchers a smooth transition from optimal control of deterministic PDEs to optimal control of random PDEs. Coverage includes uncertainty modelling in control problems, variational formulation of PDEs with random inputs, robust and risk-averse formulations of optimal control problems, existence theory and numerical resolution methods. The exposition focusses on the entire path, starting from uncertainty modelling and ending in the practical implementation of numerical schemes for the numerical approximation of the considered problems. To this end, a selected number of illustrative examples are analysed in detail throughout the book. Computer codes, written in MatLab, are provided for all these examples. This book is adressed to graduate students and researches in Engineering, Physics and Mathematics who are interested in optimal control and optimal design for random partial differential equations.

Download or read book Stochastic Optimal Control in Infinite Dimension written by Giorgio Fabbri and published by Springer. This book was released on 2017-06-22 with total page 928 pages. Available in PDF, EPUB and Kindle. Book excerpt: Providing an introduction to stochastic optimal control in infinite dimension, this book gives a complete account of the theory of second-order HJB equations in infinite-dimensional Hilbert spaces, focusing on its applicability to associated stochastic optimal control problems. It features a general introduction to optimal stochastic control, including basic results (e.g. the dynamic programming principle) with proofs, and provides examples of applications. A complete and up-to-date exposition of the existing theory of viscosity solutions and regular solutions of second-order HJB equations in Hilbert spaces is given, together with an extensive survey of other methods, with a full bibliography. In particular, Chapter 6, written by M. Fuhrman and G. Tessitore, surveys the theory of regular solutions of HJB equations arising in infinite-dimensional stochastic control, via BSDEs. The book is of interest to both pure and applied researchers working in the control theory of stochastic PDEs, and in PDEs in infinite dimension. Readers from other fields who want to learn the basic theory will also find it useful. The prerequisites are: standard functional analysis, the theory of semigroups of operators and its use in the study of PDEs, some knowledge of the dynamic programming approach to stochastic optimal control problems in finite dimension, and the basics of stochastic analysis and stochastic equations in infinite-dimensional spaces.

Download or read book Numerical Methods for Stochastic Control Problems in Continuous Time written by Harold J. Kushner and published by Springer Science & Business Media. This book was released on 2001 with total page 496 pages. Available in PDF, EPUB and Kindle. Book excerpt: The required background is surveyed, and there is an extensive development of methods of approximation and computational algorithms. The book is written on two levels: algorithms and applications, and mathematical proofs. Thus, the ideas should be very accessible to a broad audience."--BOOK JACKET.

Download or read book Mathematical Control Theory for Stochastic Partial Differential Equations written by Qi Lü and published by Springer Nature. This book was released on 2021-10-19 with total page 592 pages. Available in PDF, EPUB and Kindle. Book excerpt: This is the first book to systematically present control theory for stochastic distributed parameter systems, a comparatively new branch of mathematical control theory. The new phenomena and difficulties arising in the study of controllability and optimal control problems for this type of system are explained in detail. Interestingly enough, one has to develop new mathematical tools to solve some problems in this field, such as the global Carleman estimate for stochastic partial differential equations and the stochastic transposition method for backward stochastic evolution equations. In a certain sense, the stochastic distributed parameter control system is the most general control system in the context of classical physics. Accordingly, studying this field may also yield valuable insights into quantum control systems. A basic grasp of functional analysis, partial differential equations, and control theory for deterministic systems is the only prerequisite for reading this book.

Download or read book Approximations Existence and Numerical Procedures for Optimal Stochastic Controls written by Harold Joseph Kushner and published by . This book was released on 1973 with total page 46 pages. Available in PDF, EPUB and Kindle. Book excerpt: In the paper, the authors prove several convergence results for a numerical method in optimal stochastic control, based on finite difference approximations to the non-linear Bellman partial differential equation for the optimal cost. As a very useful by-product to the main development, the authors obtain new existence results for optimal controls, and interesting results on the approximation of a controlled diffusion by a controlled Markov chain. The methods and results are new, and depend on results concerning weak convergence of probability measures. The methods seem to be quite powerful, and have applications to many other problems in approximation and control. (Author).

Download or read book Linear Stochastic Control Systems written by Goong Chen and published by CRC Press. This book was released on 1995-07-12 with total page 404 pages. Available in PDF, EPUB and Kindle. Book excerpt: Linear Stochastic Control Systems presents a thorough description of the mathematical theory and fundamental principles of linear stochastic control systems. Both continuous-time and discrete-time systems are thoroughly covered. Reviews of the modern probability and random processes theories and the Itô stochastic differential equations are provided. Discrete-time stochastic systems theory, optimal estimation and Kalman filtering, and optimal stochastic control theory are studied in detail. A modern treatment of these same topics for continuous-time stochastic control systems is included. The text is written in an easy-to-understand style, and the reader needs only to have a background of elementary real analysis and linear deterministic systems theory to comprehend the subject matter. This graduate textbook is also suitable for self-study, professional training, and as a handy research reference. Linear Stochastic Control Systems is self-contained and provides a step-by-step development of the theory, with many illustrative examples, exercises, and engineering applications.

Download or read book Optimal Design of Control Systems written by Gennadii E. Kolosov and published by CRC Press. This book was released on 2020-08-27 with total page 424 pages. Available in PDF, EPUB and Kindle. Book excerpt: "Covers design methods for optimal (or quasioptimal) control algorithms in the form of synthesis for deterministic and stochastic dynamical systems-with applications in aerospace, robotic, and servomechanical technologies. Providing new results on exact and approximate solutions of optimal control problems."

Download or read book Stochastic Control Theory written by Makiko Nisio and published by . This book was released on 2014-12-31 with total page 268 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Deterministic and Stochastic Optimal Control written by Wendell H. Fleming and published by Springer Science & Business Media. This book was released on 1975-11-17 with total page 242 pages. Available in PDF, EPUB and Kindle. Book excerpt: The first part of this book presents the essential topics for an introduction to deterministic optimal control theory. The second part introduces stochastic optimal control for Markov diffusion processes. It also inlcudes two other topics important for applications, namely, the solution to the stochastic linear regulator and the separation principle.

Download or read book Foundations of Deterministic and Stochastic Control written by Jon H. Davis and published by Springer Science & Business Media. This book was released on 2012-12-06 with total page 434 pages. Available in PDF, EPUB and Kindle. Book excerpt: "This volume is a textbook on linear control systems with an emphasis on stochastic optimal control with solution methods using spectral factorization in line with the original approach of N. Wiener. Continuous-time and discrete-time versions are presented in parallel.... Two appendices introduce functional analytic concepts and probability theory, and there are 77 references and an index. The chapters (except for the last two) end with problems.... [T]he book presents in a clear way important concepts of control theory and can be used for teaching." —Zentralblatt Math "This is a textbook intended for use in courses on linear control and filtering and estimation on (advanced) levels. Its major purpose is an introduction to both deterministic and stochastic control and estimation. Topics are treated in both continuous time and discrete time versions.... Each chapter involves problems and exercises, and the book is supplemented by appendices, where fundamentals on Hilbert and Banach spaces, operator theory, and measure theoretic probability may be found. The book will be very useful for students, but also for a variety of specialists interested in deterministic and stochastic control and filtering." —Applications of Mathematics "The strength of the book under review lies in the choice of specialized topics it contains, which may not be found in this form elsewhere. Also, the first half would make a good standard course in linear control." —Journal of the Indian Institute of Science

Download or read book Control and Optimization with PDE Constraints written by Kristian Bredies and published by Springer Science & Business Media. This book was released on 2013-06-12 with total page 221 pages. Available in PDF, EPUB and Kindle. Book excerpt: Many mathematical models of physical, biological and social systems involve partial differential equations (PDEs). The desire to understand and influence these systems naturally leads to considering problems of control and optimization. This book presents important topics in the areas of control of PDEs and of PDE-constrained optimization, covering the full spectrum from analysis to numerical realization and applications. Leading scientists address current topics such as non-smooth optimization, Hamilton–Jacobi–Bellmann equations, issues in optimization and control of stochastic partial differential equations, reduced-order models and domain decomposition, discretization error estimates for optimal control problems, and control of quantum-dynamical systems. These contributions originate from the “International Workshop on Control and Optimization of PDEs” in Mariatrost in October 2011. This book is an excellent resource for students and researchers in control or optimization of differential equations. Readers interested in theory or in numerical algorithms will find this book equally useful.

Download or read book Optimal Stochastic Control Stochastic Target Problems and Backward SDE written by Nizar Touzi and published by Springer Science & Business Media. This book was released on 2012-09-25 with total page 219 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book collects some recent developments in stochastic control theory with applications to financial mathematics. We first address standard stochastic control problems from the viewpoint of the recently developed weak dynamic programming principle. A special emphasis is put on the regularity issues and, in particular, on the behavior of the value function near the boundary. We then provide a quick review of the main tools from viscosity solutions which allow to overcome all regularity problems. We next address the class of stochastic target problems which extends in a nontrivial way the standard stochastic control problems. Here the theory of viscosity solutions plays a crucial role in the derivation of the dynamic programming equation as the infinitesimal counterpart of the corresponding geometric dynamic programming equation. The various developments of this theory have been stimulated by applications in finance and by relevant connections with geometric flows. Namely, the second order extension was motivated by illiquidity modeling, and the controlled loss version was introduced following the problem of quantile hedging. The third part specializes to an overview of Backward stochastic differential equations, and their extensions to the quadratic case.​

Download or read book Optimal Stochastic Control Schemes within a Structural Reliability Framework written by Bernt J Leira and published by Springer. This book was released on 2013-09-16 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: ​The book addresses the topic of on-line implementation of structural and mechanical design criteria as an explicit part of optimal control schemes. The intention of the present research monograph is to reflect recent developments within this area. Examples of application of relevant control algorithms are included to illustrate their practical implementation. These examples are mainly taken from the area of marine technology with the multi-component external loading being represented as both varying in time and with magnitudes that are represented as statistical quantities. The relevant target group will be mechanical and structural engineers that are concerned with “smart components and structures” where optimal design principles and control actuators are combined. The book is also relevant for engineers e.g. involved in mechatronics and control applications.

Download or read book Probabilistic and Randomized Methods for Design under Uncertainty written by Giuseppe Calafiore and published by Springer Science & Business Media. This book was released on 2006-03-06 with total page 454 pages. Available in PDF, EPUB and Kindle. Book excerpt: Probabilistic and Randomized Methods for Design under Uncertainty is a collection of contributions from the world’s leading experts in a fast-emerging branch of control engineering and operations research. The book will be bought by university researchers and lecturers along with graduate students in control engineering and operational research.

Download or read book Optimal Stochastic Control Numerical Methods written by and published by . This book was released on 1988* with total page 10 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Download or read book Stochastic Optimal Transportation written by Toshio Mikami and published by Springer Nature. This book was released on 2021-06-15 with total page 129 pages. Available in PDF, EPUB and Kindle. Book excerpt: In this book, the optimal transportation problem (OT) is described as a variational problem for absolutely continuous stochastic processes with fixed initial and terminal distributions. Also described is Schrödinger’s problem, which is originally a variational problem for one-step random walks with fixed initial and terminal distributions. The stochastic optimal transportation problem (SOT) is then introduced as a generalization of the OT, i.e., as a variational problem for semimartingales with fixed initial and terminal distributions. An interpretation of the SOT is also stated as a generalization of Schrödinger’s problem. After the brief introduction above, the fundamental results on the SOT are described: duality theorem, a sufficient condition for the problem to be finite, forward–backward stochastic differential equations (SDE) for the minimizer, and so on. The recent development of the superposition principle plays a crucial role in the SOT. A systematic method is introduced to consider two problems: one with fixed initial and terminal distributions and one with fixed marginal distributions for all times. By the zero-noise limit of the SOT, the probabilistic proofs to Monge’s problem with a quadratic cost and the duality theorem for the OT are described. Also described are the Lipschitz continuity and the semiconcavity of Schrödinger’s problem in marginal distributions and random variables with given marginals, respectively. As well, there is an explanation of the regularity result for the solution to Schrödinger’s functional equation when the space of Borel probability measures is endowed with a strong or a weak topology, and it is shown that Schrödinger’s problem can be considered a class of mean field games. The construction of stochastic processes with given marginals, called the marginal problem for stochastic processes, is discussed as an application of the SOT and the OT.