Download or read book Multidimensional Singular Control and Related Skorokhod Problem written by Jodi Dianetti and published by . This book was released on 2021 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: We characterize the optimal control for a class of singular stochastic control problems as the unique solution to a related Skorokhod reflection problem. The considered optimization problems concern the minimization of a discounted cost functional over an infinite time-horizon through a process of bounded variation affecting an Itˆo-diffusion. The setting is multidimensional, the dynamics of the state and the costs are convex, the volatility matrix can be constant or linear in the state. We prove that the optimal control acts only when the underlying diffusion attempts to exit the so-called waiting region, and that the direction of this action is prescribed by the derivative of the value function. Our approach is based on the study of a suitable monotonicity property of the derivative of the value function through its interpretation as the value of an optimal stopping game. Such a monotonicity allows to construct nearly optimal policies which reflect the underlying diffusion at the boundary of approximating waiting regions. The limit of this approximation scheme then provides the desired characterization. Our result applies to a relevant class of linear-quadratic models, among others. Furthermore, it allows to construct the optimal control in degenerate and non degenerate settings considered in the literature, where this important aspect was only partially addressed.
Download or read book Multidimensional Singular Control and Related Skorokhod Problem Suficient Conditions for the Characterization of Optimal Controls written by Jodi Dianetti and published by . This book was released on 2021 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book SIAM Journal on Control and Optimization written by Society for Industrial and Applied Mathematics and published by . This book was released on 1976 with total page 860 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Heavy Traffic Analysis of Controlled Queueing and Communication Networks written by Harold Kushner and published by Springer Science & Business Media. This book was released on 2013-11-21 with total page 522 pages. Available in PDF, EPUB and Kindle. Book excerpt: One of the first books in the timely and important area of heavy traffic analysis of controlled and uncontrolled stochastics networks, by one of the leading authors in the field. The general theory is developed, with possibly state dependent parameters, and specialized to many different cases of practical interest.
Download or read book Relative Optimization of Continuous Time and Continuous State Stochastic Systems written by Xi-Ren Cao and published by Springer Nature. This book was released on 2020-05-13 with total page 376 pages. Available in PDF, EPUB and Kindle. Book excerpt: This monograph applies the relative optimization approach to time nonhomogeneous continuous-time and continuous-state dynamic systems. The approach is intuitively clear and does not require deep knowledge of the mathematics of partial differential equations. The topics covered have the following distinguishing features: long-run average with no under-selectivity, non-smooth value functions with no viscosity solutions, diffusion processes with degenerate points, multi-class optimization with state classification, and optimization with no dynamic programming. The book begins with an introduction to relative optimization, including a comparison with the traditional approach of dynamic programming. The text then studies the Markov process, focusing on infinite-horizon optimization problems, and moves on to discuss optimal control of diffusion processes with semi-smooth value functions and degenerate points, and optimization of multi-dimensional diffusion processes. The book concludes with a brief overview of performance derivative-based optimization. Among the more important novel considerations presented are: the extension of the Hamilton–Jacobi–Bellman optimality condition from smooth to semi-smooth value functions by derivation of explicit optimality conditions at semi-smooth points and application of this result to degenerate and reflected processes; proof of semi-smoothness of the value function at degenerate points; attention to the under-selectivity issue for the long-run average and bias optimality; discussion of state classification for time nonhomogeneous continuous processes and multi-class optimization; and development of the multi-dimensional Tanaka formula for semi-smooth functions and application of this formula to stochastic control of multi-dimensional systems with degenerate points. The book will be of interest to researchers and students in the field of stochastic control and performance optimization alike.
Download or read book XIII Symposium on Probability and Stochastic Processes written by Sergio I. López and published by Springer Nature. This book was released on 2020-10-16 with total page 167 pages. Available in PDF, EPUB and Kindle. Book excerpt: This volume features a collection of contributed articles and lecture notes from the XIII Symposium on Probability and Stochastic Processes, held at UNAM, Mexico, in December 2017. It is split into two main parts: the first one presents lecture notes of the course provided by Mauricio Duarte, followed by its second part which contains research contributions of some of the participants.
Download or read book Multi dimensional Finite fuel Singular Stochastic Control written by David S. Bridge and published by . This book was released on 1991 with total page 42 pages. Available in PDF, EPUB and Kindle. Book excerpt: Abstract: "A multi-dimensional Brownian motion is controlled so as to minimize the infinite-horizon, integrated, discounted second moment. The control process is singularly continuous, pushing the Brownian motion directly toward the origin whenever its norm reaches a certain critical level. The total amount of pushing which can be exerted over the infinite horizon is finite, and so as the remaining 'fuel' diminishes, the critical level at which control is exerted increases, but not to infinity. The optimal control eventually consumes all available fuel, and thereafter the Brownian motion is uncontrolled. The problem is solved by analysis of the associated Hamilton-Jacobi-Bellman variational inequality. The value function is found to be twice continuously differentiable, even across the free boundary associated with this variational inequality."
Download or read book Stochastic Calculus of Variations written by Yasushi Ishikawa and published by Walter de Gruyter GmbH & Co KG. This book was released on 2023-07-24 with total page 376 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book is a concise introduction to the stochastic calculus of variations for processes with jumps. The author provides many results on this topic in a self-contained way for e.g., stochastic differential equations (SDEs) with jumps. The book also contains some applications of the stochastic calculus for processes with jumps to the control theory, mathematical finance and so. This third and entirely revised edition of the work is updated to reflect the latest developments in the theory and some applications with graphics.
Download or read book Mathematical Reviews written by and published by . This book was released on 2004 with total page 1804 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book An Introduction to Stochastic Differential Equations with Reflection written by Andrey Pilipenko and published by Universitätsverlag Potsdam. This book was released on 2014 with total page 90 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book Dissertation Abstracts International written by and published by . This book was released on 2000 with total page 956 pages. Available in PDF, EPUB and Kindle. Book excerpt:
Download or read book High Dimensional Probability written by Roman Vershynin and published by Cambridge University Press. This book was released on 2018-09-27 with total page 299 pages. Available in PDF, EPUB and Kindle. Book excerpt: An integrated package of powerful probabilistic tools and key applications in modern mathematical data science.
Download or read book Encyclopedia of Optimization written by Christodoulos A. Floudas and published by Springer Science & Business Media. This book was released on 2008-09-04 with total page 4646 pages. Available in PDF, EPUB and Kindle. Book excerpt: The goal of the Encyclopedia of Optimization is to introduce the reader to a complete set of topics that show the spectrum of research, the richness of ideas, and the breadth of applications that has come from this field. The second edition builds on the success of the former edition with more than 150 completely new entries, designed to ensure that the reference addresses recent areas where optimization theories and techniques have advanced. Particularly heavy attention resulted in health science and transportation, with entries such as "Algorithms for Genomics", "Optimization and Radiotherapy Treatment Design", and "Crew Scheduling".
Download or read book Mathematics of Two Dimensional Turbulence written by Sergei Kuksin and published by Cambridge University Press. This book was released on 2012-09-20 with total page 337 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book is dedicated to the mathematical study of two-dimensional statistical hydrodynamics and turbulence, described by the 2D Navier–Stokes system with a random force. The authors' main goal is to justify the statistical properties of a fluid's velocity field u(t,x) that physicists assume in their work. They rigorously prove that u(t,x) converges, as time grows, to a statistical equilibrium, independent of initial data. They use this to study ergodic properties of u(t,x) – proving, in particular, that observables f(u(t,.)) satisfy the strong law of large numbers and central limit theorem. They also discuss the inviscid limit when viscosity goes to zero, normalising the force so that the energy of solutions stays constant, while their Reynolds numbers grow to infinity. They show that then the statistical equilibria converge to invariant measures of the 2D Euler equation and study these measures. The methods apply to other nonlinear PDEs perturbed by random forces.
Download or read book Brownian Motion written by Peter Mörters and published by Cambridge University Press. This book was released on 2010-03-25 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: This eagerly awaited textbook covers everything the graduate student in probability wants to know about Brownian motion, as well as the latest research in the area. Starting with the construction of Brownian motion, the book then proceeds to sample path properties like continuity and nowhere differentiability. Notions of fractal dimension are introduced early and are used throughout the book to describe fine properties of Brownian paths. The relation of Brownian motion and random walk is explored from several viewpoints, including a development of the theory of Brownian local times from random walk embeddings. Stochastic integration is introduced as a tool and an accessible treatment of the potential theory of Brownian motion clears the path for an extensive treatment of intersections of Brownian paths. An investigation of exceptional points on the Brownian path and an appendix on SLE processes, by Oded Schramm and Wendelin Werner, lead directly to recent research themes.
Download or read book Optimal Transport written by Cédric Villani and published by Springer Science & Business Media. This book was released on 2008-10-26 with total page 970 pages. Available in PDF, EPUB and Kindle. Book excerpt: At the close of the 1980s, the independent contributions of Yann Brenier, Mike Cullen and John Mather launched a revolution in the venerable field of optimal transport founded by G. Monge in the 18th century, which has made breathtaking forays into various other domains of mathematics ever since. The author presents a broad overview of this area, supplying complete and self-contained proofs of all the fundamental results of the theory of optimal transport at the appropriate level of generality. Thus, the book encompasses the broad spectrum ranging from basic theory to the most recent research results. PhD students or researchers can read the entire book without any prior knowledge of the field. A comprehensive bibliography with notes that extensively discuss the existing literature underlines the book’s value as a most welcome reference text on this subject.
Download or read book Controlled Diffusion Processes written by N. V. Krylov and published by Springer Science & Business Media. This book was released on 2008-09-26 with total page 314 pages. Available in PDF, EPUB and Kindle. Book excerpt: Stochastic control theory is a relatively young branch of mathematics. The beginning of its intensive development falls in the late 1950s and early 1960s. ~urin~ that period an extensive literature appeared on optimal stochastic control using the quadratic performance criterion (see references in Wonham [76]). At the same time, Girsanov [25] and Howard [26] made the first steps in constructing a general theory, based on Bellman's technique of dynamic programming, developed by him somewhat earlier [4]. Two types of engineering problems engendered two different parts of stochastic control theory. Problems of the first type are associated with multistep decision making in discrete time, and are treated in the theory of discrete stochastic dynamic programming. For more on this theory, we note in addition to the work of Howard and Bellman, mentioned above, the books by Derman [8], Mine and Osaki [55], and Dynkin and Yushkevich [12]. Another class of engineering problems which encouraged the development of the theory of stochastic control involves time continuous control of a dynamic system in the presence of random noise. The case where the system is described by a differential equation and the noise is modeled as a time continuous random process is the core of the optimal control theory of diffusion processes. This book deals with this latter theory.
