Stochastic Optimal Control: The Discrete-Time Case
- ISBN-10
- 1886529035
- ISBN-13
- 9781886529038
- Category
- Mathematics
- Pages
- 330
- Language
- English
- Published
- 1996-12-01
- Publisher
- Athena Scientific
- Authors
- Steven E. Shreve, Dimitri P. Bertsekas
Description
This research monograph, first published in 1978 by Academic Press, remains the authoritative and comprehensive treatment of the mathematical foundations of stochastic optimal control of discrete-time systems, including the treatment of the intricate measure-theoretic issues. It is an excellent supplement to the first author's Dynamic Programming and Optimal Control (Athena Scientific, 2018). Review of the 1978 printing:"Bertsekas and Shreve have written a fine book. The exposition is extremely clear and a helpful introductory chapter provides orientation and a guide to the rather intimidating mass of literature on the subject. Apart from anything else, the book serves as an excellent introduction to the arcane world of analytic sets and other lesser known byways of measure theory." Mark H. A. Davis, Imperial College, in IEEE Trans. on Automatic Control Among its special features, the book: 1) Resolves definitively the mathematical issues of discrete-time stochastic optimal control problems, including Borel models, and semi-continuous models 2) Establishes the most general possible theory of finite and infinite horizon stochastic dynamic programming models, through the use of analytic sets and universally measurable policies 3) Develops general frameworks for dynamic programming based on abstract contraction and monotone mappings 4) Provides extensive background on analytic sets, Borel spaces and their probability measures 5) Contains much in depth research not found in any other textbook
Get the book
Other editions
Similar books
-
Deterministic and Stochastic Optimal Control
By Wendell H. Fleming, Raymond W. RishelThis book may be regarded as consisting of two parts.
-
Optimal Control and Estimation
By Robert F. StengelGraduate-level text provides introduction to optimal control theory for stochastic systems, emphasizing application of basic concepts to real problems.
-
Stochastic Controls: Hamiltonian Systems and HJB Equations
By Xun Yu Zhou, Jiongmin YongThis is known as a Hamilton-Jacobi-Bellman (HJB) equation.
-
Stochastic Linear-Quadratic Optimal Control Theory: Open-Loop and Closed-Loop Solutions
By Jiongmin Yong, Jingrui SunThis book gathers the most essential results, including recent ones, on linear-quadratic optimal control problems, which represent an important aspect of stochastic control.
-
Deterministic and Stochastic Optimal Control and Inverse Problems
By Stanisław Migórski, Baasansuren Jadamba, Akhtar A. KhanThis edited volume comprises invited contributions from world-renowned researchers in the subject of control and inverse problems.
-
Stochastic Optimal Control in Infinite Dimension: Dynamic Programming and HJB Equations
By Giorgio Fabbri, Fausto Gozzi, Andrzej Święch35(1), 15–33 (1998) M. Nisio, Game approach to risk sensitive control for stochastic evolution systems, in Stochastic Analysis, Control, Optimization and Applications, ed. by W.M. McEneaney, G.G. Yin, Q. Zhang.
-
Stochastic Control Theory: Dynamic Programming Principle
By Makiko NisioThis book offers a systematic introduction to the optimal stochastic control theory via the dynamic programming principle, which is a powerful tool to analyze control problems.
-
Applications of Stochastic Optimal Control to Economics and Finance
By Giorgio Ferrari, Salvatore Federico, Luca RegisThis book is a collection of the papers published in the Special Issue "Applications of Stochastic Optimal Control to Economics and Finance", which appeared in the open access journal Risks in 2019.
-
Optimal Stochastic Control, Stochastic Target Problems, and Backward SDE
By Nizar TouziThis book collects some recent developments in stochastic control theory with applications to financial mathematics.
-
Continuous-time Stochastic Control and Optimization with Financial Applications
By Huyên PhamThis book is directed towards graduate students and researchers in mathematical finance, and will also benefit applied mathematicians interested in financial applications and practitioners wishing to know more about the use of stochastic ...