Dynamic Programming and Optimal Control: Volume II; Approximate Dynamic Programming
- ISBN-10
- 1886529442
- ISBN-13
- 9781886529441
- Category
- Mathematics
- Pages
- 715
- Language
- English
- Published
- 2012-10-23
- Publisher
- Athena Scientific
- Author
- Dimitri Bertsekas
Description
This is the leading and most up-to-date textbook on the far-ranging algorithmic methodology of Dynamic Programming, which can be used for optimal control, Markovian decision problems, planning and sequential decision making under uncertainty, and discrete/combinatorial optimization. The treatment focuses on basic unifying themes, and conceptual foundations. It illustrates the versatility, power, and generality of the method with many examples and applications from engineering, operations research, and other fields. It also addresses extensively the practical application of the methodology, possibly through the use of approximations, and provides an extensive treatment of the far-reaching methodology of Neuro-Dynamic Programming/Reinforcement Learning. Among its special features, the book 1) provides a unifying framework for sequential decision making, 2) treats simultaneously deterministic and stochastic control problems popular in modern control theory and Markovian decision popular in operations research, 3) develops the theory of deterministic optimal control problems including the Pontryagin Minimum Principle, 4) introduces recent suboptimal control and simulation-based approximation techniques (neuro-dynamic programming), which allow the practical application of dynamic programming to complex problems that involve the dual curse of large dimension and lack of an accurate mathematical model, 5) provides a comprehensive treatment of infinite horizon problems in the second volume, and an introductory treatment in the first volume.
Get the book
Other editions
Similar books
-
Dynamic Programming and Optimal Control
By Dimitri P. BertsekasDynamic Programming and Optimal Control
-
Dynamic Programming and Optimal Control
By Dimitri P. BertsekasThe text contains many illustrations, worked-out examples, and exercises."--Publisher's website.
-
Reinforcement Learning and Optimal Control
By Dimitri BertsekasThis book considers large and challenging multistage decision problems, which can be solved in principle by dynamic programming (DP), but their exact solution is computationally intractable.
-
Stochastic Optimal Control: The Discrete-Time Case
By Steven E. Shreve, Dimitri P. BertsekasApart from anything else, the book serves as an excellent introduction to the arcane world of analytic sets and other lesser known byways of measure theory.
-
Dynamic Optimization, Second Edition: The Calculus of Variations and Optimal Control in Economics and Management
By Nancy L. Schwartz, Morton I. KamienSince its initial publication, this text has defined courses in dynamic optimization taught to economics and management science students. The two-part treatment covers the calculus of variations and optimal control. 1998 edition.
-
Optimal Control Theory: An Introduction
By Donald E. KirkUpper-level undergraduate text introduces aspects of optimal control theory: dynamic programming, Pontryagin's minimum principle, and numerical techniques for trajectory optimization.
-
Adaptive Dynamic Programming with Applications in Optimal Control
By Qinglai Wei, Derong Liu, Hongliang LiAbu-Khalaf M, Lewis FL (2005) Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach. Automatica 41(5):779–791 2. Beard RW, Saridis GN, Wen JT (1997) Galerkin approximations of ...
-
Stochastic Optimal Control in Infinite Dimension: Dynamic Programming and HJB Equations
By Giorgio Fabbri, Fausto Gozzi, Andrzej Święch35(1), 15–33 (1998) M. Nisio, Game approach to risk sensitive control for stochastic evolution systems, in Stochastic Analysis, Control, Optimization and Applications, ed. by W.M. McEneaney, G.G. Yin, Q. Zhang.
-
Rollout, Policy Iteration, and Distributed Reinforcement Learning
By Dimitri BertsekasReinforcement Learning and Dynamic Programming Using Function Approximators, CRC Press, N. Y. [BBD10b] Busoniu, L., ... “Ellipsoidal Reachable Sets of Linear Time-Varying Continuous and Discrete Systems in Control and Estimation ...
-
Optimal Control
By Frank L. Lewis, Draguna Vrabie, Vassilis L. SyrmosA NEW EDITION OF THE CLASSIC TEXT ON OPTIMAL CONTROL THEORY As a superb introductory text and an indispensable reference, this new edition of Optimal Control will serve the needs of both the professional engineer and the advanced student in ...