Finite Approximations in Discrete-Time Stochastic Control Quantized Models and Asymptotic Optimality

In a unified form, this monograph presents fundamental results on the approximation of centralized and decentralized stochastic control problems, with uncountable state, measurement, and action spaces. It demonstrates how quantization provides a system-independent and constructive method for the red...

Full description

Bibliographic Details
Main Authors: Saldi, Naci, Linder, Tamás (Author), Yüksel, Serdar (Author)
Format: eBook
Language:English
Published: Cham Birkhäuser 2018, 2018
Edition:1st ed. 2018
Series:Systems & Control: Foundations & Applications
Subjects:
Online Access:
Collection: Springer eBooks 2005- - Collection details see MPG.ReNa
Description
Summary:In a unified form, this monograph presents fundamental results on the approximation of centralized and decentralized stochastic control problems, with uncountable state, measurement, and action spaces. It demonstrates how quantization provides a system-independent and constructive method for the reduction of a system with Borel spaces to one with finite state, measurement, and action spaces. In addition to this constructive view, the book considers both the information transmission approach for discretization of actions, and the computational approach for discretization of states and actions. Part I of the text discusses Markov decision processes and their finite-state or finite-action approximations, while Part II builds from there to finite approximations in decentralized stochastic control problems. This volume is perfect for researchers and graduate students interested in stochastic controls. With the tools presented, readers will be able to establish the convergence of approximation models to original models and the methods are general enough that researchers can build corresponding approximation results, typically with no additional assumptions
Physical Description:VII, 198 p. 6 illus online resource
ISBN:9783319790336