Finite Approximations in Discrete-Time Stochastic Control: Quantized Models and Asymptotic Optimality
In a unified form, this monograph presents fundamental results on the approximation of centralized and decentralized shastic control problems, with uncountable state, measurement, and action spaces. It demonstrates how quantization provides a system-independent and constructive method for the reduction of a system with Borel spaces to one with finite state, measurement, and action spaces. In addition to this constructive view, the book considers both the information transmission approach for discretization of actions, and the computational approach for discretization of states and actions. Part I of the text discusses Markov decision processes and their finite-state or finite-action approximations, while Part II builds from there to finite approximations in decentralized shastic control problems.

This volume is perfect for researchers and graduate students interested in shastic controls. With the tools presented, readers will be able to establish the convergence of approximation models to original models and the methods are general enough that researchers can build corresponding approximation results, typically with no additional assumptions.
1133188288
Finite Approximations in Discrete-Time Stochastic Control: Quantized Models and Asymptotic Optimality
In a unified form, this monograph presents fundamental results on the approximation of centralized and decentralized shastic control problems, with uncountable state, measurement, and action spaces. It demonstrates how quantization provides a system-independent and constructive method for the reduction of a system with Borel spaces to one with finite state, measurement, and action spaces. In addition to this constructive view, the book considers both the information transmission approach for discretization of actions, and the computational approach for discretization of states and actions. Part I of the text discusses Markov decision processes and their finite-state or finite-action approximations, while Part II builds from there to finite approximations in decentralized shastic control problems.

This volume is perfect for researchers and graduate students interested in shastic controls. With the tools presented, readers will be able to establish the convergence of approximation models to original models and the methods are general enough that researchers can build corresponding approximation results, typically with no additional assumptions.
99.99 In Stock
Finite Approximations in Discrete-Time Stochastic Control: Quantized Models and Asymptotic Optimality

Finite Approximations in Discrete-Time Stochastic Control: Quantized Models and Asymptotic Optimality

Finite Approximations in Discrete-Time Stochastic Control: Quantized Models and Asymptotic Optimality

Finite Approximations in Discrete-Time Stochastic Control: Quantized Models and Asymptotic Optimality

Hardcover(1st ed. 2018)

$99.99 
  • SHIP THIS ITEM
    In stock. Ships in 6-10 days.
  • PICK UP IN STORE

    Your local store may have stock of this item.

Related collections and offers


Overview

In a unified form, this monograph presents fundamental results on the approximation of centralized and decentralized shastic control problems, with uncountable state, measurement, and action spaces. It demonstrates how quantization provides a system-independent and constructive method for the reduction of a system with Borel spaces to one with finite state, measurement, and action spaces. In addition to this constructive view, the book considers both the information transmission approach for discretization of actions, and the computational approach for discretization of states and actions. Part I of the text discusses Markov decision processes and their finite-state or finite-action approximations, while Part II builds from there to finite approximations in decentralized shastic control problems.

This volume is perfect for researchers and graduate students interested in shastic controls. With the tools presented, readers will be able to establish the convergence of approximation models to original models and the methods are general enough that researchers can build corresponding approximation results, typically with no additional assumptions.

Product Details

ISBN-13: 9783319790329
Publisher: Springer International Publishing
Publication date: 05/12/2018
Series: Systems & Control: Foundations & Applications
Edition description: 1st ed. 2018
Pages: 198
Product dimensions: 6.10(w) x 9.25(h) x (d)

Table of Contents

Introduction and Summary.- Part I: Finite Model Approximations in Shastic Control.- Prelude to Part I.- Finite Action Approximation of Markov Decision Processes.- Finite-State Approximation of Markov Decision Processes.- Approximations for Partially Observed Markov Decision Processes.- Approximations for Constrained Markov Decision Problems.- Part II: Finite Model Approximations in Decentralized Shastic Control.- Prelude to Part II.- Finite Model Approximations in Decentralized Shastic Control.- Asymptotic Optimality of Finite Models for Specific Systems.- Index.- References.
From the B&N Reads Blog

Customer Reviews