Dynamic Optimization: Deterministic and Stochastic Models

by Karl Hinderer, Ulrich Rieder, Michael Stieglitz

Overview

This book explores discrete-time dynamic optimization and provides a detailed introduction to both deterministic and shastic models. Covering problems with finite and infinite horizon, as well as Markov renewal programs, Bayesian control models and partially observable processes, the book focuses on the precise modelling of applications in a variety of areas, including operations research, computer science, mathematics, statistics, engineering, economics and finance.

Dynamic Optimization is a carefully presented textbook which starts with discrete-time deterministic dynamic optimization problems, providing readers with the tools for sequential decision-making, before proceeding to the more complicated shastic models. The authors present complete and simple proofs and illustrate the main results with numerous examples and exercises (without solutions). With relevant material covered in four appendices, this book is completely self-contained.

Product Details

ISBN-13:	9783319488134
Publisher:	Springer International Publishing
Publication date:	01/13/2017
Series:	Universitext
Edition description:	1st ed. 2016
Pages:	530
Product dimensions:	6.10(w) x 9.25(h) x (d)

About the Author

Karl Hinderer was Professor of Shastics at the Karlsruhe Institute of Technology KIT. He wrote the seminal book Foundations of Non-stationary Dynamic Programming with Discrete Time Parameter (1970) and the textbook Grundbegriffe der Wahrscheinlichkeitstheorie (1972). His main research areas were shastic dynamic programming, probability and shastic processes.

Ulrich Rieder is Professor emeritus at the University of Ulm. From 1990 to 2008, he was Editor-in-Chief of Mathematical Methods of Operations Research. His main research areas include shastic dynamic programming and control, risk-sensitive Markov decision processes, shastic games, and financial optimization.

Michael Stieglitz was Professor at the University of Karlsruhe until 2002. He contributes to summability, approximation theory, and probability.

Table of Contents

Introduction and Organization of the Book.- Part I Deterministic Models.- Part II Markovian Decision Processes.- Part III Generalizations of Markovian Decision Processes.- Part IV Appendix.

Editorial Reviews

Part I deals with deterministic dynamic optimization models describing the control of discrete-time systems. Part II is devoted to discrete-time shastic control models. Part III … is devoted to Markovian decision processes with disturbances… The book comprises a lot of examples, problems for readers, and supplements with additional comments for the advanced reader and with bibliographic notes.” (Svetlana A. Kravchenko, zbMATH 1365.90002)

From the Publisher