Stochastic Control in Discrete and Continuous Time / Edition 1

by Atle Seierstad

Overview

This book contains an introduction to three topics in shastic control: discrete time shastic control, i. e. , shastic dynamic programming (Chapter 1), piecewise - terministic control problems (Chapter 3), and control of Ito diffusions (Chapter 4). The chapters include treatments of optimal stopping problems. An Appendix - calls material from elementary probability theory and gives heuristic explanations of certain more advanced tools in probability theory. The book will hopefully be of interest to students in several fields: economics, engineering, operations research, finance, business, mathematics. In economics and business administration, graduate students should readily be able to read it, and the mathematical level can be suitable for advanced undergraduates in mathem- ics and science. The prerequisites for reading the book are only a calculus course and a course in elementary probability. (Certain technical comments may demand a slightly better background. ) As this book perhaps (and hopefully) will be read by readers with widely diff- ing backgrounds, some general advice may be useful: Don’t be put off if paragraphs, comments, or remarks contain material of a seemingly more technical nature that you don’t understand. Just skip such material and continue reading, it will surely not be needed in order to understand the main ideas and results. The presentation avoids the use of measure theory.

Product Details

ISBN-13:	9781441945693
Publisher:	Springer US
Publication date:	12/12/2011
Edition description:	2009
Pages:	222
Product dimensions:	6.10(w) x 9.25(h) x 0.03(d)

Table of Contents

Shastic Control over Discrete Time.- The HJB Equation for Deterministic Control.- Piecewise Deterministic Optimal Control Problems.- Control of Diffusions.- Appendix: Probability, Concepts, and Results.

Editorial Reviews

From the reviews:

"This book provides a comprehensive introduction to shastic control. … The treatment is at the level of a first course, with several examples and exercises. The book can be used by undergraduate students, but also by graduate students, engineers and others who study control, systems and related areas or want to extend their knowledge in these topics." (Krzysztof Szajowski, Mathematical Reviews, Issue 2009 j)

From the Publisher