Markov Processes for Stochastic Modeling / Edition 2

by Oliver Ibe

Overview

Markov processes are processes that have limited memory. In particular, their dependence on the past is only through the previous state. They are used to model the behavior of many systems including communications systems, transportation networks, image segmentation and analysis, biological systems and DNA sequence analysis, random atomic motion and diffusion in physics, social mobility, population studies, epidemiology, animal and insect migration, queueing systems, resource management, dams, financial engineering, actuarial science, and decision systems.

Covering a wide range of areas of application of Markov processes, this second edition is revised to highlight the most important aspects as well as the most recent trends and applications of Markov processes. The author spent over 16 years in the industry before returning to academia, and he has applied many of the principles covered in this book in multiple research projects. Therefore, this is an applications-oriented book that also includes enough theory to provide a solid ground in the subject for the reader.

Product Details

ISBN-13:	9780323282956
Publisher:	Elsevier Science
Publication date:	06/03/2013
Edition description:	Revised
Pages:	516
Product dimensions:	6.00(w) x 9.00(h) x (d)

About the Author

Dr Ibe has been teaching at U Mass since 2003. He also has more than 20 years of experience in the corporate world, most recently as Chief Technology Officer at Sineria Networks and Director of Network Architecture for Spike Broadband Corp.

Table of Contents

Chapter 1: Basic ConceptsChapter 2: Introduction to Markov Processes Chapter 3: Discrete-Time Markov ChainsChapter 4: Continuous-Time Markov Chains Chapter 5: Markovian Queueing Systems Chapter 6: Markov Renewal ProcessesChapter 7: Markovian Arrival Processes Chapter 8: Random Walk Chapter 9: Brownian Motion and Diffusion Processes Chapter 10: Controlled Markov ProcessesChapter 11: Hidden Markov ModelsChapter 12: Markov Point Processes

What People are Saying About This

From the Publisher

This book brings into one volume the different applications of Markov processes.

Editorial Reviews

"It is a good textbook for students and reference book for researchers and practitioners, it provides an introduction to a wide range of topics including the classical and the most actual ones, and the reader who is interested in more information in any particular topic is advised to consult any of specialized books in the references." —Laszlo Lakatos (Budapest), Zentralblatt MATH

From the Publisher