June 21st Father's Day! All the best gift ideas.  Shop NowJune 21st Father's Day! All the best gift ideas.  Shop Now
Membership Card Icon
Collect stamps to save with Rewards. 10 stamps = $5. Learn More
Select a store to view item availability.

Available on compatible , the free NOOK App, and in My Digital Library

NOOK App

Download NOOK app

NOOK Devices

NOOK eReaders

  • NOOK GlowLight 4 Plus
  • NOOK GlowLight 4e
  • NOOK GlowLight 4
  • NOOK GlowLight Plus 7.8"
  • NOOK GlowLight 3
  • NOOK GlowLight Plus 6"

NOOK Tablets

  • NOOK 9" Lenovo Tablet
  • NOOK 10" HD Lenovo Tablet
  • NOOK Tablet 7" & 10.1"
  • NOOK by Samsung Galaxy Tab 7.0 [Tab A and Tab 4]
  • NOOK by Samsung [Tab 4 10.1, S2 & E]

Free NOOK Reading Apps

  • NOOK for iOS
  • NOOK for Android

BN.com website

Go to your Digital Library in My Account

Limit 1 per customer

This book covers the classical theory of Markov chains on general state-spaces as well as many recent developments. The theoretical results are illustrated by simple examples, many of which are taken from Markov Chain Monte Carlo methods. The book is self-contained, while all the results are carefully and concisely proven. Bibliographical notes are added at the end of each chapter to provide an overview of the literature.

Part I lays the foundations of the theory of Markov chain on general ...