This textbook provides a systematic treatment of denumerable Markov chains, covering both the foundations of the subject and some in topics in potential theory and boundary theory. The book is a careful exposition with special emphasis on the clarity of style and presentation.
D.S. Griffeath
Brownian motion Chains Markov Markov chain Markov property Martingale Random Walk Random variable Stochastic processes measure theory stochastic process