Many academic institutions provide access to the digital version.
The primary academic resource related to your search is the textbook by James R. Norris , published by Cambridge University Press . While the full textbook is generally a paid resource, several authorized educational previews and related lecture notes are available online. Official Previews & Summaries markov chains jr norris pdf
Transience, recurrence, irreducibility, and invariant distributions. Many academic institutions provide access to the digital
Complex theorems are always preceded by concrete physical examples. markov chains jr norris pdf