1.
Taylor, Howard M. & Karlin, Samuel. An introduction to stochastic modeling. (Academic Press, 1998).
2.
Norris, J. R. Markov chains. vol. Cambridge series on statistical and probabilistic mathematics (Cambridge University Press, 1998).