Introduction to Stochastic Processes (Dover Books on Mathematics)

by Erhan Çinlar

Note that in this example, not only each row, but also each column sums to one. Such matrices are called doubly Markov.