The theory of Markovian processes comprises the largest and the most important chapter in the theory of stochastic processes; this importance is further enhanced by the many applications it has found in both the physical, biological, and social sciences and in engineering and commerce.
