Equation (1.8) is called the Chapman-Kolmogorov equation; it states that starting at state i, in order for the process X to be in state j after m + n steps, it must be in some intermediate state k after the mth step and then move from that state k into state j during the remaining n steps.

