15.3.2 Markov chains

Problem: A labeled graph of system states is given. Find: a) the transition matrices in one and two steps, b) the probabilities of the system state after the first, second and the third steps, if at the initial moment the system was in the state of \( S_{2} \), c) final probabilities.