15.3.4 Markov chains

Problem: A labeled graph of a system states is given. Find: a) the transition matrix in one and two steps, b) the probabilities of the system state after the first, second, third steps, if at the initial moment the system was in the state of \( S_{1} \), c) final probabilities.