

![0_image_0.png](0_image_0.png)

![0_image_1.png](0_image_1.png)

(c)

![0_image_2.png](0_image_2.png)

S
history Markov assumption

$$S^{t-1},\,\cdot\,\cdot\,\cdot\,,\,S^{0}$$

st+1|St St-

![0_image_3.png](0_image_3.png)

stage 5 sta tion ary i.

Markov chains