

![0_image_0.png](0_image_0.png)

N 
o
- 0

![0_image_1.png](0_image_1.png)

s;

![0_image_2.png](0_image_2.png)

t t 0

$$\prod_{i=n}^{0}\quad i$$

transition matrices

![0_image_3.png](0_image_3.png)

$$i{\dot{j}}$$

state-transition diagram

St+1 s | St s; i i  6
$$N^{2}$$
$$\begin{array}{c c}{{i j}}&{{}}&{{}}&{{i j}}\end{array}$$
$$N$$
Example 2.1

![0_image_4.png](0_image_4.png)

$$L_{O C}$$

.

.

□

C S closed  proper closed n i j
recurrent

![0_image_5.png](0_image_5.png)

classes absorbing