Convergence 0 1 0 1/3 P= 1/3 0 2/3 /3 1/3 1/3 1/3 0.2500 0.3750 0.3750 P20 ≈ 0.2500 0.3750 0.3750 0.2500 0.3750 0.3750 ergodic:convergent to stationary distributionConvergence P = ￾ ⇤ 010 1/302/3 1/3 1/3 1/3 ⇥ ⌅ 1/3 1/3 1/3 1/3 2/3 1 1 2 3 P20 ￾ ￾ ⇤ 0.2500 0.3750 0.3750 0.2500 0.3750 0.3750 0.2500 0.3750 0.3750 ⇥ ⌅ ergodic: convergent to stationary distribution