Survey
* Your assessment is very important for improving the work of artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the work of artificial intelligence, which forms the content of this project
2.3. STATIONARY DISTRIBUTIONS
17
Proof: First of all, Ï is a probability measure since
â
XX
P(Xn = j, Ïi > n|X0 = i) =
jâE n=0
â X
X
P(Xn = j, Ïi > n|X0 = i)
n=0 jâE
=
â
X
P(Ïi > n|X0 = i) = mi
n=0
The particular statements in the theorem are obvious from theorem 2.16 and the
definition of Ï. The stationarity of Ï is shown as follows. First we obtain
Ïj = mâ1
i ·
= mâ1
i ·
= mâ1
i ·
â
X
P(Xn = j, Ïi > n|X0 = i)
n=0
â
X
n=1
â
X
n=1
P(Xn = j, Ïi ⥠n|X0 = i)
P(Xn = j, Ïi > n â 1|X0 = i)
since X0 = XÏi = i in the conditioning set {X0 = i}. Because of
P(Xn = j, Ïi > n â 1|X0 = i)
P(Xn = j, Ïi > n â 1, X0 = i)
=
P(X0 = i)
X P(Xn = j, Xnâ1 = k, Ïi > n â 1, X0 = i)
=
P(X0 = i)
kâE
X P(Xn = j, Xnâ1 = k, Ïi > n â 1, X0 = i)
=
P(Xnâ1 = k, Ïi > n â 1, X0 = i)
kâE
P(Xnâ1 = k, Ïi > n â 1, X0 = i)
Ã
P(X0 = i)
X
pkj P(Xnâ1 = k, Ïi > n â 1|X0 = i)
=
kâE
we can transform further
â X
X
pkj P(Xnâ1 = k, Ïi > n â 1|X0 = i)
Ïj = mâ1
·
i
n=1 kâE