Download Introduction to Stochastic Processes

Document related concepts

Perron–Frobenius theorem wikipedia , lookup

Cayley–Hamilton theorem wikipedia , lookup

Transcript
2.3. STATIONARY DISTRIBUTIONS
17
Proof: First of all, π is a probability measure since
∞
XX
P(Xn = j, τi > n|X0 = i) =
j∈E n=0
∞ X
X
P(Xn = j, τi > n|X0 = i)
n=0 j∈E
=
∞
X
P(τi > n|X0 = i) = mi
n=0
The particular statements in the theorem are obvious from theorem 2.16 and the
definition of π. The stationarity of π is shown as follows. First we obtain
πj = m−1
i ·
= m−1
i ·
= m−1
i ·
∞
X
P(Xn = j, τi > n|X0 = i)
n=0
∞
X
n=1
∞
X
n=1
P(Xn = j, τi ≥ n|X0 = i)
P(Xn = j, τi > n − 1|X0 = i)
since X0 = Xτi = i in the conditioning set {X0 = i}. Because of
P(Xn = j, τi > n − 1|X0 = i)
P(Xn = j, τi > n − 1, X0 = i)
=
P(X0 = i)
X P(Xn = j, Xn−1 = k, τi > n − 1, X0 = i)
=
P(X0 = i)
k∈E
X P(Xn = j, Xn−1 = k, τi > n − 1, X0 = i)
=
P(Xn−1 = k, τi > n − 1, X0 = i)
k∈E
P(Xn−1 = k, τi > n − 1, X0 = i)
×
P(X0 = i)
X
pkj P(Xn−1 = k, τi > n − 1|X0 = i)
=
k∈E
we can transform further
∞ X
X
pkj P(Xn−1 = k, τi > n − 1|X0 = i)
πj = m−1
·
i
n=1 k∈E