Created by Knut M. Synstadfrom the Noun Project

Passage Time

Definition (Passage time)

Let {Xn},n0\{X_{n}\},n\ge0 be MC with the state space SS. Let iSi\in S be a state. Denote Ti(r)T_{i}^{(r)} to be the rthr^{th} passage time to ii. Specifically, let Ti(0)=0,T_{i}^{(0)}=0, and for r0r\ge0, Ti(r+1)=inf{n>Ti(r):Xn=i}T_{i}^{(r+1)}=\inf\{n>T_{i}^{(r)}:X_{n}=i\}

Lemma

Let iSi\in S and r0r\ge0. Then the passage time Ti(r)T_{i}^{(r)} is a stopping time.

Lemma

Let iSi\in S and r1r\ge1. Then

  1. For r1r\ge1, P(Ti(r+1)<Ti(r)<)=Pi(Ti(1)<)=hiP(T_{i}^{(r+1)}<\infty|T_{i}^{(r)}<\infty)=P_{i}(T_{i}^{(1)}<\infty)=h_{i}or the probability that we pass state ii again given we did it rr times is equivalent to probability that starting from ii we return to ii which is equivalent to the Hitting probability.
  2. Consequently, r0r\ge0, Pi(Ti(r)<)=(Pi(Ti(1)<))r=(hi)rP_{i}(T_{i}^{(r)}<\infty)=(P_{i}(T_{i}^{(1)}<\infty))^{r}=(h_{i})^{r}

Linked from