Created by Knut M. Synstadfrom the Noun Project

Passage Time

Definition (Passage time)

Let {Xn},n≥0\{X_{n}\},n\ge0 be MC with the state space SS. Let i∈Si\in S be a state. Denote Ti(r)T_{i}^{(r)} to be the rthr^{th} passage time to ii. Specifically, let Ti(0)=0,T_{i}^{(0)}=0, and for r≥0r\ge0, Ti(r+1)=inf⁡{n>Ti(r):Xn=i}T_{i}^{(r+1)}=\inf\{n>T_{i}^{(r)}:X_{n}=i\}

Lemma

Let i∈Si\in S and r≥0r\ge0. Then the passage time Ti(r)T_{i}^{(r)} is a stopping time.

Lemma

Let i∈Si\in S and r≥1r\ge1. Then

  1. For r≥1r\ge1, P(Ti(r+1)<∞∣Ti(r)<∞)=Pi(Ti(1)<∞)=hiP(T_{i}^{(r+1)}<\infty|T_{i}^{(r)}<\infty)=P_{i}(T_{i}^{(1)}<\infty)=h_{i}or the probability that we pass state ii again given we did it rr times is equivalent to probability that starting from ii we return to ii which is equivalent to the Hitting probability.
  2. Consequently, r≥0r\ge0, Pi(Ti(r)<∞)=(Pi(Ti(1)<∞))r=(hi)rP_{i}(T_{i}^{(r)}<\infty)=(P_{i}(T_{i}^{(1)}<\infty))^{r}=(h_{i})^{r}

Linked from