Intro
When working with the world of Belief MDP s we often would like like to characterize how the Filter Process behaves
Definition (Weak Merging in expectation )
A filter process is stable in the sense of weak merging in expectation if for any f ∈ C b ( X ) f\in C_{b}(\mathbb{X}) f ∈ C b ( X ) and any prior ν \nu ν with μ ≪ ν \mu\ll\nu μ ≪ ν we have lim n → ∞ E μ [ ∣ ∫ f d π n μ − ∫ f d π n ν ∣ ] = 0 \lim_{ n \to \infty } \mathbb{E}^{\mu}\left[ \left| \int\limits f \, d\pi_{n}^{\mu}-\int\limits f \, d\pi_{n}^{\nu} \right| \right]=0 n → ∞ lim E μ [ ∫ f d π n μ − ∫ f d π n ν ] = 0
Definition (Weak merging almost surely )
A filter process is stable in the sense of weak merging P μ \mathbb{P}^{\mu} P μ a.s. if there exists a set of measurement sequences A ⊂ Y Z + A\subset \mathbb{Y}^{\mathbb{Z}_{+}} A ⊂ Y Z + with P μ \mathbb{P}^{\mu} P μ probability 1 1 1 such that for any sequence in A A A , for any f ∈ C b ( X ) f\in C_{b}(\mathbb{X}) f ∈ C b ( X ) and any prior ν \nu ν with μ ≪ ν \mu\ll\nu μ ≪ ν , we have lim n → ∞ ∣ ∫ f d π n μ − ∫ f d π n ν ∣ = 0 P μ a.s. \lim_{ n \to \infty } \left| \int\limits f \, d\pi_{n}^{\mu}-\int\limits f \, d\pi_{n}^{\nu} \right| =0\quad \mathbb{P}^{\mu}\text{ a.s.} n → ∞ lim ∫ f d π n μ − ∫ f d π n ν = 0 P μ a.s.
Definition (Total Variation metric in expectation )
A filter process is stable in the sense of total variation in expectation if for any prior ν \nu ν with μ ≪ ν \mu\ll\nu μ ≪ ν , we have lim n → ∞ E [ ∥ π n μ − π n ν ∥ T V ] = 0 \lim_{ n \to \infty } \mathbb{E}[\lVert \pi_{n}^{\mu}-\pi_{n}^{\nu} \rVert_{TV} ]=0 n → ∞ lim E [∥ π n μ − π n ν ∥ T V ] = 0
Definition (Total Variation metric almost surely )
A filter process is stable in the sense of total variation P μ \mathbb{P}^{\mu} P μ a.s. if for any prior ν \nu ν with μ ≪ ν \mu\ll\nu μ ≪ ν we have lim n → ∞ ∥ π n μ − π n ν ∥ T V = 0 P μ a.s. \lim_{ n \to \infty } \lVert \pi_{n}^{\mu}-\pi_{n}^{\nu} \rVert _{TV}=0\quad\mathbb{P}^{\mu}\text{ a.s.} n → ∞ lim ∥ π n μ − π n ν ∥ T V = 0 P μ a.s.
Definition (Divergence )
A filter process is stable in relative entropy if for any prior ν \nu ν with μ ≪ ν \mu\ll\nu μ ≪ ν lim n → ∞ E μ [ D ( π n μ ∥ π n ν ) ] = 0 \lim_{ n \to \infty } \mathbb{E}^{\mu}[D(\pi_{n}^{\mu}\Vert \pi_{n}^{\nu} )]=0 n → ∞ lim E μ [ D ( π n μ ∥ π n ν )] = 0
Definition (Bounded-Lipschitz metric merging)
A system is stable in the sense of BL-merging P μ \mathbb{P}^{\mu} P μ a.s. if we have lim n → ∞ ∥ π n μ − π n ν ∥ = 0 P μ a.s. \lim_{ n \to \infty } \lVert \pi_{n}^{\mu}-\pi_{n}^{\nu} \rVert =0\quad \mathbb{P}^{\mu}\text{ a.s.} n → ∞ lim ∥ π n μ − π n ν ∥ = 0 P μ a.s.