Filter Stability

Intro

When working with the world of Belief MDPs we often would like like to characterize how the Filter Process behaves

Definition (Weak Merging in expectation)

A filter process is stable in the sense of weak merging in expectation if for any f∈Cb(X)f\in C_{b}(\mathbb{X}) and any prior ν\nu with μ≪ν\mu\ll\nu we have lim⁡n→∞Eμ[∣∫f dπnμ−∫f dπnν∣]=0\lim_{ n \to \infty } \mathbb{E}^{\mu}\left[ \left| \int\limits f \, d\pi_{n}^{\mu}-\int\limits f \, d\pi_{n}^{\nu} \right| \right]=0

Definition (Weak merging almost surely)

A filter process is stable in the sense of weak merging Pμ\mathbb{P}^{\mu} a.s. if there exists a set of measurement sequences A⊂YZ+A\subset \mathbb{Y}^{\mathbb{Z}_{+}} with Pμ\mathbb{P}^{\mu} probability 11 such that for any sequence in AA, for any f∈Cb(X)f\in C_{b}(\mathbb{X}) and any prior ν\nu with μ≪ν\mu\ll\nu, we have lim⁡n→∞∣∫f dπnμ−∫f dπnν∣=0Pμ a.s.\lim_{ n \to \infty } \left| \int\limits f \, d\pi_{n}^{\mu}-\int\limits f \, d\pi_{n}^{\nu} \right| =0\quad \mathbb{P}^{\mu}\text{ a.s.}

Definition (Total Variation metric in expectation)

A filter process is stable in the sense of total variation in expectation if for any prior ν\nu with μ≪ν\mu\ll\nu, we have lim⁡n→∞E[∥πnμ−πnν∥TV]=0\lim_{ n \to \infty } \mathbb{E}[\lVert \pi_{n}^{\mu}-\pi_{n}^{\nu} \rVert_{TV} ]=0

Definition (Total Variation metric almost surely)

A filter process is stable in the sense of total variation Pμ\mathbb{P}^{\mu} a.s. if for any prior ν\nu with μ≪ν\mu\ll\nu we have lim⁡n→∞∥πnμ−πnν∥TV=0Pμ a.s.\lim_{ n \to \infty } \lVert \pi_{n}^{\mu}-\pi_{n}^{\nu} \rVert _{TV}=0\quad\mathbb{P}^{\mu}\text{ a.s.}

Definition (Divergence)

A filter process is stable in relative entropy if for any prior ν\nu with μ≪ν\mu\ll\nu lim⁡n→∞Eμ[D(πnμ∥πnν)]=0\lim_{ n \to \infty } \mathbb{E}^{\mu}[D(\pi_{n}^{\mu}\Vert \pi_{n}^{\nu} )]=0

Definition (Bounded-Lipschitz metric merging)

A system is stable in the sense of BL-merging Pμ\mathbb{P}^{\mu} a.s. if we have lim⁡n→∞∥πnμ−πnν∥=0Pμ a.s.\lim_{ n \to \infty } \lVert \pi_{n}^{\mu}-\pi_{n}^{\nu} \rVert =0\quad \mathbb{P}^{\mu}\text{ a.s.}