When working with the world of Belief MDPs we often would like like to characterize how the Belief MDP behaves
A filter process is stable in the sense of weak merging in expectation if for any f∈Cb(X) and any prior ν with μ≪ν we have n→∞limEμ[∫fdπnμ−∫fdπnν]=0
A filter process is stable in the sense of weak mergingPμa.s. if there exists a set of measurement sequences A⊂YZ+ with Pμ probability 1 such that for any sequence in A, for any f∈Cb(X) and any prior ν with μ≪ν, we have n→∞lim∫fdπnμ−∫fdπnν=0Pμ a.s.
A filter process is stable in the sense of total variation in expectation if for any prior ν with μ≪ν, we have n→∞limE[∥πnμ−πnν∥TV]=0
A filter process is stable in the sense of total variationPμa.s. if for any prior ν with μ≪ν we have n→∞lim∥πnμ−πnν∥TV=0Pμ a.s.
A filter process is stable in relative entropy if for any prior ν with μ≪νn→∞limEμ[D(πnμ∥πnν)]=0
A system is stable in the sense of BL-mergingPμa.s. if we have n→∞lim∥πnμ−πnν∥=0Pμ a.s.