Bellman's Optimality Principle

Blackwell's Irrelevant Information Theorem

Controllability & Observability w.r.t. Riccati

Discounted Cost

Linear Quadratic Problem

Markov Policy is Good Enough

Policy Relationships

Riccati Equation

Value Iteration Algorithm