990 notes · 3002 links
Engineering
Machine Learning
Math
Algebra
Linear Algebra
Concepts
Affine
Bijective
Composition
Identity Map
Image
Invertibility
Kernel
Linear Map
Linear Operator
Preimage
Set of Linear Maps
Adjoint
Diagonal
Diagonalizable
Matrix of Linear Map
Orthogonal Matrix
Orthonormal Matrix
Positive Definite
Positive Semidefinite
Rank
Singular
Trace
Upper-Triangular
Complementary Subspaces
Direct Sum
Finite Basis
Finite Dimensional
Invariant Subspace
Invariant
Linear Combination
Linear Independence
Orthogonal Vector
Span
Subspace
Vector Space
Closure (Algebra)
Eigenvector
Intersection of Sets
Sum of Subsets
Union of Sets
Theorems
Determinants for Linearly Transformed Autocorrelation Matrices
Finite Variance = Autocorrelation symmetric + positive semidefinite
Linear Transform for Autocorrelation Matrices
Distinct eigenvalues have linearly independent eigenvectors
Eigendecomposition of a Matrix
Existence of Eigenvalues on Complex Spaces
Positive Definite = Positive Eigenvalues
Positive Semidefinite has dim Eigenvectors
Trace and Determinant with Eigenvalues
Linear Maps
Dimensionality & Linear Maps
Injectivity, surjectivity, and isomorphism are equivalent when Dimension is the Same
Inverse to a Linear Map is Unique
Isomorphism is a Bijection
Linear maps are defined on a basis
Properties of Linear Maps
Matrices
Composition Rules for Matrices
Inverse Property of Matrix of Linear Map
Linear Maps are Isomorphic to their Matrices
Linearity Properties of Matrices
Criterion for Invertibility using Upper Triangular
Criterion for Upper Triangular Matrix
Eigenvalues are Diagonal Elements of Upper Triangular
Existence of Upper Triangular Matrices on Complex Spaces
Norm-Preserving Matrix
Orthogonal Matrices have Determinant 1
Vector Spaces
All Bases have same size
Criterion for a Basis
Every Spanning Set Contains a Basis
Linearly Independent Sets Generate Bases
Cauchy-Schwarz Inequality
Double Complement Returns the Original Subspace
Orthogonal Decomposition
Parallelogram Equality
Properties of Orthogonal Complements
The Orthogonal Complement is a Complementary Subspace
Criterion for Subspace
Span of Vectors is a Subspace of the Vector Space
Sum of Subspaces is Smallest Subspace Containing their Union
Sum of Subspaces is a Subspace
Isomorphic Vector Spaces have the Same Dimension
Jordan Canonical Form
Analysis
Functional Analysis
Measure Theory
Borel Sets And Functions
Distribution Functions Lebesgue Stieltjes
Lebesgue Integration
Theorems
Beppo Levi Theorem
Countable Additivity is Necessary for MCT
Dominated Convergence Theorem
Fatou's Lemma
Monotone Convergence Theorem
Change of Variable Formula
Lebesgue Integral is a Measure
Convolution
Lebesgue Integral
Lp Spaces
Measurability
Algebras
Construction Of Measures
Measures
Measures On Cartesian Products
Fubini Theorem (For indicator functions)
Fubini-Tonelli
Product Measure
Product σ-algebra is the smallest monotone class containing collection of elementary sets
Slices of P stay in their respective σ-algebras
Slices of product measurable function are in measurable in resultant σ-algebras
Real Analysis
A Summary of MATH 891
Control Theory
Classical Control
Admissible Control
Dynamic Programming
Finite-Horizon Optimal Control Problem
Fixed endpoint problem
Free endpoint problem
Hamilton-Jacobi-Bellman Equation
Value Function
Arbitrary assignment of Eigenvalues
Controllability Canonical Form
Detectable
Eigenvalue assignment for LTIC systems
Global Asymptotic Stability
Hurwitz Matrix
Stabilizable
Functional
Linear Time Invariant Control System
Linear Time Varying Control System
Linearization of Nonlinear Control System
Stochastic Control
Optimal Stochastic Control
Binomial Theorem
Completion of Squares
Greatest Common Divisor
Injective
Necessary
Sufficient
Surjective
Vee
Wedge
Number Theory
Elementary Number Theory
Additive
Arithmetic Function
Binary Function (f_b)
Carmichael Number
Composite Number
Congruence
Coprime
Equivalence Relation
Euler's Totient Function ϕ
Finite Field of Order p
Homomorphism
Isomorphism
Least Common Multiple
Multiplicative
Möbius Function
Parity
Perfect Square
Positive Divisor Counter Function (d)
Prime Number
Primitive
Proper Divisor
Pseudoprime
Pythagorean Triple
Squarefree Number
The Set of Residue Classes mod p
Unit
p-adic Valuation (v_p)
All Numbers Have Prime Divisors
All Numbers have Prime Factorization
Chinese Remainder Theorem
Euclidean Algorithm
Euler's Theorem
Euler's Totient Function in Terms of Mobius Function
Fermat's Little Theorem
Fundamental Theorem of Arithmetic
Generalized Chinese Remainder Theorem
If a Prime divides ab it divides one of a or b
Möbius Inversion Formula
Solution to Congruence
Theorem 1.1
Theorem 1.16
Theorem 1.17
Theorem 1.18
Theorem 1.19
Theorem 1.22
Theorem 1.6
Writing Primitive Pythagorean Triples
b-ary Representation Theorem
Finite Fields
Associate
Generator
Irreducible (Polynomial)
Minimal Polynomial
Monic
Nonzero Constant Polynomials
Polynomials
Primitive Root
Relatively Prime
Ring of Polynomials of Order p
Root of Unity
Root
Characteristic of F
Degree is Closed under Addition
Division Algorithm for Polynomials
Division of Polynomials
Finite Fields of Same Cardinality = Isomorphic
Finite Subgroups are Cyclic
Gauss's Formula
If an Irreducible Polynomial divides ab then it divides a or b
Irreducible Factorization
Lagrange Corollary
Lagrange Lemma
Lagrange Theorem
Min poly. dividing poly. of same root
Unique Factorization Theorem for Polynomials
Uniqueness of GCD
Wilson's Theorem
lcm Order Lemma
Probability
Information Theory
Coding
Lossless Coding
General
Universal Coding
Kac's Lemma (Stationary Ergodic)
Lempel-Ziv Coding
Prefix Code
Shannon-Fano-Elias Code
Lossy Coding
Channel Coding
Achievable
Average Probability of Error (Channel Code)
Average Probability of Error (Source-Channel Code)
Binary Erasure Channel
Binary Symmetric Channel
Binary Symmetric Erasure Channel
Discrete Communication Channel
Discrete Memoryless Channel
Fixed-Length Codes for Discrete Channels
Information Capacity
Operational Channel Capacity
Rate
Source-Channel Fixed-Length Code
Symmetric Channel
Continuous Information Theory
Achievable (Continuous)
Average Cost Constraint
Average Power Constraint
Block Codes for the Gaussian Channel
Continuous Memoryless Source
Differential Cross-Entropy
Differential Divergence
Differential Entropy
Discrete-Time Continuous Memoryless Channels
Discrete-Time Memoryless Gaussian Channel (AWGN Channel)
Fading Channel
Information Capacity with Input Cost
Multivariate Gaussian
Operational Channel Capacity (Continuous)
Typical Set
Volume
AEP For Continuous IID RVs
Capacity of Correlated Parallel Gaussian Channels
Capacity of Uncorrelated Parallel Gaussian Channels
Capacity with Decoder-Side Information (DSI)
Capacity with Full-Side Information (FSI)
Concavity of Channel Capacity in P
Consequence of the AEP
Equivalent Properties in Discrete & Continuous IT
Estimation Error and differential entropy
Gaussian Noise Minimizes Capacity of Additive-Noise Channel
Joint Differential Entropy of Multivariate Gaussian
Shannon's Channel Coding Theorem for AWGN
Uniform Quantization of Real-Valued Source
Upper Bound on Channel Capacity
Elementary Information Theory
Cross-Entropy
Discrete Memoryless Source
Divergence
Entropy Rate
Entropy
Ergodic
Jensen-Shannon Divergence
Joint Entropy
Mutual Information
Renyi Divergence
Renyi Entropy
Self-Information
Source Entropy
Source
State
Stationary & Ergodic Source
Stationary Distribution
Stationary
Typical Set
Channel Coding Operation
Information Capacity Calculation
Karush-Kuhn-Tucker Conditions (KKT)
Lagrange Multipliers Technique
Optimal Power Allotment
Quantization
Predictive Quantization
Scalar Quantization
Companding Quantization
Encoder Decoder Structure of Quantization
High-Resolution Conditions
Lloyd-Max Algorithm
Lloyd-Max Quantizer
Optimal Quantizer
Performance Analysis of Quantizers
Quantizer Cell
Regular Quantizer
Scalar Quantizer
Signal to Noise Ratio
Uniform Quantizer
Probability Theory
Convergence
Expectation Variance
Fundamentals Of Probability
Almost surely
Bernoulli Trial
Coin Tossing Probability Space
Conditional Probability of Events
Decreasing Events
Distribution
Event Space
Exchangeable
Increasing Events
Independent
Limits of Events
Probability Space
Random Variable
Random Vector
Relatively Sequentially Compact
Sample Space
Tail Field
Tight
iid
σ(X)
(Cumulative) Distribution Function
Conditional Probability Density Function
Conditional Probability Mass Function
Joint Distribution Function
Joint Probability Density Function
Joint Probability Mass Function
Marginal Probability Density Function
Marginal Probability Mass Function
Probability Density Function
Probability Mass Function
Types Of Rvs
Binomial Random Variable
Exponential Random Variable
Gamma Random Variable
Gaussian Random Variable
Geometric Random Variable
Negative Binomial RV
Poisson Random Variable
Standard Normal Random Variable
Uniform Random Variable
Summary of MATH 895
Stochastic Differential Equations
Ito Calculus
(A) Ring Generated by R
(P) Predictable σ-algebra
(R) Set of Predictable Rectangles
(Ɛ) Simple Predicable Processes
(Λ) Set of Predictable Locally Integrable Processes
Doléans Measure
Itô Isometry
Itô Stochastic Integral
Mutual Variation
Semimartingale Integral
Semimartingale
Stochastic Interval
Bichteler-Dellacherie Theorem
Cross Variation
Density of Ɛ
Independence of Bounded RV
Itô Isometry v2
Itô Isometry v3
Itô Representation Theorem
Itô Stochastic Integral is a Local Martingale
Itô Stochastic Integral on Ɛ is a R.C. Martingale
Itô Stochastic Integral on Λ is a R.C. Martingale
Itô's Formula
Left Continuous Adapted = Predictable
Multidimensional Itô Formula
Mutual Variation of Itô Stochastic Integrals
Predictable Stochastic Intervals
Quadratic Variation is CAII
Quadratic Variation
Semimartingale Properties
Solution to SDE
Stopping Time Integral
Stochastic Processes
Concepts
Markov Chains
Concepts
Accessible
Aperiodic
Communication
Continuous Time Markov Chain
Detailed Balance
Indistinguishable
Invariant Distribution for CTMC
Invariant Distribution
Invariant Measure
Irreducible
Markov chain
Q-Matrix
Stationary
Transition Kernel
Martingales
Continuous Martingale with Finite Variation is Constant
Doob's Forward Convergence Theorem
Doob's Maximal Inequalities
Doob's Optional Sampling Theorem
Doob's Upcrossing Inequality
Existence of Càdlàg Version
Lévy's Convergence Theorems
Martingale Convergence Theorem
Martingale Equivalence for Stopping Times
Stopped Process is also R.C. Martingale
Excursion Time
Hitting Time
Holding Time
Jump Time
Occupation Time
Passage Time
Random Time
Stopping Time
Adapted
Conditional Independence
Càdlàg
Disintegration
Feller Property
Filtration
Indistinguishable
Modification
Non-Explosive
Stochastic Kernel
Stochastic Process
Stochastic Realization
Topology
Concepts
"Nice" Topological Spaces
Dense
First-countable
Hausdorff
Lindëlof Space
Metric Space
Paracompact
Second-countable
Topological Space
Discrete topology
Euclidean topology
Extended Real Line
Standard topology
Trivial topology
Basis
Closed
Closure
Compact
Induced Topology
Interior Point
Locally Compact
Metrizable
Neighbourhood
Open
Precompact
Relatively Compact
Separable
Sequentially Compact
Topology
Totally Bounded
σ-compact