Overview¶
- Non-Invertible (VAEs)
- Invertible:
- Inverse Sampling Theorem (Uniform and PDFs)
- Change of Variables
Core Topics
- Parametric Gaussianization
- Deep Density Destructors
- Information Theory Measures
- Generalized Divisive Normalization
Supplementary
- Inverse Sampling Theorem
- Change of Variables Formula
- Entropy
- NegEntropy
Classical * Parametric * Histogram * KDE * kNN
Neural Density
- Deep Density Destructor
- Normalizing Flows
- Parametric Gaussianization
- Original: Projection Pursuit, Gaussianization
- Modern: Rotation-Based Iterative Gaussianization (RBIG)
- Approx: Generalized Divisive Normalization (GDN)