Skip to content

Research Journal Automatic Differentiation

Initializing search

jejjohnson/research_journal

Research Journal

jejjohnson/research_journal

Overview
Definitions
Logistics
Explorers
Explorers
- Explorers
- BNNs
  BNNs
  - Bayesian Neural Networks Working Group
  - Sidebar
  - Code
    Code
    
    Programming Exercises
    
    Resources
    
    Software
    
    My notes
    My notes
    
    TensorFlow 2.0
    
    Packages
    Packages
    
    Numpyro
    
    Pyro
  - Other
    Other
    
    Explorers Group: TF 2.X and PyTorch for not so Dummies
    
    Key Figures
    
    Controversy
    
    Videos
  - Prezis
    Prezis
    
    TF2.X and PyTorch
  - Theory
    Theory
    
    Index
    
    Optimization
    
    Papers
    
    Neural Networks with Uncertainty
    
    Resources
    
    State-of-the-Art
    
    Neural Networks with Uncertainty
    
    Videos
- Starspots
  Starspots
  - StarSpots
Appendix
Appendix
- My Appendices
- Bayesian
  Bayesian
  - Exponential Family of Distributions
  - Gaussian
  - Solving Hard Integral Problems
  - Bayesian: Language of Uncertainty
  - Kernel Density Estimation
  - KL Divergence
  - Mixture Models
  - Monte Carlo
  - PDF Estimation
  - PDF Estimation
  - Regression
  - Uniform Distribution
  - Variational Inference
  - Neural networks
    Neural networks
    
    Dropout
    
    Literature
    
    Regression master
- Concepts
  Concepts
  - Frameworks
  - Linear Algebra Tricks
  - Matrix tricks
  - Key Concepts
  - Splines
  - Calculus
    Calculus
    
    Automatic Differentiation Automatic Differentiation
    Table of contents
    
    Tutorials
    
    Change of Variables
    
    [Identity Trick](https://www.shakirm.com/slides/MLSS2018-Madrid-ProbThinking.pdf)
    
    Inverse Function Theorem
    
    Jensens Inequality
- Density
  Density
  - Density Estimation
  - Conditional Density Estimation
  - Generative Modeling
  - Histograms
  - Logistic Distribution
  - Flows
    Flows
    
    Applications in Earth Science
    
    Gaussinization
    
    HouseHolder Flows
    
    Normalizing Flows Literature
    
    Continuous Mixture CDFs
  - Gaussianization
    Gaussianization
    
    RBIG for Spatial-Temporal Representation Analysis
    
    RBIG 2.0 Ideas
    
    Unscented Transformation
    
    Applications
    Applications
    
    Climate
    
    Demo: Gaussianization
    
    Drought
    
    Spatial temporal
    
    Software
    Software
    
    Coupling Layers
    
    Loss Functions
    
    Marginal Gaussianization
    
    Marginal Uniformization
    
    Refactoring RBIG (RBIG 1.1)
    
    Rotation
    
    Theory
    Theory
    
    Gaussianization
    
    Information Theory Measures
    
    Literature Review
    
    Related Methods
- Gps
  Gps
- Information
  Information
- Kernels
  Kernels
  - Other Distances
  - Kernel Measures of Similarity
  - Density
    Density
    
    Kernel Density Estimation
  - Derivatives
    Derivatives
    
    Overview
  - Similarity
    Similarity
    
    Kernels and Information Measures
    
    Similarity Measures
- Math
  Math
  - Bisection
  - Orthogonal
- Ml
  Ml
  - Multi-Output
- Neural
  Neural
  - Rbig
- Similarity
  Similarity
Blogs
Blogs
- My Blogs
- Ideas
  Ideas
  - Concrete Ideas
  - Blog Ideas
- Posted
  Posted
  - GPs and Uncertain Inputs through the Ages
Projects
Projects
- Overview
- ErrorGPs
  ErrorGPs
  - Overview
  - Gaussian Approximations
  - Code
    Code
    
    Software
  - Overview
    Overview
    
    Basics
    
    Literature Review
    
    Next Steps
  - Taylor Expansion
    Taylor Expansion
    
    Error Propagation
    
    Scratch
    
    Linearized GP
  - Variational
    Variational
    
    Variational Strategies
    
    Egp pyro svgp
    Egp pyro svgp
    
    eSVGP 1D Demo
    
    Egp pyro vgp
    Egp pyro vgp
    
    eVGP 1D Demo
  - Monte carlo
    Monte carlo
    
    MCMC eGP
- Ml4astro
  Ml4astro
- Similarity
  Similarity
  - Overview
Resources
Resources
- My Resources
- Software
- MKDocs Tips
- My WorkFlow
- Reproducibility
- Machine learning
  Machine learning
- Math
  Math
  - Bisection Method
- Python
  Python
  - Python IDEs
  - Interesting Tidbits
  - Code
    Code
    
    Einsum
    
    Large Scale
  - Good code
    Good code
    
    Tutorials
    
    Documentation
    
    Experiments
    
    Git
    
    Good Code
    
    MakeFiles
    
    Pip
    
    Pythonic
    
    Typing
  - Packages
    Packages
    
    Earth-Sci Stuff
    
    Jax
    
    Logging
    
    Pandas
    
    Parallel Programming
    
    PathLib
    
    Plotting Libraries
    
    PyTorch
    
    Scikit-Learn
    
    SQL
  - Remote computing
    Remote computing
    
    Overview
    
    JupyterLab + Slurm
    
    VSCode
  - Software stacks
    Software stacks
    
    Deep Learning
    
    Earth Science
    
    Python Ecosystem
    
    Standard
- Tips
  Tips
  - Cheat Sheets
  - Colab
  - Conda
  - Github
  - Markdown
  - Scikit-Learn
Snippets
Snippets
- My Snippets
- Bash
  Bash
- Bayesian
  Bayesian
  - Error in GPs in Sklearn
- Earth
  Earth
  - Cartesian Coordinates 2 Geocoordinates
  - XArray
- Latex
  Latex
  - PseudoCode
  - Tables
- Markdown
  Markdown
  - Figures
- Ml
  Ml
  - Anomaly Detection
- My configs
  My configs
  - MkDocs
  - Conda
    Conda
    
    Env jax
  - Jlab
    Jlab
    
    Install JupyterLab Stuff
  - Makefile
    Makefile
    
    Make
  - Setups
    Setups
    
    Setup py
- Numpy
  Numpy
- Parallel
  Parallel
- Python
  Python
- Pytorch
  Pytorch
- Scipy
  Scipy
  - The Cholesky Decomposition
- Testing
  Testing
  - PyTest Tricks
  - Tips
- Visualization
  Visualization
  - gifs
  - Matplotlib
    Matplotlib
    
    Colorbars
    
    Legend
    
    Log Scale Plots
    
    Defaults
    
    Styling
  - Xarray
    Xarray
    
    Tif Files
Talks
Talks
Thesis
Thesis
- My Thesis
- Related Publications
- Logistics
- Thesis Outline
- Quotes
- Reproducibility
- My Thesis: A Overview
- Toc
- Chapters
  Chapters
  - 1 introduction
    1 introduction
    
    Earth Science Setting
    
    Machine Learning Setting
    
    1.3 thesis
  - 2 models
    2 models
    
    Sensitivity
    
    Similarity
    
    Uncertainty
  - 3 similarity
    3 similarity
    
    Hybrid Approaches
    
    Kernel Methods
    
    Neural Networks
    
    Randomized
  - 4 information
    4 information
    
    Density
    Density
    
    Overview
    
    Density Estimation
    
    Parametric Gaussianization
    
    Normalizing Flows
    
    Parametric
    
    Rotation-Based Iterative Gaussianization (RBIG)
    
    Information
    Information
    
    Information Theory
    
    TODO
  - 5 applications
    5 applications
    
    Sensitivity Applications
    
    Similarity Applications
    
    Uncertainty Applications
Tutorials
Tutorials
- Tutorials
- Earth sci
  Earth sci
- Gaussian processes
  Gaussian processes
  - ideas
- Jax
  Jax
  - Jax
  - Bisection search
  - Classes
  - Ecosystem
  - Jax Tutorial Ideas
  - Init funcs
  - Jit
  - Optimizing Using Jax
  - VMAP
  - Lab tutorials
    Lab tutorials
    
    Bandwidth Approximation
    
    Kernel Derivatives
    
    Kernel Matrices
    
    MonteCarlo
    
    Pairwise
    
    Resources
- Jupyter vscode
  Jupyter vscode
  - Using Jupyter Notebooks for VSCode Remote Computing
- Manifold learning
  Manifold learning
  - Semisupervised Manifold Alignment
  - 6 laplacian eigenmaps
- Pytorch nns
  Pytorch nns
- Remote computing
  Remote computing
- Tf2
  Tf2
  - Slides
  - Docs
    Docs
    
    Css
    Css
    
    Theme
    Theme
    
    Index
    
    Plugin
    Plugin
    
    Markdown
    Markdown
    
    Markdown Demo

Table of contents

Tutorials

Automatic Differentiation¶

Tutorials¶

Automatic Differentiation - Matthew James Johnson (2017) - Video

Previous Splines

Next Change of Variables

Copyright © 2020 J. Emmanuel Johnson

Made with Material for MkDocs