Skip to content
Research Journal
PyTorch Ideas
Initializing search
jejjohnson/research_journal
Research Journal
jejjohnson/research_journal
Overview
Definitions
Logistics
Explorers
Explorers
Explorers
BNNs
BNNs
Bayesian Neural Networks Working Group
Sidebar
Code
Code
Programming Exercises
Resources
Software
My notes
My notes
TensorFlow 2.0
Packages
Packages
Numpyro
Pyro
Other
Other
Explorers Group: TF 2.X and PyTorch for not so Dummies
Key Figures
Controversy
Videos
Prezis
Prezis
TF2.X and PyTorch
Theory
Theory
Index
Optimization
Papers
Neural Networks with Uncertainty
Resources
State-of-the-Art
Neural Networks with Uncertainty
Videos
Starspots
Starspots
StarSpots
Appendix
Appendix
My Appendices
Bayesian
Bayesian
Exponential Family of Distributions
Gaussian
Solving Hard Integral Problems
Bayesian: Language of Uncertainty
Kernel Density Estimation
KL Divergence
Mixture Models
Monte Carlo
PDF Estimation
PDF Estimation
Regression
Uniform Distribution
Variational Inference
Neural networks
Neural networks
Dropout
Literature
Regression master
Concepts
Concepts
Frameworks
Linear Algebra Tricks
Matrix tricks
Key Concepts
Splines
Calculus
Calculus
Automatic Differentiation
Change of Variables
[Identity Trick](https://www.shakirm.com/slides/MLSS2018-Madrid-ProbThinking.pdf)
Inverse Function Theorem
Jensens Inequality
Density
Density
Density Estimation
Conditional Density Estimation
Generative Modeling
Histograms
Logistic Distribution
Flows
Flows
Applications in Earth Science
Gaussinization
HouseHolder Flows
Normalizing Flows Literature
Continuous Mixture CDFs
Gaussianization
Gaussianization
RBIG for Spatial-Temporal Representation Analysis
RBIG 2.0 Ideas
Unscented Transformation
Applications
Applications
Climate
Demo: Gaussianization
Drought
Spatial temporal
Software
Software
Coupling Layers
Loss Functions
Marginal Gaussianization
Marginal Uniformization
Refactoring RBIG (RBIG 1.1)
Rotation
Theory
Theory
Gaussianization
Information Theory Measures
Literature Review
Related Methods
Gps
Gps
Basic GP
Sparse Gaussian Processes
GPs and Uncertain Inputs through the Ages
Uncertainty of GPs: Taylor Expansion
Variational GPs
Gaussian Dists. and GPs
SOTA GPs
Information
Information
Entropy
Exponential Family of Solutions
Gaussian Distribution
Information
Information
Information Bottleneck
Information Theory Measures Estimators
Information Theory Measures
KLD
K-Nearest Neighbors Estimator
Main
Mutual Information
Probability Density Function Estimators
Variation of Information
Kernels
Kernels
Other Distances
Kernel Measures of Similarity
Density
Density
Kernel Density Estimation
Derivatives
Derivatives
Overview
Similarity
Similarity
Kernels and Information Measures
Similarity Measures
Math
Math
Bisection
Orthogonal
Ml
Ml
Multi-Output
Neural
Neural
Rbig
Similarity
Similarity
Overview
What is Similarity?
Distances
HSIC
MMD
RV Coefficient
Taylor Diagram (1D Data)
Taylor Diagram (2D Data)
Variation of Information
Blogs
Blogs
My Blogs
Ideas
Ideas
Concrete Ideas
Blog Ideas
Posted
Posted
GPs and Uncertain Inputs through the Ages
Projects
Projects
Overview
ErrorGPs
ErrorGPs
Overview
Gaussian Approximations
Code
Code
Software
Overview
Overview
Basics
Literature Review
Next Steps
Taylor Expansion
Taylor Expansion
Error Propagation
Scratch
Linearized GP
Variational
Variational
Variational Strategies
Egp pyro svgp
Egp pyro svgp
eSVGP 1D Demo
Egp pyro vgp
Egp pyro vgp
eVGP 1D Demo
Monte carlo
Monte carlo
MCMC eGP
Ml4astro
Ml4astro
Index
Bayesian Neural Networks
Physics-Based Model
Similarity
Similarity
Overview
Resources
Resources
My Resources
Software
MKDocs Tips
My WorkFlow
Reproducibility
Machine learning
Machine learning
Machine Learning
Bayesian ML
Recommended Books
Class Notes
Deep Learning
Interpretable Machine Learning
Neural Networks
Physic-Informed Machine Learning
Statistics
Math
Math
Bisection Method
Python
Python
Python IDEs
Interesting Tidbits
Code
Code
Einsum
Large Scale
Good code
Good code
Tutorials
Documentation
Experiments
Git
Good Code
MakeFiles
Pip
Pythonic
Typing
Packages
Packages
Earth-Sci Stuff
Jax
Logging
Pandas
Parallel Programming
PathLib
Plotting Libraries
PyTorch
Scikit-Learn
SQL
Remote computing
Remote computing
Overview
JupyterLab + Slurm
VSCode
Software stacks
Software stacks
Deep Learning
Earth Science
Python Ecosystem
Standard
Tips
Tips
Cheat Sheets
Colab
Conda
Github
Markdown
Scikit-Learn
Snippets
Snippets
My Snippets
Bash
Bash
Arguments in Scripts
Loops
Makefile Arguments
Running Subsequent Scripts
Bayesian
Bayesian
Error in GPs in Sklearn
Earth
Earth
Cartesian Coordinates 2 Geocoordinates
XArray
Latex
Latex
PseudoCode
Tables
Markdown
Markdown
Figures
Ml
Ml
Anomaly Detection
My configs
My configs
MkDocs
Conda
Conda
Env jax
Jlab
Jlab
Install JupyterLab Stuff
Makefile
Makefile
Make
Setups
Setups
Setup py
Numpy
Numpy
Bisection
Efficient Euclidean Distance Calculation - Numpy Einsum
Add every n values in array
Optimized RBF kernel using `numexpr`
Parallel
Parallel
Embarrassingly Parallel Workloads
Hyperparameter Optimization
Large predict
Parallel Processing
Pipelines
Python
Python
Conda
My Typical Conda Environments
Dictionaries to Lists
Tricks with Lists
Named Tuples
Paths
My Setup File
Pytorch
Pytorch
Device Agnostic
Histograms in PyTorch
Interpolating in PyTorch
KeOps - Gaussian Kernel
Loops with TQDM
Multi kernel
PyTorch Tensors 2 Numpy Adaptors
Pytorch lightning
Rbf kernel
Scipy
Scipy
The Cholesky Decomposition
Testing
Testing
PyTest Tricks
Tips
Visualization
Visualization
gifs
Matplotlib
Matplotlib
Colorbars
Legend
Log Scale Plots
Defaults
Styling
Xarray
Xarray
Tif Files
Talks
Talks
My Talks
KERMES Meetup 2018
AGU 2019
Phi Week 2019
Phi Week 2019
Fast Friday Talk
KERMES Meetup 2020
Fast Friday Talk
Thesis
Thesis
My Thesis
Related Publications
Logistics
Thesis Outline
Quotes
Reproducibility
My Thesis: A Overview
Toc
Chapters
Chapters
1 introduction
1 introduction
Earth Science Setting
Machine Learning Setting
1.3 thesis
2 models
2 models
Sensitivity
Similarity
Uncertainty
3 similarity
3 similarity
Hybrid Approaches
Kernel Methods
Neural Networks
Randomized
4 information
4 information
Density
Density
Overview
Density Estimation
Parametric Gaussianization
Normalizing Flows
Parametric
Rotation-Based Iterative Gaussianization (RBIG)
Information
Information
Information Theory
TODO
5 applications
5 applications
Sensitivity Applications
Similarity Applications
Uncertainty Applications
Tutorials
Tutorials
Tutorials
Earth sci
Earth sci
Earth Science Tools
Ideas
Esdc streaming
Gaussian processes
Gaussian processes
ideas
Jax
Jax
Jax
Bisection search
Classes
Ecosystem
Jax Tutorial Ideas
Init funcs
Jit
Optimizing Using Jax
VMAP
Lab tutorials
Lab tutorials
Bandwidth Approximation
Kernel Derivatives
Kernel Matrices
MonteCarlo
Pairwise
Resources
Jupyter vscode
Jupyter vscode
Using Jupyter Notebooks for VSCode Remote Computing
Manifold learning
Manifold learning
Semisupervised Manifold Alignment
6 laplacian eigenmaps
Pytorch nns
Pytorch nns
NN from scratch
Refactoring
Sweeps using Weights and Biases
PyTorch Ideas
PyTorch Ideas
Table of contents
1. Neural Networks from scratch
2.
PyTorch Lightning
Remote computing
Remote computing
Copying Files
Documentation
Remote Machines: JupyterLab + VSCode
Tf2
Tf2
Slides
Docs
Docs
Css
Css
Theme
Theme
Index
Plugin
Plugin
Markdown
Markdown
Markdown Demo
Table of contents
1. Neural Networks from scratch
2.
PyTorch Ideas
¶
1. Neural Networks from scratch
¶
BNN
2.
¶