Skip to content

Research Journal Hyperparameter Optimization

Initializing search

jejjohnson/research_journal

Research Journal

jejjohnson/research_journal

Overview
Definitions
Logistics
Explorers
Explorers
- Explorers
- BNNs
  BNNs
  - Bayesian Neural Networks Working Group
  - Sidebar
  - Code
    Code
    
    Programming Exercises
    
    Resources
    
    Software
    
    My notes
    My notes
    
    TensorFlow 2.0
    
    Packages
    Packages
    
    Numpyro
    
    Pyro
  - Other
    Other
    
    Explorers Group: TF 2.X and PyTorch for not so Dummies
    
    Key Figures
    
    Controversy
    
    Videos
  - Prezis
    Prezis
    
    TF2.X and PyTorch
  - Theory
    Theory
    
    Index
    
    Optimization
    
    Papers
    
    Neural Networks with Uncertainty
    
    Resources
    
    State-of-the-Art
    
    Neural Networks with Uncertainty
    
    Videos
- Starspots
  Starspots
  - StarSpots
Appendix
Appendix
- My Appendices
- Bayesian
  Bayesian
  - Exponential Family of Distributions
  - Gaussian
  - Solving Hard Integral Problems
  - Bayesian: Language of Uncertainty
  - Kernel Density Estimation
  - KL Divergence
  - Mixture Models
  - Monte Carlo
  - PDF Estimation
  - PDF Estimation
  - Regression
  - Uniform Distribution
  - Variational Inference
  - Neural networks
    Neural networks
    
    Dropout
    
    Literature
    
    Regression master
- Concepts
  Concepts
- Density
  Density
  - Density Estimation
  - Conditional Density Estimation
  - Generative Modeling
  - Histograms
  - Logistic Distribution
  - Flows
    Flows
    
    Applications in Earth Science
    
    Gaussinization
    
    HouseHolder Flows
    
    Normalizing Flows Literature
    
    Continuous Mixture CDFs
  - Gaussianization
    Gaussianization
    
    RBIG for Spatial-Temporal Representation Analysis
    
    RBIG 2.0 Ideas
    
    Unscented Transformation
    
    Applications
    Applications
    
    Climate
    
    Demo: Gaussianization
    
    Drought
    
    Spatial temporal
    
    Software
    Software
    
    Coupling Layers
    
    Loss Functions
    
    Marginal Gaussianization
    
    Marginal Uniformization
    
    Refactoring RBIG (RBIG 1.1)
    
    Rotation
    
    Theory
    Theory
    
    Gaussianization
    
    Information Theory Measures
    
    Literature Review
    
    Related Methods
- Gps
  Gps
- Information
  Information
- Kernels
  Kernels
  - Other Distances
  - Kernel Measures of Similarity
  - Density
    Density
    
    Kernel Density Estimation
  - Derivatives
    Derivatives
    
    Overview
  - Similarity
    Similarity
    
    Kernels and Information Measures
    
    Similarity Measures
- Math
  Math
  - Bisection
  - Orthogonal
- Ml
  Ml
  - Multi-Output
- Neural
  Neural
  - Rbig
- Similarity
  Similarity
Blogs
Blogs
- My Blogs
- Ideas
  Ideas
  - Concrete Ideas
  - Blog Ideas
- Posted
  Posted
  - GPs and Uncertain Inputs through the Ages
Projects
Projects
- Overview
- ErrorGPs
  ErrorGPs
  - Overview
  - Gaussian Approximations
  - Code
    Code
    
    Software
  - Overview
    Overview
    
    Basics
    
    Literature Review
    
    Next Steps
  - Taylor Expansion
    Taylor Expansion
    
    Error Propagation
    
    Scratch
    
    Linearized GP
  - Variational
    Variational
    
    Variational Strategies
    
    Egp pyro svgp
    Egp pyro svgp
    
    eSVGP 1D Demo
    
    Egp pyro vgp
    Egp pyro vgp
    
    eVGP 1D Demo
  - Monte carlo
    Monte carlo
    
    MCMC eGP
- Ml4astro
  Ml4astro
- Similarity
  Similarity
  - Overview
Resources
Resources
- My Resources
- Software
- MKDocs Tips
- My WorkFlow
- Reproducibility
- Machine learning
  Machine learning
- Math
  Math
  - Bisection Method
- Python
  Python
  - Python IDEs
  - Interesting Tidbits
  - Code
    Code
    
    Einsum
    
    Large Scale
  - Good code
    Good code
    
    Tutorials
    
    Documentation
    
    Experiments
    
    Git
    
    Good Code
    
    MakeFiles
    
    Pip
    
    Pythonic
    
    Typing
  - Packages
    Packages
    
    Earth-Sci Stuff
    
    Jax
    
    Logging
    
    Pandas
    
    Parallel Programming
    
    PathLib
    
    Plotting Libraries
    
    PyTorch
    
    Scikit-Learn
    
    SQL
  - Remote computing
    Remote computing
    
    Overview
    
    JupyterLab + Slurm
    
    VSCode
  - Software stacks
    Software stacks
    
    Deep Learning
    
    Earth Science
    
    Python Ecosystem
    
    Standard
- Tips
  Tips
  - Cheat Sheets
  - Colab
  - Conda
  - Github
  - Markdown
  - Scikit-Learn
Snippets
Snippets
- My Snippets
- Bash
  Bash
- Bayesian
  Bayesian
  - Error in GPs in Sklearn
- Earth
  Earth
  - Cartesian Coordinates 2 Geocoordinates
  - XArray
- Latex
  Latex
  - PseudoCode
  - Tables
- Markdown
  Markdown
  - Figures
- Ml
  Ml
  - Anomaly Detection
- My configs
  My configs
  - MkDocs
  - Conda
    Conda
    
    Env jax
  - Jlab
    Jlab
    
    Install JupyterLab Stuff
  - Makefile
    Makefile
    
    Make
  - Setups
    Setups
    
    Setup py
- Numpy
  Numpy
- Parallel
  Parallel
- Python
  Python
- Pytorch
  Pytorch
- Scipy
  Scipy
  - The Cholesky Decomposition
- Testing
  Testing
  - PyTest Tricks
  - Tips
- Visualization
  Visualization
  - gifs
  - Matplotlib
    Matplotlib
    
    Colorbars
    
    Legend
    
    Log Scale Plots
    
    Defaults
    
    Styling
  - Xarray
    Xarray
    
    Tif Files
Talks
Talks
Thesis
Thesis
- My Thesis
- Related Publications
- Logistics
- Thesis Outline
- Quotes
- Reproducibility
- My Thesis: A Overview
- Toc
- Chapters
  Chapters
  - 1 introduction
    1 introduction
    
    Earth Science Setting
    
    Machine Learning Setting
    
    1.3 thesis
  - 2 models
    2 models
    
    Sensitivity
    
    Similarity
    
    Uncertainty
  - 3 similarity
    3 similarity
    
    Hybrid Approaches
    
    Kernel Methods
    
    Neural Networks
    
    Randomized
  - 4 information
    4 information
    
    Density
    Density
    
    Overview
    
    Density Estimation
    
    Parametric Gaussianization
    
    Normalizing Flows
    
    Parametric
    
    Rotation-Based Iterative Gaussianization (RBIG)
    
    Information
    Information
    
    Information Theory
    
    TODO
  - 5 applications
    5 applications
    
    Sensitivity Applications
    
    Similarity Applications
    
    Uncertainty Applications
Tutorials
Tutorials
- Tutorials
- Earth sci
  Earth sci
- Gaussian processes
  Gaussian processes
  - ideas
- Jax
  Jax
  - Jax
  - Bisection search
  - Classes
  - Ecosystem
  - Jax Tutorial Ideas
  - Init funcs
  - Jit
  - Optimizing Using Jax
  - VMAP
  - Lab tutorials
    Lab tutorials
    
    Bandwidth Approximation
    
    Kernel Derivatives
    
    Kernel Matrices
    
    MonteCarlo
    
    Pairwise
    
    Resources
- Jupyter vscode
  Jupyter vscode
  - Using Jupyter Notebooks for VSCode Remote Computing
- Manifold learning
  Manifold learning
  - Semisupervised Manifold Alignment
  - 6 laplacian eigenmaps
- Pytorch nns
  Pytorch nns
- Remote computing
  Remote computing
- Tf2
  Tf2
  - Slides
  - Docs
    Docs
    
    Css
    Css
    
    Theme
    Theme
    
    Index
    
    Plugin
    Plugin
    
    Markdown
    Markdown
    
    Markdown Demo

Hyperparameter Optimization¶

Hyperparameter optimization with Dask
Scale sklearn for Small Data Problems

Previous Embarrassingly Parallel Workloads

Next Large predict

Copyright © 2020 J. Emmanuel Johnson

Made with Material for MkDocs