Application Track¶
Overview¶
Extreme Values Modeling
The first application track we have are looking at extreme values.
This allows us to slowly introduce some core concepts that will be useful in the later application tracks.
DsΩΔtDy=[Altitude, Longitude, Latitude]=[Unstructured Weather Stations]={Daily, Hourly}=[Temperature, Precipitation, Wind Speed]
Sea Surface Mapping
The second application track is working with sea surface mapping of variables like temperature, height, and ocean colour.
In this setting, we will deal with how to transform between different geometries like the alongtrack satellite observations and the regular gridded applications.
These measurements feature a lot of missing values, so we will learn how to deal with this.
The bulk of this application will involve learning-to-learn, whereby we find various ways to learn prior models
DsΩΔtDy=[Depth, Longitude, Latitude]=[Irregular Along Track, Regular Gridded]={Daily, Hourly}=[Temperature, Height, Salinity, Colour]
Instrument-2-Instrument Translation
In this third application track, we will investigate how we can apply a method to translate one type of satellite to another type of satellite.
Here, we have to do all tasks including interpolation, X-casting, and variable transformation.
The interpolation component is due to the non-consistent geometry amongst the satellites.
The X-casting component comes from the
We also have to deal with a
DsΩΔtDy=[Height, Longitude, Latitude]=[Irregular Polar-Orbiting Satellite, Regular Geostationary Satellite]={Days, 15 Minutes}=[Spectral Signature]
Break Down¶
Here, we have a breakdown of how we will structure the application section.
We will analyse the data which will be used to learn.
Then, we will do whatever interpolation or discretization necessary to transform it to the form we want.
Then, we will do some parameter estimation to learn a representation of the system.
Lastly, we will do state estimation using whichever form is
- Data Acquisition - GPs, Simulations, L1 Data, L2 Data, L3 Data
- Interpolation & Discretization - Histograms, Nearest Neighbors, Gaussian Processes
- Learning Priors - Gaussian Processes, L2 Data, L3 Data, Simulations
- Parameter Estimation - Representation Learning, Dynamical Systems
- State Estimation - 3DVar, Strong-Constrained 4D Var, Weak-Constrained 4DVar, Deep Equillibrium
Walk-Through¶
For each of these sections
Download EO Data¶
Examples: Sea Surface Height/Temperature/Salinity, Satellite Data, Weather Stations
LS Data:L1 Data:L2 Data:L3 Data:L4 Data:[GP Priors,Simulations][Weather Stations,ARGO Floats,Satellite][Interpolated Data][Reanalysis][Reanalysis]
Discretizations¶
Examples: Histogram, Nearest Neighbours, Radius Neighbours, Kernel Density Estimation
p(y1:T,θ)=n=1∏NTp(yt∣θ)p(θ∣sn,tn)
Functional Regression¶
Examples: Nearest Neighbors, Gaussian Processes, Neural Fields
p(y1:N,s1:N,t1:N,θ)=p(θ)n=1∏NTp(yn∣sn,tn,θ)
Param. Est. - GP Priors¶
Examples: RBF, Matern
Joint:Posterior:p(f,α,z,θ)q(α,z,f,θ)=p(f∣z)p(z∣α,θ)p(θ)=q(α)n=1∏Nq(z∣f,α)
State Estimation
q(y1:T,z1:T∗,α∗,θ)=q(θ∗)q()
Param. Est. - Simulations¶
Param. Est. - Spatial Field Priors¶
Joint:Posterior:p(y,z,θ)q(z,y,θ)=p(θ)n=1∏Np(yn∣zn)p(zn∣θ)=q(θ)n=1∏Nq(z∣y,θ)
State Estimation¶
q(z,y,θ)=q(z∣θ,ϕ∗)q(θ∣ϕ∗)
Equilibrium Models¶
z∗=f(z∗,y,x,θ)
Param. Est. - Strong-Constrained Dynamical Priors¶
Joint:Variational:p(y1:T,z0:T,θ)q(z0:T,y1:T,θ)=p(θ)p(z0)n=1∏Np(yt∣zt,θ)=q(θ)q(z0)n=1∏Nq(zt∣yt,θ)
State Estimation¶
Param. Est. - Weak-Constrained Dynamical Prior¶
Joint:Variational:p(y1:T,z0:T,θ)q(z0:T,y1:T,θ)=p(θ)p(z0)n=1∏Np(yt∣zt)p(zt∣zt−1,θ)=q(θ)q(z0)n=1∏Nq(zt∣zt−1,yt)q(zt∣zt−1,θ)
State Estimation¶
q(y1:T,z1:T∗,θ∗)=q(θ∗)q(z0∗)t=1∏Tq(zt∣zt−1,yt) We download some
Applications¶
Extreme Values.
Here, we learn how we can estimate the parameters of a model for extreme values.
Ocean Surface Height.
We will learn how to create mapping products for Sea Surface Height (SSH) and Sea Surface Temperature (SST).
Instrument-2-Instrument.
We will learn how to map one set of spatio-spectral channels to a different spatio-spectral channels.
Application I - Extremes¶
In this application, we are interested in modeling temperatures, and in particular, temperature extremes.
Datasets.
We will use some standard datasets that are found within the AEMET database.
D={(tn,sn),xn,yn}n=1N,yn∈RDyxn∈RDysn∈RDstn∈R+ - Covariante, xn
- Global Mean Surface Temperature Anomaly (GMSTA)
- Measurement, yn:
- Daily Mean Temperature (TMax)
- Daily Maximum Temperature (TMean)
Extreme Events.
D={yn}n=1N We will use some standard techniques to extract the extreme events from the time series.
- Block Maximum (BM)
- Peak-Over-Threshold (POT)
- Temporal Point Process (TPP)
Data Likelihood.
y∼p(y∣z) We need to decide which likelihood we want to use.
For the mean data, we can assume that it follows a Gaussian distribution or a long-tailed T-Student distribution.
However, for the maximum values, we need to assume an EVD like the GEVD, GPD or TPP.
- Mean -> Gaussian, T-Student
- Maximum -> GEVD, GPD, TPP
Parameterizations.
p(y,z,θ)=p(y∣z)p(z∣θ)p(θ) We have to decide the parameterization we wish to use.
- IID
- Hierarchical
- Strong-Constrained Dynamical, i.e., Neural ODE/PDE
- Weak-Constrained Dynamical, i.e., SSM, EnsKF
State Estimation
z∗(θ)=argminJ(z;θ) - Weak-Constrained
- Gradient-Based - 4DVar
- Derivative-Free - Ensemble Kalman Filter
- Minimization-Based - DEQ
Predictions
u∼p(u∣z∗)p(z∗∣D) Our final task is to use a our new model to make predictions.
- Feature Representation
- Interpolation
- HindCasting
- Forecasting
Application II - Sea Surface Height Mapping¶
In this application, we will investigate different ways that we can create maps of sea surface height (SSH).