A set of notes to catalogue my progress in applying AI for climate attributions.
High-Level Table of Contents¶
Introduction¶
In this section, you’ll find:
- Problem Definition (TODO) you’ll find a brief overview of the problem of climate attribution.
- literature review (TODO) for all papers related to the problem with a particular focus on the problem definition side and statistical modeling side.
- project proposals - outlines some (everchanging) proposed ideas with a set of goals that I want to accomplish within the project.
Conceptual¶
In this section, you’ll find a brief outline of some ideas I deem conceptual important to understand from on an abstract level.
- extreme value theory - I go over some of the important theorems and concepts.
- evaluating the extreme value family distribution - I go over some of the staple methods for analysis and evaluation for these types of distributions and parameter estimation.
- Bayesian modeling - I outline some important concepts of Bayes rule. I also include hierarchical Bayesian models which will be an important for this work.
- Bayesian inference - I do an overview of some of the staple methods for finding the best parameters.
Data¶
In this section, you’ll find a some sections related to the type of data we will be using for this study and some of the properties. In general, we will be working with global or regional spatiotemporal EO data. However, there are some nuances to the type.
- Datasets - outlines some of the staple datasets to be used within this study. It includes the CMIPX and ERA5 datasets. I also distinguish some defining characteristics for example the idea of simulation versus reanalysis.
- Data Access - outlines how one can quickly access the datasets using python. This will be particularly useful for individuals who don’t have a lot of resources and quickly want to prototype different methods without having to download the entire dataset.
Modeling¶
In this section, you’ll find some sections related to the modeling aspects detailing how we actually implement some of the conceptual aspects in practice.
- Features (Manually) - outlines how we can manually extract features from our spatiotemporal dataset. These are typically “classical methods” done historically and are coupled with simple models.
- Features (Learned) - outlines how we can learn the features directly from data. It offers some alternatives to manually extracting features. Many of these methods are very common within the machine learning community.
- Software - outlines some software that we can use to accomplish some of the data processing, feature extraction, modeling, and evaluation.
Cookbook¶
In this section, you’ll find some sections with recipes with a bit more detail on how we can accomplish specific tasks. These will be used as reference for things outlined in other sections.
- Filtering EO Data - outlines how we can manually filter spatiotemporal data to remove high variations.
- EO Data Anomalies - outlines how we can manually extract anomalies from spatiotemporal data.
- Spatial Averaging - outlines how we can aggregate the spatial dimension of spatiotemporal data to extract a single time series or patches of time series.