Large Scale

Tutorials

Small Big Data

These are tutorials to see how we can

• Small Big Data: Using Numpy and Pandas when your data doesn't fit - Itamar Turner-Trauring - (PyCon 2020)
• Dask - Youtube Page | Matthew Playlist

Packages

Vaex

This is an out-of-core dataframes library for Python, ML and visualization. This is sort of like pandas with some built-in functions. It also plays well with scikit-learn.

• Train 1 Billion Samples with Vaex and Scikit-Learn