Machine Learning Whirlwind Tour

CNRS
MEOM

Table 1:This table showcases a few ways to parameterize a model.

ParameterizationEquation
LinearWx+b\mathbf{Wx} + \mathbf{b}
Basis FunctionWϕ(x)+b\mathbf{W}\boldsymbol{\phi}(\mathbf{x})+\mathbf{b}
Non-Linear Functionσ(Wx+b)\sigma\left(\mathbf{Wx}+\mathbf{b}\right)
Neural Networkσ(Wx+b)\sigma\left(\mathbf{Wx}+\mathbf{b}\right)
Functionalp(f())GPp(\boldsymbol{f}(\cdot))\sim \mathcal{GP}