## L2 regularization intuition

Posted on Sun 22 January 2023 in Mathematics • Tagged with Mathematics, Machine Learning, Deep Learning

A nice intuition for L2 regularization comes from having a prior on the distribution of parameters: the prior assumes that the parameters are close to zero. Let's assume that the prior is $\mathcal{N}(0, \Sigma)$. The MAP estimate of the parameters would then be

\begin{align} \theta_{\text{MAP …

## Optimizers, Part 1

Posted on Mon 02 January 2023 in Programming • Tagged with Programming, Machine Learning, Deep Learning

Happy New Year! This is going to was supposed to be a long one, so sit back and grab a chocolate (and preferably view this on your laptop)

Some optimization algorithms. Click on a colour in the legend to hide/show it

## My DL workflow for 2023

Posted on Thu 29 December 2022 in Programming • Tagged with Programming, Machine Learning, Deep Learning

I've kind of zeroed down on Deep Learning at this point, and putting my money where my mouth is, will be taking both COL772 (Natural Language Processing) and COL775 (Deep Learning) next semester.

Along with Operating Systems, Parallel Programming and Theory of Computation.

## Why a workflow?

I'll need to train …