Math-of-Intelligence

Solutions to Siraj Raval's Math of Intelligence course.

Week 1 - Gradient Descent

Implemented gradient descent with linear regression and support vector machine in numpy, with matplotlib visualisations.

Week 2 - Second Order Optimization

Implemented Newton's Method for second order optimization and batch gradient descent, demonstrated with logistic regression.

Week 3 - L1 and L2 Regularization

Implemented L1 and L2 Normalization on a linear regression model.

Week 4 - Self-Organizing Feature Maps

Implemented Kohonen's Self-Organizing Feature Maps for unsupervised learning of RGB and MNIST dataset.

Week 5 - Principle Component Analysis

Implemented Principle Component Analysis for compression of facial images - 'eigenfaces'.