Day 6: Introduction to Optimization

Today we will review the optimization tools required to train Artificial Intelligence and Machine Learning Algorithms. We will cover the theoretical foundations and practical implementaiton of Gradient Descent, Stochastic Gradient Decent, and Momentum.

Task Source Objective
Multidimenstional Logistic Regression Exercises Ex1 Logistics Regression in High Dimensions
Stochastic Gradient Decent Ex2 Logistic Regression with Stochastic Gradient Descent

<
Resourse Link Description
Lecture 6 Optimization Review
Lecture 6 Optimization Review

...
Reading

Chapter 6

The Reading for today's lab is chapter 6 Optimization.

...
Exercises

Chapter 6

Examples and exercise 6.