Introduction to Machine Learning - TAU Assignments

This repository contains my solutions to the assignments of the Introduction to Machine Learning course at Tel Aviv University (course number: 0368-3235) taken in the second semester of 2022, taught by Prof. Amir Globerson.

Assignments

• Assignment 1
• Assignment 2
• Assignment 3
• Assignment 4

Assignment 1

• Theoretical Assignment

  • 1.1. Linear Algebra
  • 1.2. Calculus and Probability
  • 1.3. Optimal Classifiers and Decision Rules

• Programming Assignment

  • 1 (a) Visualizing the Hoeffding bound
  • 1 (b) Nearest Neighbor

Assignment 2

• Theoretical Assignment

  • 2.1. Step-size Perceptron
  • 2.2. Convex functions
  • 2.3. Ranking
  • 2.4. Gradient Descent on Smooth Functions

• Programming Assignment

  • 2 (a) Union Of Intervals

Assignment 3

• Theoretical Assignment

  • 3.1. PAC learnability of ℓ2-balls around the origin
  • 3.2. PAC in Expectation
  • 3.3. Union Of Intervals
  • 3.4. Prediction by polynomials

• Programming Assignment

  • 3 (a) SGD for Hinge loss
  • 3 (b) SGD for log-loss

Assignment 4

• Theoretical Assignment

  • 4.1. SVM with multiple classes
  • 4.2. Expressivity of ReLU networks
  • 4.3. Soft SVM with ℓ2 penalty
  • 4.4. Gradient of cross-entropy loss over softmax

• Programming Assignment

  • 4 (a) Neural Networks
  • 4 (b) Training a deep Convolutional Neural Network