Lecture 8

Topic

In this lecture you learn what a neural network actually is and implement one from scratch.

Lecture Slides

Download the slides

Exercises

• Exercise 8
• Exercise 8 (solution)

Suggested Homework

• Watch the Video below

• Play around with a different model (e.g. more layers, larger layers)

  • How small can you make the model before it breaks down?

  • Does a larger model help?

• Play around with the hyperparameters of the optimization

Additional materials

3Blue1Brown Video

This excellent Video uses the exact same network you train in the exercises and gives explains it from a slightly different perspective. You should absolutely watch it, ideally before the lecture.