Backpropagation: Key Algorithm in Machine Learning

Learn about backpropagation, the essential algorithm driving machine learning advancements. 🔍

Backpropagation: Key Algorithm in Machine Learning
Artem Kirsanov
867.5K views • Apr 1, 2024
Backpropagation: Key Algorithm in Machine Learning

About this video

Shortform link:
https://shortform.com/artem

In this video we will talk about backpropagation – an algorithm powering the entire field of machine learning and try to derive it from first principles.

OUTLINE:
00:00 Introduction
01:28 Historical background
02:50 Curve Fitting problem
06:26 Random vs guided adjustments
09:43 Derivatives
14:34 Gradient Descent
16:23 Higher dimensions
21:36 Chain Rule Intuition
27:01 Computational Graph and Autodiff
36:24 Summary
38:16 Shortform
39:20 Outro

USEFUL RESOURCES:
Andrej Karpathy's playlist: https://youtube.com/playlist?list=PLAqhIrjkxbuWI23v9cThsA9GvCAUhRvKZ&si=zBUZW5kufVPLVy9E

Jürgen Schmidhuber's blog on the history of backprop:
https://people.idsia.ch/~juergen/who-invented-backpropagation.html


CREDITS:
Icons by https://www.freepik.com/

Tags and Topics

Browse our collection to discover more content in these categories.

Video Information

Views

867.5K

Likes

35.7K

Duration

40:08

Published

Apr 1, 2024

User Reviews

4.8
(173)
Rate:

Related Trending Topics

LIVE TRENDS

Related trending topics. Click any trend to explore more videos.

Trending Now