Gradient Descent From Scratch In Python

Published: 10 January 2023
on channel: Dataquest

19,034

435

We'll learn about gradient descent, a technique for training neural networks. We'll then implement gradient descent from scratch in Python, so you can understand how it works. We'll implement gradient descent by training a linear regression model to predict the weather. In future videos, we'll build on this to create complex neural networks!

You can see a full explanation and code here - https://github.com/VikParuchuri/nnet_... .

Chapters
0:00 Introduction
01:49 - Linear Regression Intuition
07:53 - Measuring Loss
15:28 - Parameter Updates
16:11 - Gradients And Partial Derivatives
23:29 - Learning Rate
28:35 - Implement Linear Regression
36:09 - Training Loop

This video is part of our new course, Zero to GPT - a guide to building your own GPT model from scratch. By taking this course, you'll learn deep learning skills from the ground up. Even if you're a complete beginner, you can start with the prerequisites we offer at Dataquest to get you started.

If you're dreaming of building deep learning models, this course is for you.

Best of all, you can access the course for free while it's still in beta!

Sign up today!
https://bit.ly/4016NfK

On this page of the site you can watch the video online Gradient Descent From Scratch In Python with a duration of hours minute second in good quality, which was uploaded by the user Dataquest 10 January 2023, share the link with friends and acquaintances, this video has already been watched 19,034 times on youtube and it was liked by 435 viewers. Enjoy your viewing!

10,660

268