NN - 8 - Code a NN from Scratch (with Python + numpy code)
In this video we will code a simple NN using only numpy, and the backpropagation gradients that we calculated in the previous videos.
NN Playlist: https://bit.ly/3PvvYSF
Become a member and get full access to this online course:
https://meerkatstatistics.com/courses...
** 🎉 Special YouTube 60% Discount on Yearly Plan – valid for the 1st 100 subscribers; Voucher code: First100 🎉 **
"NN with Python" Course Outline:
Intro
Administration
Intro - Long
Notebook - Intro to Python
Notebook - Intro to PyTorch
Comparison to other methods
Linear Regression vs. Neural Network
Logistic Regression vs. Neural Network
GLM vs. Neural Network
Expressivity / Capacity
Hidden Layers: 0 vs. 1 vs. 2+
Training
Backpropagation - Part 1
Backpropagation - Part 2
Implement a NN in NumPy
Notebook - Implementation redo: Classes instead of Functions (NumPy)
Classification - Softmax and Cross Entropy - Theory
Classification - Softmax and Cross Entropy - Derivatives
Notebook - Implementing Classification (NumPy)
Autodiff
Automatic Differentiation
Forward vs. Reverse mode
Symmetries in Weight Space
Tanh & Permutation Symmetries
Notebook - Tanh, Permutation, ReLU symmetries
Generalization
Generalization and the Bias-Variance Trade-Off
Generalization Code
L2 Regularization / Weight Decay
DropOut regularization
Notebook - DropOut (PyTorch)
Notebook - DropOut (NumPy)
Notebook - Early Stopping
Improved Training
Weight Initialization - Part 1: What NOT to do
Notebook - Weight Initialization 1
Weight Initialization - Part 2: What to do
Notebook - Weight Initialization 2
Notebook - TensorBoard
Learning Rate Decay
Notebook - Input Normalization
Batch Normalization - Part 1: Theory
Batch Normalization - Part 2: Derivatives
Notebook - BatchNorm (PyTorch)
Notebook - BatchNorm (NumPy)
Activation Functions
Classical Activations
ReLU Variants
Optimizers
SGD Variants: Momentum, NAG, AdaGrad, RMSprop, AdaDelta, Adam, AdaMax, Nadam - Part 1: Theory
SGD Variants: Momentum, NAG, AdaGrad, RMSprop, AdaDelta, Adam, AdaMax, Nadam - Part 2: Code
Auto Encoders
Variational Auto Encoders
If you’re looking for statistical consultation, work on interesting projects, or training workshop, visit my website https://meerkatstatistics.com/ or contact me directly at david@meerkatstatistics.com
~~~~~ SUPPORT ~~~~~
Paypal me: https://paypal.me/MeerkatStatistics
~~~~~~~~~~~~~~~~~
Intro/Outro Music: Dreamer - by Johny Grimes
• Johny Grimes - Dreamer
Auf dieser Seite können Sie das Online-Video NN - 8 - Code a NN from Scratch (with Python + numpy code) mit der Dauer stunde minuten sekunde in guter Qualität ansehen, das der Benutzer Meerkat Statistics 27 Mai 2022 hochgeladen hat, den Link mit Freunden und Bekannten teilen, dieses Video wurde auf Youtube bereits 900 Mal angesehen und es wurde von 12 den Zuschauern gefallen. Viel Spaß beim Betrachtenden Zuschauern gefallen!
