Gradient Descent

Machine Learning

Gradient Descent Explained Simply

In this video, learn about Gradient Descent and how we can use it to update the weights and bias of our AI model. Time Stamps 00:00 – what is gradient descent? 00:37 – gradient descent vs perception 01:04 – sigmoid activation function 01:45 – bias and threshold 02:06 – weighted sum – working example 02:37 […]

Read More
AI Security

Defense Against Adversarial Attacks

Siraj Raval just posted this video on defending AI against adversarial attacks Machine Learning technology isn’t perfect, it’s vulnerable to many different types of attacks! In this episode, I’ll explain 2 common types of attacks and 2 common types of defenses using various code demos from across the Web. There’s some really dope mathematics involved […]

Read More
AI Data Science Machine Learning

A Step-by-Step Look at Gradient Descent

Gradient Descent is the workhorse behind much of Machine Learning. When you fit a machine learning method to a training dataset, you’re almost certainly using Gradient Descent. The process can optimize parameters in a wide variety of settings. Since it’s so fundamental to Machine Learning, Josh Starmer of StatQuest decided to make a “step-by-step” video […]

Read More
Machine Learning

How Gradient Descent Helps Neural Networks Learn

3Blue1Brown has a great video exploring neural networks and the important role that gradient descent plays in machine learning.

Read More