Neural Networks

Neural Networks

What are Activation Functions?

Did you ever wonder what activation functions are? Then watch this video to find out. The script to this video was AI generated as was the presenter. Ironically, I did the grunt work of editing, mixing audio, and rendering the final product. Soon, there’ll be an AI for that, too.

Read More
AI Neural Networks

Introduction to transformer architecture and discussion

Phillip Isola and Brian Cheung of MIT provide an informal discussion that provides an overview of transformer networks and then we will open the floor for questions and discussion.

Read More
Neural Networks

How can Neural Networks learn (almost) anything

They seem magical, but the functioning of neural networks is real and fantastic. A video about neural networks, how they work, and why they’re useful.

Read More
Hardware Neural Networks

Running Neural Networks on Meshes of Light

Photonics are not just for quantum computers apparently. Could we be on the precipice of a new hardware paradigm?

Read More
AI Neural Networks

How Deep Neural Networks Work

This is part of the End-to-End Machine Learning School Course 193, How Neural Networks Work at https://e2eml.school/193

Read More
Neural Networks Python

Building a neural network FROM SCRATCH (no Tensorflow/Pytorch, just numpy & math)

Watch the video and check out the Kaggle notebook with all the code.

Read More
AI Neural Networks

Developer Tech Minutes: Swin Transformer

Microsoft researchers developed Swin Transformer, a new model architecture that has significantly outperformed previous dominant convolutional neural networks on broad vision problems. In version 2 of Swin Transformer, they then joined this new architecture with a new learning approach, known as SimMIM, or “A Simple Framework for Masked Image Modeling.” In this Tech Minutes episode, […]

Read More
AI Neural Networks

Transfer learning and Transformer models (ML Tech Talks)

In this session of Machine Learning Tech Talks, Software Engineer from Google Research, Iulia Turc, will walk us through the recent history of natural language processing, including the current state of the art architecture, the Transformer.

Read More