Neural Networks

AI Neural Networks

Unveiling the Power of ONNX: The Keystone of Interoperable AI Models

The Open Neural Network Exchange (ONNX) format emerges as a pivotal innovation, fostering interoperability among AI models. As the AI landscape burgeons with diverse frameworks and tools, the challenge of model portability and efficiency in deployment becomes pronounced. ONNX, an open-source format, addresses this challenge head-on, enabling models trained in one framework to be exported […]

Read More
AI Deep Learning Neural Networks

Watching Neural Networks Learn

Emergent Garden provides this video about neural networks, function approximation, machine learning, and mathematical building blocks. Dennis Nedry did nothing wrong.

Read More
AI Ethics Neural Networks Research Science

Lab-Grown Brain Connects to Microchip, Recognizing Human Voices

This video from Anton Petrov makes me wonder where we are going as a society and as a species. Links: https://www.nature.com/articles/s41928-023-01069-w https://www.biorxiv.org/content/10.1101/2023.02.28.530502v1.full.pdf https://pubmed.ncbi.nlm.nih.gov/33482329/

Read More
AI Generative AI Large Language Models Natural Language Processing Neural Networks

How Neural Networks Learned to Talk | ChatGPT: A 30 Year History

This video from Art of the Problem explores the journey of language models, from their modest beginnings through the development of OpenAI’s GPT models & hints at Q* / Google Gemini. Our journey takes us through the key moments in neural network research involved in next word prediction. We delve into the early experiments with […]

Read More
AI Neural Networks Python

How to Create a Neural Network from scratch using Only NUMPY

This video is from Computer Science with Dr. RCB. source code: GitHub link https://github.com/DrRCB/code_a_neural_network.git

Read More
AI Neural Networks

Transposed Convolutions in Neural Networks – Interactive Demo App

This video is from deeplizard. Transposed convolutions are a particular type of upsampling technique often used in neural networks, particularly GANs. Just like other upsampling techniques, transposed convolutions increase the size of data. For image data, transposed convolutions are used to increase image dimensions. Use the interactive demonstration below to gain a better understanding of […]

Read More
AI Neural Networks Research

Retentive Network: A Successor to Transformer for Large Language Models (Paper Explained)

This video is from Yannic Kilcher. Retention is an alternative to Attention in Transformers that can both be written in a parallel and in a recurrent fashion. This means the architecture achieves training parallelism while maintaining low-cost inference. Experiments in the paper look very promising. Paper: https://arxiv.org/abs/2307.08621

Read More
Neural Networks

Computer Chronicles: Exploring Neural Networks in 1991

This video from The Computer Chronicles explains what the early 90s vision of neural networks was. Special thanks to archive.org for hosting these episodes. Downloads of all these episodes and more can be found at: http://archive.org/details/computerchronicles

Read More
AI Neural Networks

Watching Neural Networks Learn

This video is from Emergent Garden. A video about neural networks, function approximation, machine learning, and mathematical building blocks. Dennis Nedry did nothing wrong. This is a submission for #SoME3

Read More
AI Neural Networks Research

Formalizing Explanations of Neural Network Behaviors

This video is from Simons Institute. Existing research on mechanistic interpretability usually tries to develop an informal human understanding of “how a model works,” making it hard to evaluate research results and raising concerns about scalability. Meanwhile formal proofs of model properties seem far out of reach both in theory and practice. In this talk […]

Read More