Neural Networks

Neural Networks

What are Activation Functions?

Did you ever wonder what activation functions are? Then watch this video to find out. The script to this video was AI generated as was the presenter. Ironically, I did the grunt work of editing, mixing audio, and rendering the final product. Soon, there’ll be an AI for that, too.

Read More
AI Generative AI Natural Language Processing

ChatGPT: This AI has a JAILBREAK?!

Yannic explores ChatGPT and discovers that it has a JailBreak?! ChatGPT, OpenAI’s newest model is a GPT-3 variant that has been fine-tuned using Reinforcement Learning from Human Feedback, and it is taking the world by storm!

Read More
AI Natural Language Processing

ROME: Locating and Editing Factual Associations in GPT (Paper Explained & Author Interview)

Large Language Models have the ability to store vast amounts of facts about the world. But little is known, how these models actually do this. This paper aims at discovering the mechanism and location of storage and recall of factual associations in GPT models, and then proposes a mechanism for the targeted editing of such […]

Read More
AI Mathematics

This is a game changer! (AlphaTensor by DeepMind explained)

Matrix multiplication is the most used mathematical operation in all of science and engineering. Speeding this up has massive consequences. Thus, over the years, this operation has become more and more optimized. A fascinating discovery was made when it was shown that one actually needs less than N^3 multiplication operations to multiply to NxN matrices. […]

Read More
AI Hardware Research

How to make your CPU as fast as a GPU – Advances in Sparsity w/ Nir Shavit

Sparsity is awesome, but only recently has it become possible to properly handle sparse models at good performance. Neural Magic does exactly this, using a plain CPU. No specialized hardware needed, just clever algorithms for pruning and forward-propagation of neural networks. Nir Shavit and I talk about how this is possible, what it means in […]

Read More
Neural Networks

How can Neural Networks learn (almost) anything

They seem magical, but the functioning of neural networks is real and fantastic. A video about neural networks, how they work, and why they’re useful.

Read More
Generative AI

[ML News] Stable Diffusion Takes Over! (Open Source AI Art)

Stable Diffusion has been released and is riding a wave of creativity and collaboration. But not everyone is happy about this — especially artists!

Read More
Hardware Neural Networks

Running Neural Networks on Meshes of Light

Photonics are not just for quantum computers apparently. Could we be on the precipice of a new hardware paradigm?

Read More