Paper

Are Retentive Networks A Successor to Transformer for Large Language Models?

Retention is an alternative to Attention in Transformers that can both be written in a parallel and in a recurrent fashion. This means the architecture achieves training parallelism while maintaining low-cost inference. Experiments in the paper look very promising. Yannic Kilcher elaborates.

AI Large Language Models

[ML News] LLaMA2 Released | LLMs for Robots | Multimodality on the Rise

This video is from Yannic Kilcher and covers the latest LLM happenings.

AI Large Language Models Research

Scaling Transformer to 1M tokens and beyond with RMT (Paper Explained)

Yannic Kilcher explains this paper that promises to scale transformers to 1 million tokens and beyond. We take a look at the technique behind it: The Recurrent Memory Transformer, and what its strengths and weaknesses are.

AI Large Language Models Natural Language Processing Speech and Voice

OpenAssistant RELEASED! The world’s best open-source Chat AI!

This video is from Yannic Kilcher.

Large Language Models

GPT-4 is here! What we know so far (Full Analysis)

Yannic Kilcher provides this in depth analysis of GPT-4.

Natural Language Processing Research

LLaMA: Open and Efficient Foundation Language Models (Paper Explained)

Large Language Models (LLMs) are all the rage right now. ChatGPT is the LLM everyone talks about, but there are others. With the attention (and money) that OpenAI is getting, expect more of them. LLaMA is a series of large language models from 7B to 65B parameters, trained by Meta AI. They train for longer […]

AI Generative AI Natural Language Processing

ChatGPT: This AI has a JAILBREAK?!

Yannic explores ChatGPT and discovers that it has a JailBreak?! ChatGPT, OpenAI’s newest model is a GPT-3 variant that has been fine-tuned using Reinforcement Learning from Human Feedback, and it is taking the world by storm!

GPT-4 Rumors | AI Mind Reading | Neuron Interaction Solved | AI Theorem Proving

Yanic provides a weekly news roundup from the AI & Machine Learning world.

AI Natural Language Processing

ROME: Locating and Editing Factual Associations in GPT (Paper Explained & Author Interview)

Large Language Models have the ability to store vast amounts of facts about the world. But little is known, how these models actually do this. This paper aims at discovering the mechanism and location of storage and recall of factual associations in GPT models, and then proposes a mechanism for the targeted editing of such […]

AI Mathematics

This is a game changer! (AlphaTensor by DeepMind explained)

Matrix multiplication is the most used mathematical operation in all of science and engineering. Speeding this up has massive consequences. Thus, over the years, this operation has become more and more optimized. A fascinating discovery was made when it was shown that one actually needs less than N^3 multiplication operations to multiply to NxN matrices. […]

Sort & Stretch with the Latest Tesla Bot Update

The End Of The Smartphone Is Near

Nvidia: The Dawn of the AI Era (Audio)

How to Uncover Anomalies in Time Series Data with Python

How to set up centralized, scalable, and secure access for SQL operations personnel | Data Exposed