Machine Learning

AI Generative AI

Parti – Scaling Autoregressive Models for Content-Rich Text-to-Image Generation

Parti is a new autoregressive text-to-image model that shows just how much scale can achieve. This model’s outputs are crips, accurate, realistic, and can combine arbitrary styles, concepts, and fulfil even challenging requests. Yannic explains the research paper. Time stamps: 0:00 – Introduction 2:40 – Example Outputs 6:00 – Model Architecture 17:15 – Datasets (incl. […]

Read More
AI Natural Language Processing Neural Networks

Illustrated Guide to Transformers Neural Network: A step by step explanation

Transformers are the rage nowadays, but how do they work? This video demystifies the novel neural network architecture with step by step explanation and illustrations on how transformers work. CORRECTIONS: The sine and cosine functions are actually applied to the embedding dimensions and time steps!

Read More
Natural Language Processing

AI Language Models & Transformers

Plausible text generation has been around for a couple of years, but how does it work – and what’s next? Rob Miles on Language Models and Transformers.

Read More
Quantum Computing

Quantum-Enhanced Markov Chain Monte Carlo Simulations with David Layden

Here’s a talk by David Layden on Quantum-Enhanced Markov Chain Monte Carlo Abstract: Sampling from complicated probability distributions is a hard computational problem arising in many fields, including statistical physics, optimization, and machine learning. Quantum computers have recently been used to sample from complicated distributions that are hard to sample from classically, but which seldom […]

Read More
AI Natural Language Processing

Transformers, explained: Understand the model behind GPT, BERT, and T5

Curious how an ML model could write a poem or an op ed? Transformers can do it all. In this episode of Making with ML, Dale Markowitz explains what transformers are, how they work, and why they’re so impactful. Over the past few years, Transformers, a neural network architecture, have completely transformed state-of-the-art natural language […]

Read More
AI Ethics

The Road to General AI • Danny Lange • GOTO 2021

With recent news of a “sentient chatbot,” the topic of AGI is top of mind for me again. Danny Lange, SVP of AI and ML at Unity Technologies, presents this talk on the subject. ABSTRACT Senior vice president of machine learning and artificial intelligence at Unity Danny Lange will set the stage by introducing the […]

Read More
AI

Is This the Worst AI Ever?

GPT-4chan was trained on over 3 years of posts from 4chan’s “politically incorrect” (/pol/) board. (and no, this is not GPT-4) You can imagine what it learned. Maybe we need to be better people so that we can make sure our AI overlords will have better behavior to model.

Read More
Quantum Computing

Quantum Simulations of Topological Majorana Modes with Oles Shtanko

Quantum Simulations of Topological Majorana Modes Abstract: Modern quantum devices can now outperform classical computers in physical simulations, which makes them an important tool for future physics research. As an example, I will focus on simulating the topological states of matter hosting Majorana modes — the exotic “half-electron” states. Observing Majorana modes in the lab […]

Read More