Paper

AI Generative AI

Parti – Scaling Autoregressive Models for Content-Rich Text-to-Image Generation

Parti is a new autoregressive text-to-image model that shows just how much scale can achieve. This model’s outputs are crips, accurate, realistic, and can combine arbitrary styles, concepts, and fulfil even challenging requests. Yannic explains the research paper. Time stamps: 0:00 – Introduction 2:40 – Example Outputs 6:00 – Model Architecture 17:15 – Datasets (incl. […]

Read More
AI

Is This the Worst AI Ever?

GPT-4chan was trained on over 3 years of posts from 4chan’s “politically incorrect” (/pol/) board. (and no, this is not GPT-4) You can imagine what it learned. Maybe we need to be better people so that we can make sure our AI overlords will have better behavior to model.

Read More
AI Generative AI

The Weird and Wonderful World of AI Art (w/ Author Jack Morris)

Since the release of CLIP, the world of AI art has seen an unprecedented level of acceleration in what’s possible to do. Whereas image generation had previously been mostly in the domain of scientists, now a community of professional artists, researchers, and amateurs are sending around colab notebooks and sharing their creations via social media. […]

Read More
AI Computer Vision Open Source

Exploring the LAION-5B: a 5 billion image-text-pairs dataset

LAION-5B is an open, free dataset consisting of over 5 billion image-text-pairs. Today’s video is an interview with three of its creators. We dive into the mechanics and challenges of operating at such large scale, how to keep cost low, what new possibilities are enabled with open datasets like this, and how to best handle […]

Read More
Machine Learning

DeepMind tackles Math and More in ML News

Here’s the latest round up of ML News: 0:00 – Intro 0:15 – Sponsor: Weights & Biases 3:10 – DeepMind tackles fundamental math 6:45 – Microsoft focuses on scaling effectively and efficiently 10:15 – NeurIPS Anthology Visualization 13:30 – Timnit Gebru launches research institute independent from big tech 16:50 – SageMaker Canvas for no-code ML […]

Read More
AI Research

Implicit MLE: Backpropagating Through Discrete Exponential Family Distributions

Backpropagation is the workhorse of deep learning, but unfortunately, it only works for continuous functions that are amenable to the chain rule of differentiation. Since discrete algorithms have no continuous derivative, deep networks with such algorithms as part of them cannot be effectively trained using backpropagation. This paper presents a method to incorporate a large […]

Read More
AI Machine Learning

[ML News] Google introduces Pathways | OpenAI solves Math Problems | Meta goes First Person

Yannic provides us with a  dose of Machine Learning News. Time stamps: 0:00 – Intro 0:20 – Sponsor: Weights & Biases 2:10 – Google Introduces Pathways AI Architecture 6:30 – OpenAI trains Language Models to do High School Math 8:25 – Sam Altman says Neural Networks truly learn 9:35 – Google AI researchers frustrated with […]

Read More
AI Natural Language Processing

[ML News] New ImageNet SOTA | Uber’s H3 hexagonal coordinate system | New text-image-pair dataset

Yannic provides the latest news in machine learning in this video. Time Stamps: 0:00 – Intro 0:20 – TruthfulQA benchmark shines new light on GPT-3 2:00 – LAION-400M image-text-pair dataset 4:10 – GoogleAI’s EfficientNetV2 and CoAtNet 6:15 – Uber’s H3: A hexagonal coordinate system 7:40 – AWS NeurIPS 2021 DeepRacer Challenge 8:15 – Helpful Libraries […]

Read More