Arxiv

AI Generative AI

The Weird and Wonderful World of AI Art (w/ Author Jack Morris)

Since the release of CLIP, the world of AI art has seen an unprecedented level of acceleration in what’s possible to do. Whereas image generation had previously been mostly in the domain of scientists, now a community of professional artists, researchers, and amateurs are sending around colab notebooks and sharing their creations via social media. […]

Read More
AI Computer Vision Open Source

Exploring the LAION-5B: a 5 billion image-text-pairs dataset

LAION-5B is an open, free dataset consisting of over 5 billion image-text-pairs. Today’s video is an interview with three of its creators. We dive into the mechanics and challenges of operating at such large scale, how to keep cost low, what new possibilities are enabled with open datasets like this, and how to best handle […]

Read More
Machine Learning

DeepMind tackles Math and More in ML News

Here’s the latest round up of ML News: 0:00 – Intro 0:15 – Sponsor: Weights & Biases 3:10 – DeepMind tackles fundamental math 6:45 – Microsoft focuses on scaling effectively and efficiently 10:15 – NeurIPS Anthology Visualization 13:30 – Timnit Gebru launches research institute independent from big tech 16:50 – SageMaker Canvas for no-code ML […]

Read More
AI Research

Implicit MLE: Backpropagating Through Discrete Exponential Family Distributions

Backpropagation is the workhorse of deep learning, but unfortunately, it only works for continuous functions that are amenable to the chain rule of differentiation. Since discrete algorithms have no continuous derivative, deep networks with such algorithms as part of them cannot be effectively trained using backpropagation. This paper presents a method to incorporate a large […]

Read More
AI Machine Learning

[ML News] Google introduces Pathways | OpenAI solves Math Problems | Meta goes First Person

Yannic provides us with a  dose of Machine Learning News. Time stamps: 0:00 – Intro 0:20 – Sponsor: Weights & Biases 2:10 – Google Introduces Pathways AI Architecture 6:30 – OpenAI trains Language Models to do High School Math 8:25 – Sam Altman says Neural Networks truly learn 9:35 – Google AI researchers frustrated with […]

Read More
AI Natural Language Processing

[ML News] New ImageNet SOTA | Uber’s H3 hexagonal coordinate system | New text-image-pair dataset

Yannic provides the latest news in machine learning in this video. Time Stamps: 0:00 – Intro 0:20 – TruthfulQA benchmark shines new light on GPT-3 2:00 – LAION-400M image-text-pair dataset 4:10 – GoogleAI’s EfficientNetV2 and CoAtNet 6:15 – Uber’s H3: A hexagonal coordinate system 7:40 – AWS NeurIPS 2021 DeepRacer Challenge 8:15 – Helpful Libraries […]

Read More
AI Interesting Research

PonderNet: Learning to Ponder

Humans don’t spend the same amount of mental effort on all problems equally. Instead, we respond quickly to easy tasks, and we take our time to deliberate hard tasks. DeepMind’s PonderNet attempts to achieve the same by dynamically deciding how many computation steps to allocate to any single input sample. This is done via a […]

Read More
AI Research

Why AI is Harder Than We Think

Yannic Kilcher  explains how the AI community has gone through regular cycles of AI Springs, where rapid progress gave rise to massive overconfidence, high funding, and overpromise, followed by these promises being unfulfilled, subsequently diving into periods of disenfranchisement and underfunding, called AI Winters. This video he explores a paper which examines the reasons for […]

Read More