Neural Networks

AI Generative AI

The Weird and Wonderful World of AI Art (w/ Author Jack Morris)

Since the release of CLIP, the world of AI art has seen an unprecedented level of acceleration in what’s possible to do. Whereas image generation had previously been mostly in the domain of scientists, now a community of professional artists, researchers, and amateurs are sending around colab notebooks and sharing their creations via social media. […]

Read More
AI Computer Vision Open Source

Exploring the LAION-5B: a 5 billion image-text-pairs dataset

LAION-5B is an open, free dataset consisting of over 5 billion image-text-pairs. Today’s video is an interview with three of its creators. We dive into the mechanics and challenges of operating at such large scale, how to keep cost low, what new possibilities are enabled with open datasets like this, and how to best handle […]

Read More
Generative AI

How to Generate AI Art in 5 Minutes for Free

Wow, just wow. Check out the notebook to try it for yourself.

Read More
Neural Networks Research

DIABLo: a Deep Individual

Here’s an interesting video from Microsoft Research In this project, we have developed and studied a deep neural network-based individual-agnostic general-purpose binaural localizer (BL) for sound sources located at arbitrary directions on the $4\pi$ sphere. Unlike binaural localization models trained with an HRIR catalog associated with a specific head and ear shape, an individual-agnostic model […]

Read More
Machine Learning

DeepMind tackles Math and More in ML News

Here’s the latest round up of ML News: 0:00 – Intro 0:15 – Sponsor: Weights & Biases 3:10 – DeepMind tackles fundamental math 6:45 – Microsoft focuses on scaling effectively and efficiently 10:15 – NeurIPS Anthology Visualization 13:30 – Timnit Gebru launches research institute independent from big tech 16:50 – SageMaker Canvas for no-code ML […]

Read More
AI Mobile

How AI is Taking over your Phone

Ever wonder how the smart phone in your pocket does what it does? It’s no secret that in the last few years phone makers have turned to machine learning and neural networks to do the hard stuff that we take for granted. This combined that with the custom GPU’s that power them and training data […]

Read More
AI Research

Implicit MLE: Backpropagating Through Discrete Exponential Family Distributions

Backpropagation is the workhorse of deep learning, but unfortunately, it only works for continuous functions that are amenable to the chain rule of differentiation. Since discrete algorithms have no continuous derivative, deep networks with such algorithms as part of them cannot be effectively trained using backpropagation. This paper presents a method to incorporate a large […]

Read More
Neural Networks

Challenges of Training Large-Scale Neural Networks

Here’s an interesting look at the unique challenges that present themselves when training large neural networks.

Read More