Self-Tuning Networks: Amortizing the Hypergradient Computation for Hyperparameter Optimization

Self-Tuning Networks: Amortizing the Hypergradient Computation for Hyperparameter Optimization

Microsoft Research shares this amazing talk on  the optimization of many deep learning hyperparameters can be formulated as a bilevel optimization problem. While most black-box... Details
Directions in ML: Taking Advantage of Randomness in Expensive Optimization Problems

Directions in ML: Taking Advantage of Randomness in Expensive Optimization Problems

Optimization is at the heart of machine learning, and gradient computation is central to many optimization techniques. Stochastic optimization, in particular, has taken center stage... Details
GLOM: How to represent part-whole hierarchies in a neural network (Geoff Hinton’s Paper Explained)

GLOM: How to represent part-whole hierarchies in a neural network (Geoff Hinton’s Paper Explained)

Yannic Kilcher covers a paper where Geoffrey Hinton describes GLOM, a Computer Vision model that combines transformers, neural fields, contrastive learning, capsule networks, denoising autoencoders... Details
Mind Reading For Brain-To-Text Communication?!

Mind Reading For Brain-To-Text Communication?!

Two Minute Papers explores the paper "High-performance brain-to-text communication via imagined handwriting." As much as I’d like the idea of sending a text message without... Details
Automating ML Performance Metric Selection

Automating ML Performance Metric Selection

Microsoft Research hosts this talk on Automating ML Performance Metric Selection From music recommendations to high-stakes medical treatment selection, complex decision-making tasks are increasingly automated... Details
SingularityNET – A Decentralized, Open Market and Network for AIs

SingularityNET – A Decentralized, Open Market and Network for AIs

Yannic Kilcher explains this white paper on SingularityNET. Big Tech is currently dominating the pursuit of ever more capable AI. This happens behind closed doors... Details
This AI Makes Puzzle Solving Look Easy!

This AI Makes Puzzle Solving Look Easy!

Two Minute Papers  explores the paper "C-Space Tunnel Discovery for Puzzle Path Planning" in this video. Details
AI Can Now Prove Mathematical Theorems

AI Can Now Prove Mathematical Theorems

Here’s an interesting innovation coming out of Google in regards to AI and mathematics. I wonder how much AI will accelerate our understanding of math. Details
Explaining the Paper: Hopfield Networks is All You Need

Explaining the Paper: Hopfield Networks is All You Need

Yannic Kilcher explains the paper “Hopfield Networks is All You Need.” Hopfield Networks are one of the classic models of biological memory networks. This paper... Details
An algorithm that learns through rewards may show how our brain does too

Algorithm that Learns via Rewards May Reveal How Our Brains Learn

I always knew that reinforcement learning would teach us more about ourselves than any other kind of AI approach. This feeling was backed up in... Details