Self-Supervised Learning

AI Natural Language Processing

AlphaCode Explained: AI Code Generation

AlphaCode is DeepMind’s new massive language model for generating code. It is similar to OpenAI Codex, except for in the paper they provide a bit more analysis. The field of NLP within AI and ML has exploded get a lot more papers all the time. Hopefully this video can help you understand how AlphaCode works […]

Read More
AI Research

Yann LeCun on “Energy-Based Self-Supervised Learning”

“Energy-Based Self-Supervised Learning” by the one and only Yann LeCun – Courant Institute of Mathematical Sciences, New York University & Facebook AI Research

Read More
AI Research

Learning Algorithms and the Self-Supervised Machine with Dr. Philip Bachman

Microsoft Research has a new podcast out talking about learning algorithms. Deep learning methodologies like supervised learning have been very successful in training machines to make predictions about the world. But because they’re so dependent upon large amounts of human-annotated data, they’ve been difficult to scale. Dr. Phil Bachman, a researcher at MSR Montreal, would […]

Read More