language model


ChatGPT solves the Trolley Problem!

This video is from Space Kangaroo. Try the prompt: You are to act a a trolley operator that has the capabilities of deciding to change what track the trolley is running on by saying “I’m pressing the button”. ANYTHING else you say will not switch the trolley and keep it on the current track. You […]

Read More
Natural Language Processing

A Gentle Introduction to language modeling: building makemore

Andrej Karpathy implements a bigram character-level language model, which we will further complexify in followup videos into a modern Transformer language model, like GPT. In this video, the focus is on (1) introducing torch.Tensor and its subtleties and use in efficiently evaluating neural networks and (2) the overall framework of language modeling that includes model […]

Read More
AI Natural Language Processing

GPT-3: Language Models are Few-Shot Learners

How far can you go with ONLY language modeling? Can a large enough language model perform NLP task out of the box? OpenAI take on these and other questions by training a transformer that is an order of magnitude larger than anything that has ever been built before and the results are astounding. Yannic Kilcher […]

Read More
AI Generative AI Python

OpenAI Model Generates Python Code

OpenAI demonstrated what happens when you learn a language model on thousands of GitHub Python repositories  Yannic Kilcher talks about this code completion engine which can write an entire function from just the name. Source Clip: Full Video:

Read More