ROME: Locating and Editing Factual Associations in GPT (Paper Explained & Author Interview)
Large Language Models have the ability to store vast amounts of facts about the world. But little is known, how these models actually do this. This paper aims at discovering the mechanism and location of storage and recall of factual associations in GPT models, and then proposes a mechanism for the targeted editing of such […]
Read More){kind=link}
This is a game changer! (AlphaTensor by DeepMind explained)
-
Frank
- October 19, 2022
- AI
- ai matrix multiplication
- alpha tensor
- alpha tensor explained
- alpha zero
- alphatensor explained
- AlphaZero
- alphazero math
- artificial intelligence
- Arxiv
- Deep Learning
- deep learning tutorial
- Deep Mind
- DeepMind
- deepmind alphatensor
- deepmind math
- explained
- google deep mind
- google deepmind
- introduction to deep learning
- Machine Learning
- matrix multiplication
- matrix multiplication reinforcement learning
- Neural Networks
- Paper
- what is deep learning
Matrix multiplication is the most used mathematical operation in all of science and engineering. Speeding this up has massive consequences. Thus, over the years, this operation has become more and more optimized. A fascinating discovery was made when it was shown that one actually needs less than N^3 multiplication operations to multiply to NxN matrices. […]
Read More){kind=link}
How to make your CPU as fast as a GPU – Advances in Sparsity w/ Nir Shavit
Sparsity is awesome, but only recently has it become possible to properly handle sparse models at good performance. Neural Magic does exactly this, using a plain CPU. No specialized hardware needed, just clever algorithms for pruning and forward-propagation of neural networks. Nir Shavit and I talk about how this is possible, what it means in […]
Read More
[ML News] Stable Diffusion Takes Over! (Open Source AI Art)
Stable Diffusion has been released and is riding a wave of creativity and collaboration. But not everyone is happy about this — especially artists!
Read More){kind=link}
Parti – Scaling Autoregressive Models for Content-Rich Text-to-Image Generation
-
Frank
- June 24, 2022
- AI
- anubis
- artificial intelligence
- Arxiv
- dall e 2
- dall e 2 vs graphic designer
- dalle
- dalle 2
- dalle2
- Deep Learning
- deep learning tutorial
- diffusion models
- explained
- generative models
- google imagen
- google parti
- google party
- google pathways
- image
- introduction to deep learning
- Machine Learning
- Neural Networks
- Paper
- parti
- what is deep learning
Parti is a new autoregressive text-to-image model that shows just how much scale can achieve. This model’s outputs are crips, accurate, realistic, and can combine arbitrary styles, concepts, and fulfil even challenging requests. Yannic explains the research paper. Time stamps: 0:00 – Introduction 2:40 – Example Outputs 6:00 – Model Architecture 17:15 – Datasets (incl. […]
Read More
Is This the Worst AI Ever?
-
Frank
- June 13, 2022
- 4chan
- 4chan ai
- 4chan bot
- 4chan pol
- 4chan pol bot
- AI
- ai bias
- artificial intelligence
- Arxiv
- Deep Learning
- eleuther ai
- explained
- gpt 3
- gpt 4
- gpt 4chan
- gpt j
- gpt-3
- gpt-3 truthful
- gpt-4
- gpt-4chan
- gpt-j
- gpt-j-6b
- gpt4
- gpt4chan
- is ai truthful
- language model evaluation
- Machine Learning
- Natural Language Processing
- Neural Networks
- Paper
- seychelle
- seychelle bot
- seychelles
- truthful qa
- truthfulqa
- trutufulqa dataset
- Turing Test
GPT-4chan was trained on over 3 years of posts from 4chan’s “politically incorrect” (/pol/) board. (and no, this is not GPT-4) You can imagine what it learned. Maybe we need to be better people so that we can make sure our AI overlords will have better behavior to model.
Read More
Meta’s OPT 175B language model and DALL-E Mega is training
-
Frank
- May 11, 2022
- AI
- artificial intelligence
- Arxiv
- coca
- dall-e
- dall-e mega
- dall-e mini
- dalle
- dalle 2
- Deep Learning
- deep rl course
- explained
- facebook ai
- gpt-3
- huggingface course
- huggingface rl course
- kilcher news
- Machine Learning
- machine learning news
- meta ai
- ml news
- ml news yannic
- mlnews
- Neural Networks
- openai clip
- openai davinci
- opt 175 b
- opt 175b meta
- Paper
- tortoise tts
Yannic provides us with an inside look of what’s happening in the ML world!
Read More
The Weird and Wonderful World of AI Art (w/ Author Jack Morris)
-
Frank
- May 9, 2022
- AI
- ai art
- ai art colab
- ai art generator
- aiart
- artificial intelligence
- Arxiv
- clip
- clip ai art
- clip art
- clip guided diffusion
- clip vqgan
- dall-e
- dalle
- Deep Dream
- Deep Learning
- deep learning art
- disco diffusion
- explained
- glide
- guided diffusion
- guided diffusion openai
- Machine Intelligence
- Machine Learning
- Neural Networks
- openai clip
- Paper
- picture generator
- rudall-e
- rudalle
- StyleGAN
- turbo diffusion
Since the release of CLIP, the world of AI art has seen an unprecedented level of acceleration in what’s possible to do. Whereas image generation had previously been mostly in the domain of scientists, now a community of professional artists, researchers, and amateurs are sending around colab notebooks and sharing their creations via social media. […]
Read More){kind=link}
This AI Creates Infinite NFTs
-
Frank
- May 9, 2022
- AI
- ai art
- ai created nft
- ai nft generator
- artificial intelligence
- Arxiv
- bored ape yacht club
- bored apes
- Deep Learning
- explained
- gan nft
- generative adversarial network
- goodfellow
- how to create nft
- Machine Learning
- machine learning nft
- Neural Networks
- nft gan
- nft generator
- opensea nft
- Paper
- Schmidhuber
- StyleGAN
- stylegan2
Yannic shows us how to build an AI that can create as many bored apes as we want. Fungibility for everyone, indeed.
Read More
Exploring the LAION-5B: a 5 billion image-text-pairs dataset
-
Frank
- May 2, 2022
- AI
- artificial intelligence
- Arxiv
- dall-e
- Deep Learning
- eleuther
- eleuther ai
- explained
- huggingface
- laion
- laion 400m
- laion 5b
- laion ai
- Machine Learning
- mini dall-e
- Neural Networks
- open clip
- open source clip
- open source dalle
- open source dataset
- open source machine learning
- openai clip
- openai clip dataset
- openai dalle
- Paper
- text image dataset
LAION-5B is an open, free dataset consisting of over 5 billion image-text-pairs. Today’s video is an interview with three of its creators. We dive into the mechanics and challenges of operating at such large scale, how to keep cost low, what new possibilities are enabled with open datasets like this, and how to best handle […]
Read More