Current Events
Security
Anonymous Hacks Russian Military
If you want to stay informed of the current threat landscape, you need to subscribe to Seytonic.
Read More
Security
Anonymous Hacks China Government Website (Twice)
Top news in the security space. 0:00 Anonymous Hacks China (Again) 2:41 Microsoft Kills Malicious Documents 6:20 Altium Outro
Read More){kind=link}
AI
Natural Language Processing
Transformers for Image Recognition at Scale
-
Frank
- October 6, 2020
- AI
- andrej karpathy
- anonymous
- artificial intelligence
- Arxiv
- attention is all you need
- attention mechanism
- beyer
- big transfer
- bit
- CNN
- Convolutional Neural Network
- Data Science
- Deep Learning
- explained
- Google Brain
- google research
- iclr
- iclr 2021
- karpathy
- Machine Learning
- Neural Networks
- Paper
- peer review
- review
- TPU
- tpu v3
- transformer
- transformer computer vision
- transformer images
- under submission
- vaswani
- vision transformer
- visual transformer
- vit
Yannic Kilcher explains why transformers are ruining convolutions. This paper, under review at ICLR, shows that given enough data, a standard Transformer can outperform Convolutional Neural Networks in image recognition tasks, which are classically tasks where CNNs excel. In this Video, I explain the architecture of the Vision Transformer (ViT), the reason why it works […]
Read More