Facebook AI Research

AI Research

Three Explorations on Pre-Training: an Analysis, an Approach, and an Architecture

In this talk from Xinlei Chen, Facebook AI Research, covers three of their recent explorations on pre-training. First is an analysis on object/attribute detection pre-training, which produces bottom-attention features extensively used in vision and language research. The main finding is that plain grid features can work equally well without object proposals, while being significantly faster. […]

Read More
AI Python

PyTorch 1.1 Release Improves Performance, Adds New APIs and Tools

Here’s an article about the latest PyTorch release. Facebook AI Research announced the release of PyTorch 1.1. The latest version of the open-source deep learning framework includes improved performance via distributed training, new APIs, and new visualization tools including native support for TensorBoard. In a recent blog post, the Facebook team highlighted several improvements to […]

Read More