Xinlei Chen

AI Research

Three Explorations on Pre-Training: an Analysis, an Approach, and an Architecture

In this talk from Xinlei Chen, Facebook AI Research, covers three of their recent explorations on pre-training. First is an analysis on object/attribute detection pre-training, which produces bottom-attention features extensively used in vision and language research. The main finding is that plain grid features can work equally well without object proposals, while being significantly faster. […]

Read More