Machine Learning with Phil covers Multi Agent Deep Deterministic Policy Gradients (MADDPG) in this video.
Multi agent deep deterministic policy gradients is one of the first successful algorithms for multi agent artificial intelligence. Cooperation and competition among AI agents is going to be critical as applications of deep learning expand in our daily lives. In this tutorial, we are going to read through the paper together and then code up the entire multi agent actor critic algorithm from scratch in the Pytorch framework.
The main innovation of this algorithm is the use of centralized execution and decentralized training. In brief, we’re going to give each agent’s critic network access to the observations and actions of all the agents in the simulation. The actor networks will only have access to their own perspective, hence the centralized execution.
We are going to use Open AI’s multi agent particle environment for training and testing our agents. I’ll show you how to get it from github and install the requirements in a virtual environment.