Reinforcement Learning with Prototypical Representations - 2021

Title : Reinforcement Learning with Prototypical Representations Author(s): Yarats, Denis and Fergus, Rob and Lazaric, Alessandro and Pinto, Lerrel Link(s) : http://arxiv.org/abs/2102.11271

Learning good representations needs diverse data, and good exploration requiring diverse data needing good representations. This paper tackles this by introducing a task-agnostic pre-training stage which learns a latent space, allowing for better exploration in unseen downstream tasks.

Existing solutions are task dependent.

The latent space whose elements (prototypes) are learnt through entropy based exploration using a k-NN approximation. These prototypes serve as landmarks for usnseen downstream tasks where they explore better.