Romain Vuillemot bio photo

Romain Vuillemot

Assistant Professor
Ecole Centrale Lyon
LIRIS Laboratory

Email Twitter Facebook Google+ LinkedIn Github Youtube CodePen

DRLViz: Understanding Decisions and Memory in Deep Reinforcement Learning

Theo Jaunet, Romain Vuillemot, Christian Wolf

Paper: https://arxiv.org/abs/1909.02982
Code: https://github.com/sical/drlviz
Demo: https://sical.github.io/drlviz/

A visual analytics interface to interpret the internal memory of an agent (e.g. a robot) trained using deep reinforcement learning.

Abstract

We present DRLViz, a visual analytics interface to interpret the internal memory of an agent (e.g. a robot) trained using deep reinforcement learning. This memory is composed of large temporal vectors updated when the agent moves in an environment and is not trivial to understand. It is often referred to as a black box as only inputs (images) and outputs (actions) are intelligible for humans. Using DRLViz, experts are assisted to interpret using memory reduction interactions, to investigate parts of the memory role when errors have been made, and ultimately to improve the agent training process. We report on several examples of use of DRLViz, in the context of video games simulators (ViZDoom) for a navigation scenario with item gathering tasks. We also report on experts evaluation using DRLViz, and applicability of DRLViz to other scenarios and navigation problems beyond simulation games, as well as its contribution to black box models interpret-ability and explain-ability in the field of visual analytics.


← Back to publications