We consider the task of producing a single trajectory of a dynamical system under some state dependent policy. This ‘policy simulation’ task is often the core computational bottleneck in modern Reinforcement Learning algorithms. The multiple, inherently serial, policy evaluations that must be performed in one such simulation constitute the bulk ...
