Somehow just been following OpenAI and missed all the action at the other big algorithm R&D company. https://deepmind.com/research
Experience Replay: https://deepmind.com/research/open-source/Reverb
https://deepmind.com/research/open-source/Acme_os Their new framework; https://github.com/deepmind/acme
https://github.com/deepmind/dm_control – seems they’re a Mujoco house.