Our Toybox dataset has been posted online:
https://aivaslab.github.io/toybox/

This is the culmination of hundreds of hours of effort from many of our lab members. A tip of the hat to Xiaohan Wang, whose ideas catalyzed this work and who led the dataset effort.

The dataset is described in more detail in this preprint:
https://arxiv.org/abs/1806.06034