VirtualHome: Simulating Household Activities via Programs
Presents VirtualHome and proposes a model to predict programs from videos or descriptions. The predicted program is finetuned using RL to be executable in the simulator.X. Puig*, K. Ra*, M. Boben*, J. Li, T. Wang, S. Fidler, A. Torralba.
Synthesizing Environment-Aware Activities via Activity Sketches
Represents activities via Sketches. Proposes a model to generate programs from sketches such that they are consistent with a target environment.A. Liao*, X. Puig*, M. Boben, A. Torralba, S.Fidler.