VirtualHome: Simulating Household Activities via Programs
Presents VirtualHome and proposes a model to predict programs from videos or descriptions. The predicted program is finetuned using RL to be executable in the simulator.X. Puig, K. Ra, M. Boben, J. Li, T. Wang, S. Fidler, A. Torralba.
Synthesizing Environment-Aware Activities via Activity Sketches
Represents activities via Sketches. Proposes a model to generate programs from sketches such that they are consistent with a target environment.A. Liao, X. Puig, M. Boben, S. Fidler, A. Torralba.