Modular Action Concept Grounding in Semantic Video Prediction

CVPR 2022.

Wei Yu,
Wenxin Chen,
Songheng Yin,
Steve Easterbrook,
Animesh Garg.
[Paper]
[Code](coming soon)
[Bibtex]

Video Overview



Qualitative Results on TowerCreation

 Groundtruth      Best sample       Sample 1         Sample 2  

 Groundtruth      Best sample       Sample 1         Sample 2  

 Groundtruth      Best sample       Sample 1         Sample 2  

 Groundtruth      Best sample       Sample 1         Sample 2  




Qualitative Results on CLEVR-Building-blocks

Ground truth                    Predictions

Ground truth                    Predictions




Qualitative Results on Sapien-Kitchen

Ground truth                    Predictions

Ground truth                    Predictions




Acknowledgements

This work is supported by CIFAR AI Chair, NSERC Discovery Award, University of Toronto XSeed award, and gifts from LG.