Learning to Decompose and Disentangle Representations for Video Prediction

11 June 2018

Jun-Ting Hsieh

Bingbin Liu

De-An Huang

Li Fei-Fei

Juan Carlos Niebles

DRL

ArXiv PDF HTML

Papers citing "Learning to Decompose and Disentangle Representations for Video Prediction"

50 / 54 papers shown

Title
FreqPrior: Improving Video Diffusion Models with Frequency Filtering Gaussian Noise Yunlong Yuan Yuanfan Guo Chunwei Wang Wei Zhang Hang Xu L. Zhang DiffM VGen 108 1 0 20 Feb 2025
Learning Physics From Video: Unsupervised Physical Parameter Estimation for Continuous Dynamical Systems Alejandro Castañeda Garcia J. C. V. Gemert Daan Brinks Nergis Tömen 36 0 0 02 Oct 2024
USTEP: Spatio-Temporal Predictive Learning under A Unified View Cheng Tan Jue Wang Zhangyang Gao Siyuan Li Stan Z. Li 36 1 0 09 Oct 2023
DriveDreamer: Towards Real-world-driven World Models for Autonomous Driving Xiaofeng Wang Zheng Hua Zhu Guan Huang Xinze Chen Jiagang Zhu Jiwen Lu VGen 16 148 0 18 Sep 2023
Long-Term Prediction of Natural Video Sequences with Robust Video Predictors Luke Ditria Tom Drummond 41 0 0 21 Aug 2023
Prior based Sampling for Adaptive LiDAR Amit Shomer S. Avidan 3DV 3DPC MDE 29 1 0 14 Apr 2023
A polar prediction model for learning to represent visual transformations P. Fiquet Eero P. Simoncelli 20 5 0 06 Mar 2023
Tell Me What Happened: Unifying Text-guided Video Completion via Multimodal Masked Video Generation Tsu-jui Fu Licheng Yu Ning Zhang Cheng-Yang Fu Jong-Chyi Su William Yang Wang Sean Bell VGen 48 37 0 23 Nov 2022
Disentangled Representation Learning Xin Eric Wang Hong Chen Siao Tang Zihao Wu Wenwu Zhu DRL 22 77 0 21 Nov 2022
Graph Contrastive Learning with Cross-view Reconstruction Qianlong Wen Z. Ouyang Chunhui Zhang Y. Qian Yanfang Ye Chuxu Zhang SSL 15 6 0 16 Sep 2022
InfiniteNature-Zero: Learning Perpetual View Generation of Natural Scenes from Single Images Zhengqi Li Qianqian Wang Noah Snavely Angjoo Kanazawa VGen 26 59 0 22 Jul 2022
E-NeRV: Expedite Neural Video Representation with Disentangled Spatial-Temporal Context Zizhang Li Mengmeng Wang Huaijin Pi Kechun Xu Jianbiao Mei Yong Liu 18 70 0 17 Jul 2022
Unsupervised Semantic Segmentation with Self-supervised Object-centric Representations Andrii Zadaianchuk Matthaeus Kleindessner Yi Zhu Francesco Locatello Thomas Brox 20 49 0 11 Jul 2022
Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learning Cheng Tan Zhangyang Gao Lirong Wu Yongjie Xu Jun-Xiong Xia Siyuan Li Stan Z. Li 25 107 0 24 Jun 2022
Learning to Refactor Action and Co-occurrence Features for Temporal Action Localization Kun Xia Le Wang Sanping Zhou Nanning Zheng Wei Tang 26 36 0 23 Jun 2022
Seeing the forest and the tree: Building representations of both individual and collective dynamics with transformers Ran Liu Mehdi Azabou M. Dabagia Jingyun Xiao Eva L. Dyer AI4CE 27 19 0 10 Jun 2022
SimVP: Simpler yet Better Video Prediction Zhangyang Gao Cheng Tan Lirong Wu Stan Z. Li 25 211 0 09 Jun 2022
Joint Forecasting of Panoptic Segmentations with Difference Attention Colin Graber Cyril Jazra Wenjie Luo Liangyan Gui A. Schwing AI4TS 19 1 0 14 Apr 2022
Leveraging Disentangled Representations to Improve Vision-Based Keystroke Inference Attacks Under Low Data John Lim Jan-Michael Frahm Fabian Monrose AAML 59 0 0 05 Apr 2022
Generating Videos with Dynamics-aware Implicit Generative Adversarial Networks Sihyun Yu Jihoon Tack Sangwoo Mo Hyunsu Kim Junho Kim Jung-Woo Ha Jinwoo Shin DiffM VGen 18 199 0 21 Feb 2022
OOD-GNN: Out-of-Distribution Generalized Graph Neural Network Haoyang Li Xin Eric Wang Ziwei Zhang Wenwu Zhu OODD OOD 19 97 0 07 Dec 2021
Self-Supervised Learning Disentangled Group Representation as Feature Tan Wang Zhongqi Yue Jianqiang Huang Qianru Sun Hanwang Zhang OOD 27 67 0 28 Oct 2021
Wide and Narrow: Video Prediction from Context and Motion Jaehoon Cho Jiyoung Lee Changjae Oh Wonil Song K. Sohn 16 1 0 22 Oct 2021
Video Autoencoder: self-supervised disentanglement of static 3D structure and motion Zihang Lai Sifei Liu Alexei A. Efros Xiaolong Wang VGen 36 31 0 06 Oct 2021
A Hierarchical Variational Neural Uncertainty Model for Stochastic Video Prediction Moitreya Chatterjee N. Ahuja A. Cherian UQCV VGen BDL 29 17 0 06 Oct 2021
Capturing the objects of vision with neural networks B. Peters N. Kriegeskorte OCL 18 56 0 07 Sep 2021
A Novel Estimator of Mutual Information for Learning to Disentangle Textual Representations Pierre Colombo Chloé Clavel Pablo Piantanida AAML DRL 26 49 0 06 May 2021
A Good Image Generator Is What You Need for High-Resolution Video Synthesis Yu Tian Jian Ren Menglei Chai Kyle Olszewski Xi Peng Dimitris N. Metaxas Sergey Tulyakov VGen 40 183 0 30 Apr 2021
Learning Semantic-Aware Dynamics for Video Prediction Xinzhu Bei Yanchao Yang Stefano Soatto VGen 22 31 0 20 Apr 2021
Video Prediction Recalling Long-term Motion Context via Memory Alignment Learning Sangmin Lee Hak Gu Kim Dae Hwi Choi Hyungil Kim Yong Man Ro 20 102 0 02 Apr 2021
Cloth-Changing Person Re-identification from A Single Image with Gait Prediction and Regularization Xin Jin Tianyu He Kecheng Zheng Zhiheng Yin Xu Shen Zhen Huang Ruoyu Feng Jianqiang Huang Xiansheng Hua Zhibo Chen CVBM 21 124 0 29 Mar 2021
Self-Supervision by Prediction for Object Discovery in Videos Beril Besbinar P. Frossard SSL 19 7 0 09 Mar 2021
Unsupervised Object-Based Transition Models for 3D Partially Observable Environments Antonia Creswell Rishabh Kabra Christopher P. Burgess Murray Shanahan OCL 25 29 0 08 Mar 2021
DMotion: Robotic Visuomotor Control with Unsupervised Forward Model Learned from Videos Haoqi Yuan Ruihai Wu Andrew Zhao Hanwang Zhang Zihan Ding Hao Dong 19 3 0 07 Mar 2021
Greedy Hierarchical Variational Autoencoders for Large-Scale Video Prediction Bohan Wu Suraj Nair Roberto Martin-Martin Li Fei-Fei Chelsea Finn DRL 16 99 0 06 Mar 2021
Learning Temporal Dynamics from Cycles in Narrated Video Dave Epstein Jiajun Wu Cordelia Schmid Chen Sun AI4TS 28 14 0 07 Jan 2021
Mutual Information Based Method for Unsupervised Disentanglement of Video Representation Aditya Sreekar Ujjwal Tiwari A. Namboodiri DRL 11 4 0 17 Nov 2020
Augmenting Physical Models with Deep Networks for Complex Dynamics Forecasting Yuan Yin Vincent Le Guen Jérémie Donà Emmanuel de Bézenac Ibrahim Ayed Nicolas Thome Patrick Gallinari AI4CE PINN 17 132 0 09 Oct 2020
Identifying Latent Stochastic Differential Equations Ali Hasan João M. Pereira Sina Farsiu Vahid Tarokh DiffM 16 18 0 12 Jul 2020
Latent Video Transformer Ruslan Rakhimov Denis Volkhonskiy Alexey Artemov Denis Zorin Evgeny Burnaev VGen 31 118 0 18 Jun 2020
Variational State-Space Models for Localisation and Dense 3D Mapping in 6 DoF Atanas Mirchev Baris Kayalibay Patrick van der Smagt Justin Bayer BDL DRL 10 9 0 17 Jun 2020
CausalVAE: Structured Causal Disentanglement in Variational Autoencoder Mengyue Yang Furui Liu Zhitang Chen Xinwei Shen Jianye Hao Jun Wang OOD CoGe CML 28 44 0 18 Apr 2020
Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Prediction Vincent Le Guen Nicolas Thome AI4CE PINN 80 288 0 03 Mar 2020
Weakly-Supervised Disentanglement Without Compromises Francesco Locatello Ben Poole Gunnar Rätsch Bernhard Schölkopf Olivier Bachem Michael Tschannen CoGe OOD DRL 173 313 0 07 Feb 2020
SCALOR: Generative World Models with Scalable Object Representations Jindong Jiang Sepehr Janghorbani Gerard de Melo Sungjin Ahn OCL DRL 21 132 0 06 Oct 2019
PISEP^2: Pseudo Image Sequence Evolution based 3D Pose Prediction Xiaoli Liu Jianqin Yin Huaping Liu Yilong Yin 3DH 22 7 0 04 Sep 2019
Compositional Video Prediction Yufei Ye Maneesh Singh Abhinav Gupta Shubham Tulsiani 18 84 0 22 Aug 2019
Adversarial Video Generation on Complex Datasets Aidan Clark Jeff Donahue Karen Simonyan VGen GAN 25 74 0 15 Jul 2019
Physics-as-Inverse-Graphics: Unsupervised Physical Parameter Estimation from Video Miguel Jaques Michael G. Burke Timothy M. Hospedales VGen PINN 15 44 0 27 May 2019
Point-to-Point Video Generation Tsun-Hsuan Wang Y. Cheng Chieh Hubert Lin Hwann-Tzong Chen Min Sun VGen DiffM 11 21 0 05 Apr 2019