Predicting Video with VQVAE

2 March 2021

Ali Razavi

Papers citing "Predicting Video with VQVAE"

50 / 51 papers shown

Title
LLaRA: Supercharging Robot Learning Data for Vision-Language Policy Xiang Li Cristina Mata J. Park Kumara Kahatapitiya Yoo Sung Jang ... Kanchana Ranasinghe R. Burgert Mu Cai Yong Jae Lee Michael S. Ryoo LM&Ro 86 26 0 28 Jun 2024
Jukebox: A Generative Model for Music Prafulla Dhariwal Heewoo Jun Christine Payne Jong Wook Kim Alec Radford Ilya Sutskever VLM 80 731 0 30 Apr 2020
Transformation-based Adversarial Video Prediction on Large-Scale Data Pauline Luc Aidan Clark Sander Dieleman Diego de Las Casas Yotam Doron Albin Cassirer Karen Simonyan VGen 253 86 0 09 Mar 2020
Scaling Autoregressive Video Models Dirk Weissenborn Oscar Täckström Jakob Uszkoreit DiffM VGen 60 200 0 06 Jun 2019
Generating Diverse High-Fidelity Images with VQ-VAE-2 Ali Razavi Aaron van den Oord Oriol Vinyals DRL BDL 87 1,788 0 02 Jun 2019
Recurrent Convolutional Strategies for Face Manipulation Detection in Videos Ekraam Sabir Jiaxin Cheng Ayush Jaiswal Wael AbdAlmageed I. Masi Premkumar Natarajan AAML CVBM 82 455 0 02 May 2019
Hierarchical Autoregressive Image Models with Auxiliary Decoders J. Fauw Sander Dieleman Karen Simonyan GAN 43 37 0 06 Mar 2019
VideoFlow: A Conditional Flow-Based Model for Stochastic Video Generation Manoj Kumar Mohammad Babaeizadeh D. Erhan Chelsea Finn Sergey Levine Laurent Dinh Durk Kingma VGen 38 131 0 04 Mar 2019
On the generalization of GAN image forensics Xinsheng Xuan Bo Peng Wei Wang Jing Dong CVBM 23 142 0 27 Feb 2019
Generating High Fidelity Images with Subscale Pixel Networks and Multidimensional Upscaling Jacob Menick Nal Kalchbrenner 41 150 0 04 Dec 2018
Towards Accurate Generative Models of Video: A New Metric & Challenges Thomas Unterthiner Sjoerd van Steenkiste Karol Kurach Raphaël Marinier Marcin Michalski Sylvain Gelly EGVM VGen 45 711 0 03 Dec 2018
Disentangling Propagation and Generation for Video Prediction Hang Gao Huazhe Xu Qi-Zhi Cai Ruth Wang Feng Yu Trevor Darrell 32 84 0 02 Dec 2018
Large Scale GAN Training for High Fidelity Natural Image Synthesis Andrew Brock Jeff Donahue Karen Simonyan 194 5,363 0 28 Sep 2018
MesoNet: a Compact Facial Video Forgery Detection Network Darius Afchar Vincent Nozick Junichi Yamagishi Isao Echizen CVBM PICV 49 1,241 0 04 Sep 2018
A Short Note about Kinetics-600 João Carreira Eric Noland Andras Banki-Horvath Chloe Hillier Andrew Zisserman 54 520 0 03 Aug 2018
Flow-Grounded Spatial-Temporal Video Prediction from Still Images Yijun Li Chen Fang Jimei Yang Zhaowen Wang Xin Lu Ming-Hsuan Yang 3DH 37 138 0 25 Jul 2018
Video Prediction with Appearance and Motion Conditions Y. Jang Gunhee Kim Yale Song VGen 55 44 0 07 Jul 2018
The challenge of realistic music generation: modelling raw audio at scale Sander Dieleman Aaron van den Oord Karen Simonyan 41 184 0 26 Jun 2018
Fighting Fake News: Image Splice Detection via Learned Self-Consistency Minyoung Huh Andrew Liu Andrew Owens Alexei A. Efros SSL 59 383 0 10 May 2018
Stochastic Adversarial Video Prediction Alex X. Lee Richard Y. Zhang F. Ebert Pieter Abbeel Chelsea Finn Sergey Levine DRL VGen GAN 41 450 0 04 Apr 2018
Predicting Future Instance Segmentation by Forecasting Convolutional Features Pauline Luc Camille Couprie Yann LeCun Jakob Verbeek 47 92 0 30 Mar 2018
World Models David R Ha Jürgen Schmidhuber SyDa 88 1,050 0 27 Mar 2018
Stochastic Video Generation with a Learned Prior Emily L. Denton Rob Fergus VGen 61 525 0 21 Feb 2018
PixelSNAIL: An Improved Autoregressive Generative Model Xi Chen Nikhil Mishra Mostafa Rohaninejad Pieter Abbeel DRL DiffM BDL GAN 48 270 0 28 Dec 2017
Folded Recurrent Neural Networks for Future Video Prediction Marc Oliu Javier Selva Sergio Escalera 38 135 0 01 Dec 2017
Neural Discrete Representation Learning Aaron van den Oord Oriol Vinyals Koray Kavukcuoglu BDL SSL OCL 139 4,928 0 02 Nov 2017
Stochastic Variational Video Prediction Mohammad Babaeizadeh Chelsea Finn D. Erhan R. Campbell Sergey Levine DRL VGen 51 540 0 30 Oct 2017
Progressive Growing of GANs for Improved Quality, Stability, and Variation Tero Karras Timo Aila S. Laine J. Lehtinen GAN 93 7,318 0 27 Oct 2017
Self-Supervised Visual Planning with Temporal Skip Connections F. Ebert Chelsea Finn Alex X. Lee Sergey Levine SSL 55 318 0 15 Oct 2017
Learning to Generate Time-Lapse Videos Using Multi-Stage Dynamic Generative Adversarial Networks Wei Xiong Wenhan Luo Lin Ma Wen Liu Jiebo Luo GAN 36 181 0 22 Sep 2017
Imagination-Augmented Agents for Deep Reinforcement Learning T. Weber S. Racanière David P. Reichert Lars Buesing A. Guez ... Razvan Pascanu Peter W. Battaglia Demis Hassabis David Silver Daan Wierstra LM&Ro 63 552 0 19 Jul 2017
MoCoGAN: Decomposing Motion and Content for Video Generation Sergey Tulyakov Ming-Yuan Liu Xiaodong Yang Jan Kautz GAN 104 1,138 0 17 Jul 2017
Decomposing Motion and Content for Natural Video Sequence Prediction Ruben Villegas Jimei Yang Seunghoon Hong Xunyu Lin Honglak Lee 37 595 0 25 Jun 2017
The Pose Knows: Video Forecasting by Generating Pose Futures Jacob Walker Kenneth Marino Abhinav Gupta M. Hebert 48 351 0 28 Apr 2017
Learning to Generate Long-term Future via Hierarchical Prediction Ruben Villegas Jimei Yang Yuliang Zou Sungryull Sohn Xunyu Lin Honglak Lee 46 380 0 19 Apr 2017
Predicting Deeper into the Future of Semantic Segmentation Pauline Luc Natalia Neverova Camille Couprie Jakob Verbeek Yann LeCun 43 243 0 22 Mar 2017
Parallel Multiscale Autoregressive Density Estimation Scott E. Reed Aaron van den Oord Nal Kalchbrenner Sergio Gomez Colmenarejo Ziyun Wang Dan Belov Nando de Freitas BDL 55 204 0 10 Mar 2017
WaveNet: A Generative Model for Raw Audio Aaron van den Oord Sander Dieleman Heiga Zen Karen Simonyan Oriol Vinyals Alex Graves Nal Kalchbrenner A. Senior Koray Kavukcuoglu DiffM 229 7,361 0 12 Sep 2016
Generating Videos with Scene Dynamics Carl Vondrick Hamed Pirsiavash Antonio Torralba GAN VGen 133 1,464 0 08 Sep 2016
Visual Dynamics: Probabilistic Future Frame Synthesis via Cross Convolutional Networks Tianfan Xue Jiajun Wu Katherine Bouman Bill Freeman 54 415 0 09 Jul 2016
An Uncertain Future: Forecasting from Static Images using Variational Autoencoders Jacob Walker Carl Doersch Abhinav Gupta M. Hebert VGen 28 513 0 25 Jun 2016
A Systematic Evaluation and Benchmark for Person Re-Identification: Features, Metrics, and Datasets Srikrishna Karanam Mengran Gou Ziyan Wu Angels Rates-Borras Mario Sznaier Richard J. Radke 58 1,008 0 31 May 2016
Unsupervised Learning for Physical Interaction through Video Prediction Chelsea Finn Ian Goodfellow Sergey Levine 43 1,042 0 23 May 2016
Pixel Recurrent Neural Networks Aaron van den Oord Nal Kalchbrenner Koray Kavukcuoglu SSeg GAN 360 2,563 0 25 Jan 2016
Spatio-temporal video autoencoder with differentiable memory Viorica Patraucean Ankur Handa R. Cipolla 56 307 0 19 Nov 2015
Deep multi-scale video prediction beyond mean square error Michaël Mathieu Camille Couprie Yann LeCun GAN 90 1,881 0 17 Nov 2015
A note on the evaluation of generative models Lucas Theis Aaron van den Oord Matthias Bethge EGVM 55 1,139 0 05 Nov 2015
Action-Conditional Video Prediction using Deep Networks in Atari Games Junhyuk Oh Xiaoxiao Guo Honglak Lee Richard L. Lewis Satinder Singh 64 852 0 31 Jul 2015
Unsupervised Learning of Video Representations using LSTMs Nitish Srivastava Elman Mansimov Ruslan Salakhutdinov SSL 107 2,586 0 16 Feb 2015
Video (language) modeling: a baseline for generative models of natural videos MarcÁurelio Ranzato Arthur Szlam Joan Bruna Michaël Mathieu R. Collobert S. Chopra VGen 62 471 0 20 Dec 2014