v1v2v3 (latest)

MARLIN: Masked Autoencoder for facial video Representation LearnINg

12 November 2022

Zhixi Cai

Shreya Ghosh

Kalin Stefanov

Abhinav Dhall

Jianfei Cai

ArXiv (abs)PDF HTML Github (250★)

Papers citing "MARLIN: Masked Autoencoder for facial video Representation LearnINg"

50 / 63 papers shown

Title
Spatio-Temporal Fuzzy-oriented Multi-Modal Meta-Learning for Fine-grained Emotion Recognition Wenwen Qiang Yuxuan Yang Jingyao Wang Changwen Zheng 125 0 0 18 Dec 2024
Masked Image Modeling: A Survey Vlad Hondru Florinel-Alin Croitoru Shervin Minaee Radu Tudor Ionescu N. Sebe 149 8 0 13 Aug 2024
Representation Learning and Identity Adversarial Training for Facial Behavior Understanding Mang Ning A. A. Salah Itir Onal Ertugrul CVBM 132 4 0 15 Jul 2024
CelebV-HQ: A Large-Scale Video Facial Attributes Dataset Haoning Zhu Wayne Wu Wentao Zhu Liming Jiang Siwei Tang Li Zhang Ziwei Liu Chen Change Loy 109 168 0 25 Jul 2022
VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training Zhan Tong Yibing Song Jue Wang Limin Wang ViT 226 1,205 0 23 Mar 2022
Attention-Based Lip Audio-Visual Synthesis for Talking Face Generation in the Wild Gang Wang Peng Zhang Lei Xie Wei Huang Yufei Zha CVBM 51 16 0 08 Mar 2022
Generating Videos with Dynamics-aware Implicit Generative Adversarial Networks Sihyun Yu Jihoon Tack Sangwoo Mo Hyunsu Kim Junho Kim Jung-Woo Ha Jinwoo Shin DiffM VGen 102 201 0 21 Feb 2022
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language Alexei Baevski Wei-Ning Hsu Qiantong Xu Arun Babu Jiatao Gu Michael Auli SSL VLM ViT 97 859 0 07 Feb 2022
StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2 Ivan Skorokhodov Sergey Tulyakov Mohamed Elhoseiny VGen 89 288 0 29 Dec 2021
Are Large-scale Datasets Necessary for Self-Supervised Pre-training? Alaaeldin El-Nouby Gautier Izacard Hugo Touvron Ivan Laptev Hervé Jégou Edouard Grave SSL 89 151 0 20 Dec 2021
Masked Feature Prediction for Self-Supervised Visual Pre-Training Chen Wei Haoqi Fan Saining Xie Chaoxia Wu Alan Yuille Christoph Feichtenhofer ViT 149 670 0 16 Dec 2021
General Facial Representation Learning in a Visual-Linguistic Manner Yinglin Zheng Hao Yang Ting Zhang Jianmin Bao Dongdong Chen Yangyu Huang Lu Yuan Dong Chen Ming Zeng Fang Wen CVBM 185 173 0 06 Dec 2021
MViTv2: Improved Multiscale Vision Transformers for Classification and Detection Yanghao Li Chaoxia Wu Haoqi Fan K. Mangalam Bo Xiong Jitendra Malik Christoph Feichtenhofer ViT 153 693 0 02 Dec 2021
SimMIM: A Simple Framework for Masked Image Modeling Zhenda Xie Zheng Zhang Yue Cao Yutong Lin Jianmin Bao Zhuliang Yao Qi Dai Han Hu 202 1,362 0 18 Nov 2021
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 470 7,819 0 11 Nov 2021
Unsupervised Multimodal Language Representations using Convolutional Autoencoders Panagiotis Koromilas Theodoros Giannakopoulos SSL 73 10 0 06 Oct 2021
Speech2Video: Cross-Modal Distillation for Speech to Video Generation Shijing Si Jianzong Wang Xiaoyang Qu Ning Cheng Wenqi Wei Xinghua Zhu Jing Xiao VGen 52 15 0 10 Jul 2021
Intriguing Properties of Vision Transformers Muzammal Naseer Kanchana Ranasinghe Salman Khan Munawar Hayat Fahad Shahbaz Khan Ming-Hsuan Yang ViT 331 651 0 21 May 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 708 6,127 0 29 Apr 2021
Multiscale Vision Transformers Haoqi Fan Bo Xiong K. Mangalam Yanghao Li Zhicheng Yan Jitendra Malik Christoph Feichtenhofer ViT 135 1,265 0 22 Apr 2021
VideoGPT: Video Generation using VQ-VAE and Transformers Wilson Yan Yunzhi Zhang Pieter Abbeel A. Srinivas ViT VGen 310 512 0 20 Apr 2021
M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection Junke Wang Zuxuan Wu Wenhao Ouyang Xintong Han Jingjing Chen Ser-Nam Lim Yu-Gang Jiang ViT 160 269 0 20 Apr 2021
GANcraft: Unsupervised 3D Neural Rendering of Minecraft Worlds Jinwei Gu Arun Mallya Serge Belongie Ming-Yuan Liu 79 122 0 15 Apr 2021
Pre-training strategies and datasets for facial representation learning Adrian Bulat Shiyang Cheng Jing Yang A. Garbett Enrique Sanchez Georgios Tzimiropoulos CVBM SSL 51 36 0 30 Mar 2021
FaceX-Zoo: A PyTorch Toolbox for Face Recognition Jun Wang Yinglu Liu Yibo Hu Hailin Shi Tao Mei CVBM 91 102 0 12 Jan 2021
Transformers in Vision: A Survey Salman Khan Muzammal Naseer Munawar Hayat Syed Waqas Zamir Fahad Shahbaz Khan M. Shah ViT 305 2,528 0 04 Jan 2021
pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis E. R. Chan M. Monteiro Petr Kellnhofer Jiajun Wu Gordon Wetzstein GAN 119 855 0 02 Dec 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 670 41,430 0 22 Oct 2020
A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild Prajwal K R Rudrabha Mukhopadhyay Vinay P. Namboodiri C. V. Jawahar EGVM 103 788 0 23 Aug 2020
Few-shot Knowledge Transfer for Fine-grained Cartoon Face Generation Nan Zhuang Cheng Yang CVBM 44 9 0 27 Jul 2020
Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Clues Yuyang Qian Guojun Yin Lu Sheng Zixuan Chen Jing Shao CVBM 131 695 0 18 Jul 2020
A Transformer-based joint-encoding for Emotion Recognition and Sentiment Analysis Jean-Benoit Delbrouck Noé Tits Mathilde Brousmiche Stéphane Dupont 68 112 0 29 Jun 2020
Generalized Zero and Few-Shot Transfer for Facial Forgery Detection Shivangi Aneja Matthias Nießner 53 43 0 21 Jun 2020
Towards Automatic Face-to-Face Translation Prajwal K R Rudrabha Mukhopadhyay Jerin Philip Abhishek Jha Vinay P. Namboodiri C. V. Jawahar CVBM 98 175 0 01 Mar 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 375 18,859 0 13 Feb 2020
DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detection Ruben Tolosana R. Vera-Rodríguez Julian Fierrez Aythami Morales J. Ortega-Garcia 3DPC CVBM 97 794 0 01 Jan 2020
Face X-ray for More General Face Forgery Detection Lingzhi Li Jianmin Bao Ting Zhang Hao Yang Dong Chen Fang Wen B. Guo PICV CVBM 74 847 0 31 Dec 2019
StarGAN v2: Diverse Image Synthesis for Multiple Domains Yunjey Choi Youngjung Uh Jaejun Yoo Jung-Woo Ha 3DH 129 1,756 0 04 Dec 2019
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 532 42,591 0 03 Dec 2019
3FabRec: Fast Few-shot Face alignment by Reconstruction Bjoern Browatzki C. Wallraven CVBM 82 67 0 24 Nov 2019
Large Scale Adversarial Representation Learning Jeff Donahue Karen Simonyan SSL 130 544 0 04 Jul 2019
FaceForensics++: Learning to Detect Manipulated Facial Images Andreas Rossler D. Cozzolino L. Verdoliva Christian Riess Justus Thies Matthias Nießner CVBM 111 2,095 0 25 Jan 2019
DeepFakes: a New Threat to Face Recognition? Assessment and Detection Pavel Korshunov S´ebastien Marcel PICV CVBM 69 607 0 20 Dec 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,175 0 11 Oct 2018
MesoNet: a Compact Facial Video Forgery Detection Network Darius Afchar Vincent Nozick Junichi Yamagishi Isao Echizen CVBM PICV 83 1,260 0 04 Sep 2018
ReenactGAN: Learning to Reenact Faces via Boundary Transfer Wayne Wu Yunxuan Zhang Cheng Li Chao Qian Chen Change Loy CVBM ViT 78 201 0 29 Jul 2018
VoxCeleb2: Deep Speaker Recognition Joon Son Chung Arsha Nagrani Andrew Zisserman 356 2,287 0 14 Jun 2018
Deep Facial Expression Recognition: A Survey Shan Li Weihong Deng 192 1,299 0 23 Apr 2018
Multi-attention Recurrent Network for Human Communication Comprehension Amir Zadeh Paul Pu Liang Soujanya Poria Prateek Vij Min Zhang Louis-Philippe Morency 77 485 0 03 Feb 2018
A Closer Look at Spatiotemporal Convolutions for Action Recognition Du Tran Heng Wang Lorenzo Torresani Jamie Ray Yann LeCun Manohar Paluri 235 3,033 0 30 Nov 2017