Neural Voice Puppetry: Audio-driven Facial Reenactment

11 December 2019

Matthias Nießner

Papers citing "Neural Voice Puppetry: Audio-driven Facial Reenactment"

36 / 86 papers shown

Title
DAD-3DHeads: A Large-scale Dense, Accurate and Diverse Dataset for 3D Head Alignment from a Single Image T. Martyniuk Orest Kupyn Yana Kurlyak Igor Krashenyi Jivri V. Sharmanska 3DH 31 37 0 07 Apr 2022
StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGAN Fei Yin Yong Zhang Xiaodong Cun Ming Cao Yanbo Fan Xuanxia Wang Qingyan Bai Baoyuan Wu Jue Wang Yujiu Yang CVBM 43 171 0 08 Mar 2022
FSGANv2: Improved Subject Agnostic Face Swapping and Reenactment Y. Nirkin Y. Keller Tal Hassner PICV CVBM 27 35 0 25 Feb 2022
Audio-Driven Talking Face Video Generation with Dynamic Convolution Kernels Zipeng Ye Mengfei Xia Ran Yi Juyong Zhang Yu-Kun Lai Xuanteng Huang Guoxin Zhang Yong-jin Liu CVBM 22 39 0 16 Jan 2022
DFA-NeRF: Personalized Talking Head Generation via Disentangled Face Attributes Neural Rendering Shunyu Yao Ruizhe Zhong Yichao Yan Guangtao Zhai Xiaokang Yang CVBM 24 90 0 03 Jan 2022
FaceFormer: Speech-Driven 3D Facial Animation with Transformers Yingruo Fan Zhaojiang Lin Jun Saito Wenping Wang Taku Komura CVBM 52 195 0 10 Dec 2021
Neural Head Avatars from Monocular RGB Videos Philip-William Grassal Malte Prinzler Titus Leistner Carsten Rother Matthias Nießner Justus Thies 3DH 22 191 0 02 Dec 2021
Transformer-S2A: Robust and Efficient Speech-to-Animation Liyang Chen Zhiyong Wu Jun Ling Runnan Li Xu Tan Sheng Zhao 29 18 0 18 Nov 2021
Advances in Neural Rendering A. Tewari Justus Thies B. Mildenhall P. Srinivasan E. Tretschk ... S. Fanello Jun Zhu Gordon Wetzstein Michael Zollhoefer D. B. Goldman 3DH AI4CE 59 445 0 10 Nov 2021
Imitating Arbitrary Talking Style for Realistic Audio-DrivenTalking Face Synthesis Haozhe Wu Jia Jia Haoyu Wang Yishun Dou Chao Duan Qingshan Deng CVBM 11 73 0 30 Oct 2021
Neural Dubber: Dubbing for Videos According to Scripts Chenxu Hu Qiao Tian Tingle Li Yuping Wang Yuxuan Wang Hang Zhao DiffM VGen 36 39 0 15 Oct 2021
Live Speech Portraits: Real-Time Photorealistic Talking-Head Animation Yuanxun Lu Jinxiang Chai Xun Cao 29 82 0 22 Sep 2021
Evaluation of an Audio-Video Multimodal Deepfake Dataset using Unimodal and Multimodal Detectors Hasam Khalid Minhan Kim Shahroz Tariq Simon S. Woo 23 82 0 07 Sep 2021
Sparse to Dense Motion Transfer for Face Image Animation Ruiqi Zhao Tianyi Wu Guodong Guo 3DH CVBM 29 27 0 01 Sep 2021
FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Dataset Hasam Khalid Shahroz Tariq Minha Kim Simon S. Woo 36 185 0 11 Aug 2021
SGToolkit: An Interactive Gesture Authoring Toolkit for Embodied Conversational Agents Youngwoo Yoon Keunwoo Park Minsu Jang Jaehong Kim Geehyuk Lee VGen SLR 39 19 0 10 Aug 2021
Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion Suzhe Wang Lincheng Li Yu-qiong Ding Changjie Fan Xin Yu VGen 41 160 0 20 Jul 2021
Multi-modality Deep Restoration of Extremely Compressed Face Videos Xi Zhang Xiaolin Wu CVBM 22 13 0 05 Jul 2021
Productivity, Portability, Performance: Data-Centric Python Yiheng Wang Yao Zhang Yanzhang Wang Yan Wan Jiao Wang Zhongyuan Wu Yuhao Yang Bowen She 54 95 0 01 Jul 2021
NWT: Towards natural audio-to-video generation with representation learning Rayhane Mama Marc S. Tyndel Hashiam Kadhim Cole Clifford Ragavan Thurairatnam VGen 29 12 0 08 Jun 2021
LipSync3D: Data-Efficient Learning of Personalized 3D Talking Faces from Video using Pose and Lighting Normalization A. Lahiri Vivek Kwatra C. Frueh J. P. Lewis C. Bregler 3DH 38 99 0 08 Jun 2021
Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation Hang Zhou Yasheng Sun Wayne Wu Chen Change Loy Xiaogang Wang Ziwei Liu CVBM 28 360 0 22 Apr 2021
VariTex: Variational Neural Face Textures Marcel C. Bühler Abhimitra Meka Gengyan Li Thabo Beeler Otmar Hilliges 3DH 23 34 0 13 Apr 2021
Everything's Talkin': Pareidolia Face Reenactment Linsen Song Wayne Wu Chaoyou Fu Chao Qian Chen Change Loy Ran He CVBM 35 12 0 07 Apr 2021
Face Forensics in the Wild Tianfei Zhou Wenguan Wang Zhiyuan Liang Jianbing Shen CVBM 42 118 0 30 Mar 2021
FaceDet3D: Facial Expressions with 3D Geometric Detail Prediction ShahRukh Athar Albert Pumarola Francesc Moreno-Noguer Dimitris Samaras 3DH CVBM 25 7 0 14 Dec 2020
Robust One Shot Audio to Video Generation Neeraj Kumar Srishti Goel Ankur Narang H. Mujtaba VGen 27 13 0 14 Dec 2020
Iterative Text-based Editing of Talking-heads Using Neural Retargeting Xinwei Yao Ohad Fried Kayvon Fatahalian Maneesh Agrawala VGen 24 33 0 21 Nov 2020
Facial Keypoint Sequence Generation from Audio Prateek Manocha Prithwijit Guha 3DH VGen 23 0 0 02 Nov 2020
A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild Prajwal K R Rudrabha Mukhopadhyay Vinay P. Namboodiri C. V. Jawahar EGVM 52 757 0 23 Aug 2020
Audiovisual Speech Synthesis using Tacotron2 Ahmed Hussen Abdelaziz Anushree Prasanna Kumar Chloe Seivwright Gabriele Fanelli Justin Binder Y. Stylianou S. Kajarekar 20 15 0 03 Aug 2020
Modality Dropout for Improved Performance-driven Talking Faces Ahmed Hussen Abdelaziz B. Theobald Paul Dixon Reinhard Knothe N. Apostoloff Sachin Kajareker 24 36 0 27 May 2020
Audio-driven Talking Face Video Generation with Learning-based Personalized Head Pose Ran Yi Zipeng Ye Juyong Zhang Hujun Bao Yong-jin Liu CVBM 27 122 0 24 Feb 2020
A Neural Lip-Sync Framework for Synthesizing Photorealistic Virtual News Anchors Ruobing Zheng Zhou Zhu Bo Song Changjiang Ji 3DH 24 2 0 20 Feb 2020
Deep Learning for Deepfakes Creation and Detection: A Survey Thanh Thi Nguyen Quoc Viet Hung Nguyen Dung Nguyen D. Nguyen Thien Huynh-The S. Nahavandi Thanh Tam Nguyen Viet Quoc Pham Cu Nguyen 31 433 0 25 Sep 2019
Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis Ye Jia Yu Zhang Ron J. Weiss Quan Wang Jonathan Shen ... Z. Chen Patrick Nguyen Ruoming Pang Ignacio López Moreno Yonghui Wu 207 820 0 12 Jun 2018