Neural Voice Puppetry: Audio-driven Facial Reenactment

11 December 2019

Matthias Nießner

Papers citing "Neural Voice Puppetry: Audio-driven Facial Reenactment"

50 / 81 papers shown

Title
Steganography Beyond Space-Time with Chain of Multimodal AI Ching-Chun Chang Isao Echizen 74 0 0 25 Feb 2025
LaDTalk: Latent Denoising for Synthesizing Talking Head Videos with High Frequency Details Jian Yang Xukun Wang Wentao Wang Guoming Li Qihang Fang Ruihong Yuan Tianyang Wang Jason Zhaoxin Fan Yeying Jin Zhaoxin Fan VGen 47 1 0 01 Oct 2024
High-fidelity and Lip-synced Talking Face Synthesis via Landmark-based Diffusion Model Weizhi Zhong Junfan Lin Peixin Chen Liang Lin Guanbin Li 39 1 0 10 Aug 2024
Talk3D: High-Fidelity Talking Portrait Synthesis via Personalized 3D Generative Prior Jaehoon Ko Kyusun Cho Joungbin Lee Heeji Yoon Sangmin Lee Sangjun Ahn Seungryong Kim 34 2 0 29 Mar 2024
Context-aware Talking Face Video Generation Meidai Xuanyuan Yuwang Wang Honglei Guo Qionghai Dai DiffM 41 0 0 28 Feb 2024
AE-NeRF: Audio Enhanced Neural Radiance Field for Few Shot Talking Head Synthesis Dongze Li Kang Zhao Wei Wang Bo Peng Yingya Zhang Jing Dong Tien-Ping Tan DiffM VGen 27 12 0 18 Dec 2023
GMTalker: Gaussian Mixture-based Audio-Driven Emotional Talking Video Portraits Yibo Xia Lizhen Wang Xiang Deng Xiaoyan Luo Yunhong Wang Yebin Liu VGen 45 1 0 12 Dec 2023
Neural Text to Articulate Talk: Deep Text to Audiovisual Speech Synthesis achieving both Auditory and Photo-realism Georgios Milis P. Filntisis A. Roussos Petros Maragos CVBM 34 2 0 11 Dec 2023
AdaMesh: Personalized Facial Expressions and Head Poses for Adaptive Speech-Driven 3D Facial Animation Liyang Chen Weihong Bao Shunwei Lei Boshi Tang Zhiyong Wu Shiyin Kang Haozhi Huang Helen M. Meng 42 1 0 11 Oct 2023
Audio-Driven Dubbing for User Generated Contents via Style-Aware Semi-Parametric Synthesis Linsen Song Wayne Wu Chaoyou Fu Chen Change Loy Ran He 31 10 0 31 Aug 2023
AI-Generated Content (AIGC) for Various Data Modalities: A Survey Lin Geng Foo Hossein Rahmani Xiaozhong Liu 78 31 0 27 Aug 2023
Controlling Character Motions without Observable Driving Source Weiyuan Li Bin Dai Ziyi Zhou Qi Yao Baoyuan Wang VGen 8 1 0 11 Aug 2023
UniBriVL: Robust Universal Representation and Generation of Audio Driven Diffusion Models Sen Fang Bowen Gao Yangjian Wu T. Teoh DiffM 34 1 0 29 Jul 2023
AltFreezing for More General Video Face Forgery Detection Zhendong Wang Jianmin Bao Wen-gang Zhou Weilun Wang Houqiang Li ViT CVBM 37 65 0 17 Jul 2023
Audio-Driven 3D Facial Animation from In-the-Wild Videos Liying Lu Tianke Zhang Yunfei Liu Xuangeng Chu Yu Li VGen 47 3 0 20 Jun 2023
Emotional Speech-Driven Animation with Content-Emotion Disentanglement Radek Danvevcek Kiran Chhatre Shashank Tripathi Yandong Wen Michael J. Black Timo Bolkart 16 66 0 15 Jun 2023
DAE-Talker: High Fidelity Speech-Driven Talking Face Generation with Diffusion Autoencoder Chenpeng Du Qi Chen Xie Chen K. Yu DiffM 31 50 0 30 Mar 2023
MusicFace: Music-driven Expressive Singing Face Synthesis Peng Liu W. Deng Hengda Li Jintai Wang Yinglin Zheng Yiwei Ding Xiaohu Guo Ming Zeng CVBM 35 10 0 24 Mar 2023
Learning a 3D Morphable Face Reflectance Model from Low-cost Data Yuxuan Han Zhibo Wang Feng Xu 3DH 27 8 0 21 Mar 2023
EmoTalk: Speech-Driven Emotional Disentanglement for 3D Face Animation Ziqiao Peng Hao Wu Zhenbo Song Hao-Xuan Xu Xiangyu Zhu Jun He Hongyan Liu Zhaoxin Fan CVBM 33 99 0 20 Mar 2023
Exploring Efficient-Tuned Learning Audio Representation Method from BriVL Sen Fang Yang Wu Bowen Gao Jingwen Cai T. Teoh DiffM 29 1 0 08 Mar 2023
Cyber Vaccine for Deepfake Immunity Ching-Chun Chang H. Nguyen Junichi Yamagishi Isao Echizen 26 6 0 05 Mar 2023
READ Avatars: Realistic Emotion-controllable Audio Driven Avatars Jack D. Saunders Vinay P. Namboodiri VGen 21 11 0 01 Mar 2023
GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesis Zhenhui Ye Ziyue Jiang Yi Ren Jinglin Liu Jinzheng He Zhou Zhao CVBM 25 122 0 31 Jan 2023
Expressive Speech-driven Facial Animation with controllable emotions Yutong Chen Junhong Zhao Weiqiang Zhang 33 8 0 05 Jan 2023
Imitator: Personalized Speech-driven 3D Facial Animation Balamurugan Thambiraja I. Habibie S. Aliakbarian Darren Cosker Christian Theobalt Justus Thies CVBM 47 49 0 30 Dec 2022
Fighting Malicious Media Data: A Survey on Tampering Detection and Deepfake Detection Junke Wang Zhenxin Li Chao Zhang Jingjing Chen Zuxuan Wu Larry S. Davis Yueping Jiang AAML 37 5 0 12 Dec 2022
Memories are One-to-Many Mapping Alleviators in Talking Face Generation Anni Tang Tianyu He Xuejiao Tan Jun Ling Liang Song CVBM 26 23 0 09 Dec 2022
VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild K. Cheng Xiaodong Cun Yong Zhang Menghan Xia Fei Yin Mingrui Zhu Xuanxia Wang Jue Wang Nan Wang CVBM 25 92 0 27 Nov 2022
Real-time Neural Radiance Talking Portrait Synthesis via Audio-spatial Decomposition Jiaxiang Tang Kaisiyuan Wang Hang Zhou Xiaokang Chen Dongliang He Tianshu Hu Jingtuo Liu Gang Zeng Jingdong Wang 3DH 34 76 0 22 Nov 2022
SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation Wenxuan Zhang Xiaodong Cun Xuan Wang Yong Zhang Xiaodong Shen Yu-Xiao Guo Ying Shan Fei-Yue Wang VGen 35 233 0 22 Nov 2022
Disentangling Content and Motion for Text-Based Neural Video Manipulation Levent Karacan Tolga Kerimouglu .Ismail .Inan Tolga Birdal Erkut Erdem Aykut Erdem 29 1 0 05 Nov 2022
SyncTalkFace: Talking Face Generation with Precise Lip-Syncing via Audio-Lip Memory Se Jin Park Minsu Kim Joanna Hong J. Choi Y. Ro CVBM 30 85 0 02 Nov 2022
Reconstructing Personalized Semantic Facial NeRF Models From Monocular Video Xuan Gao Chenglai Zhong Jun Xiang Yang Hong Yudong Guo Juyong Zhang 3DH CVBM 69 128 0 12 Oct 2022
A Keypoint Based Enhancement Method for Audio Driven Free View Talking Head Synthesis Yichen Han Ya Li Yingming Gao Jinlong Xue Songpo Wang Lei Yang 21 2 0 07 Oct 2022
Continuously Controllable Facial Expression Editing in Talking Face Videos Zhiyao Sun Yu-Hui Wen Tian Lv Y. Sun Ziyang Zhang Yaoyuan Wang Yong Liu CVBM 37 10 0 17 Sep 2022
On the Horizon: Interactive and Compositional Deepfakes Eric Horvitz 16 27 0 05 Sep 2022
StableFace: Analyzing and Improving Motion Stability for Talking Face Generation Jun Ling Xuejiao Tan Liyang Chen Runnan Li Yuchao Zhang Sheng Zhao Liang Song CVBM 47 13 0 29 Aug 2022
Learning in Audio-visual Context: A Review, Analysis, and New Perspective Yake Wei Di Hu Yapeng Tian Xuelong Li 46 55 0 20 Aug 2022
Audio-driven Neural Gesture Reenactment with Video Motion Graphs Yang Zhou Jimei Yang Dingzeyu Li Jun Saito Deepali Aneja E. Kalogerakis DiffM SLR 42 20 0 23 Jul 2022
Perceptual Conversational Head Generation with Regularized Driver and Enhanced Renderer Ai-Mei Huang Zhewei Huang Shuchang Zhou VGen 32 7 0 26 Jun 2022
FlexLip: A Controllable Text-to-Lip System Dan Oneaţă Beáta Lőrincz Adriana Stan H. Cucu 23 3 0 07 Jun 2022
EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Model Xinya Ji Hang Zhou Kaisiyuan Wang Qianyi Wu Wayne Wu Feng Xu Xun Cao CVBM 57 157 0 30 May 2022
Deep Learning and Synthetic Media Raphaël Millière 23 18 0 11 May 2022
Emotion-Controllable Generalized Talking Face Generation Sanjana Sinha S. Biswas Ravindra Yadav Brojeshwar Bhowmick CVBM 15 49 0 02 May 2022
Towards Metrical Reconstruction of Human Faces Wojciech Zielonka Timo Bolkart Justus Thies CVBM 3DH 27 143 0 13 Apr 2022
DAD-3DHeads: A Large-scale Dense, Accurate and Diverse Dataset for 3D Head Alignment from a Single Image T. Martyniuk Orest Kupyn Yana Kurlyak Igor Krashenyi Jivri V. Sharmanska 3DH 28 37 0 07 Apr 2022
StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGAN Fei Yin Yong Zhang Xiaodong Cun Ming Cao Yanbo Fan Xuanxia Wang Qingyan Bai Baoyuan Wu Jue Wang Yujiu Yang CVBM 34 171 0 08 Mar 2022
FSGANv2: Improved Subject Agnostic Face Swapping and Reenactment Y. Nirkin Y. Keller Tal Hassner PICV CVBM 27 34 0 25 Feb 2022
Audio-Driven Talking Face Video Generation with Dynamic Convolution Kernels Zipeng Ye Mengfei Xia Ran Yi Juyong Zhang Yu-Kun Lai Xuanteng Huang Guoxin Zhang Yong-jin Liu CVBM 22 39 0 16 Jan 2022