GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesis

31 January 2023

Zhou Zhao

Papers citing "GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesis"

50 / 79 papers shown

Title
SE4Lip: Speech-Lip Encoder for Talking Head Synthesis to Solve Phoneme-Viseme Alignment Ambiguity Yihuan Huang Jiajun Liu Yanzhen Ren Wuyang Liu Juhua Tang 24 0 0 08 Apr 2025
OmniTalker: Real-Time Text-Driven Talking Head Generation with In-Context Audio-Visual Style Replication Zhongjian Wang Peng Zhang Jinwei Qi Guangyuan Wang Sheng Xu Bang Zhang Liefeng Bo DiffM VGen 38 0 0 03 Apr 2025
STSA: Spatial-Temporal Semantic Alignment for Visual Dubbing Zijun Ding Mingdie Xiong Congcong Zhu Jingrun Chen DiffM 61 0 0 29 Mar 2025
ChatAnyone: Stylized Real-time Portrait Video Generation with Hierarchical Motion Diffusion Model Jinwei Qi Chaonan Ji Sheng Xu Peng Zhang Bang Zhang Liefeng Bo DiffM VGen 45 1 0 27 Mar 2025
Dual Audio-Centric Modality Coupling for Talking Head Generation Ao Fu Ziqi Ni Yi Zhou 37 1 0 26 Mar 2025
UniSync: A Unified Framework for Audio-Visual Synchronization Tao Feng Yifan Xie Xun Guan Jiyuan Song Z. Liu Fei Ma Fei Richard Yu 78 1 0 20 Mar 2025
SyncDiff: Diffusion-based Talking Head Synthesis with Bottlenecked Temporal Visual Prior for Improved Synchronization Xulin Fan Heting Gao Ziyi Chen Peng Chang Mei Han Mark Hasegawa-Johnson DiffM 62 0 0 17 Mar 2025
Cafe-Talk: Generating 3D Talking Face Animation with Multimodal Coarse- and Fine-grained Control Hejia Chen Haoxian Zhang Shoulong Zhang Xiaoqiang Liu Sisi Zhuang Yuan Zhang Pengfei Wan Di Zhang Shuai Li 59 1 0 14 Mar 2025
Cosh-DiT: Co-Speech Gesture Video Synthesis via Hybrid Audio-Visual Diffusion Transformers Yasheng Sun Zhiliang Xu Hang Zhou Jiazhi Guan Quanwei Yang ... Yingying Li Haocheng Feng Jiadong Wang Ziwei Liu Koike Hideki VGen 61 0 0 13 Mar 2025
InsTaG: Learning Personalized 3D Talking Head from Few-Second Video Jiahe Li Jiawei Zhang Xiao Bai Jin Zheng J. Zhou L. Gu 62 0 0 27 Feb 2025
FLAP: Fully-controllable Audio-driven Portrait Video Generation through 3D head conditioned diffusion model Lingzhou Mu Baiji Liu Ruonan Zhang Guiming Mo Jiawei Jin Kai Zhang Haozhi Huang DiffM VGen 56 1 0 26 Feb 2025
OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Models Gaojie Lin Jianwen Jiang Jiaqi Yang Zerong Zheng Chao Liang DiffM VGen 185 12 0 03 Feb 2025
DEGSTalk: Decomposed Per-Embedding Gaussian Fields for Hair-Preserving Talking Face Synthesis Kaijun Deng Dezhi Zheng Jindong Xie Jinbao Wang Weicheng Xie L. Shen Siyang Song 3DGS 37 0 0 31 Dec 2024
FADA: Fast Diffusion Avatar Synthesis with Mixed-Supervised Multi-CFG Distillation Tianyun Zhong Chao Liang Jianwen Jiang Gaojie Lin Jiaqi Yang Zhou Zhao DiffM 102 1 0 22 Dec 2024
Towards More Accurate Fake Detection on Images Generated from Advanced Generative and Neural Rendering Models Chengdong Dong Vijayakumar Bhagavatula Zhenyu Zhou Ajay Kumar 36 0 0 13 Nov 2024
MimicTalk: Mimicking a personalized and expressive 3D talking face in minutes Zhenhui Ye Tianyun Zhong Yi Ren Ziyue Jiang Jiawei Huang ... Chen Zhang Zehan Wang Xize Chen Xiang Yin Zhou Zhao VGen 39 3 0 09 Oct 2024
EmoGene: Audio-Driven Emotional 3D Talking-Head Generation Wenqing Wang Yun Fu VGen 79 0 0 07 Oct 2024
LaDTalk: Latent Denoising for Synthesizing Talking Head Videos with High Frequency Details Jian Yang Xukun Wang Wentao Wang Guoming Li Qihang Fang Ruihong Yuan Tianyang Wang Jason Zhaoxin Fan Yeying Jin Zhaoxin Fan VGen 47 1 0 01 Oct 2024
Learning Frame-Wise Emotion Intensity for Audio-Driven Talking-Head Generation Jingyi Xu Hieu Le Zhixin Shu Yang Wang Yi-Hsuan Tsai Dimitris Samaras 34 0 0 29 Sep 2024
DreamHead: Learning Spatial-Temporal Correspondence via Hierarchical Diffusion for Audio-driven Talking Head Synthesis Fa-Ting Hong Yunfei Liu Yu Li Changyin Zhou Fei Yu D. Xu DiffM 35 0 0 16 Sep 2024
EMOdiffhead: Continuously Emotional Control in Talking Head Generation via Diffusion Jian Zhang Weijian Mai Zhijun Zhang VGen 37 0 0 11 Sep 2024
PersonaTalk: Bring Attention to Your Persona in Visual Dubbing Longhao Zhang Shuang Liang Zhipeng Ge Tianshu Hu DiffM VGen 29 5 0 09 Sep 2024
S^3D-NeRF: Single-Shot Speech-Driven Neural Radiance Field for High Fidelity Talking Head Synthesis Dongze Li Kang Zhao Wei Wang Yifeng Ma Bo Peng Yingya Zhang Jing Dong 3DH CVBM 35 2 0 18 Aug 2024
High-fidelity and Lip-synced Talking Face Synthesis via Landmark-based Diffusion Model Weizhi Zhong Junfan Lin Peixin Chen Liang Lin Guanbin Li 39 1 0 10 Aug 2024
Style-Preserving Lip Sync via Audio-Aware Style Reference Weizhi Zhong Jichang Li Yinqi Cai Liang Lin Guanbin Li 35 2 0 10 Aug 2024
ReSyncer: Rewiring Style-based Generator for Unified Audio-Visually Synced Facial Performer Jiazhi Guan Zhiliang Xu Hang Zhou Kaisiyuan Wang Shengyi He ... Errui Ding Jingtuo Liu Jingdong Wang Youjian Zhao Ziwei Liu VGen 54 2 0 06 Aug 2024
EmoTalk3D: High-Fidelity Free-View Synthesis of Emotional 3D Talking Head Qianyun He Xinya Ji Ruichen Zheng Yuanxun Lu Zhengyu Diao ... Songcen Xu Xiaofei Wu Zixiao Zhang Xun Cao Hao Zhu 34 4 0 01 Aug 2024
Text-based Talking Video Editing with Cascaded Conditional Diffusion Bo Han Heqing Zou Haoyang Li Guangcong Wang Chng Eng Siong VGen DiffM 37 2 0 20 Jul 2024
RealTalk: Real-time and Realistic Audio-driven Face Generation with 3D Facial Prior-guided Identity Alignment Network Xiaozhong Ji Chuming Lin Zhonggan Ding Ying Tai Junwei Zhu Xiaobin Hu Donghao Luo Yanhao Ge Chengjie Wang CVBM 32 2 0 26 Jun 2024
NLDF: Neural Light Dynamic Fields for Efficient 3D Talking Head Generation Niu Guanchen 3DH 47 0 0 17 Jun 2024
A Comprehensive Taxonomy and Analysis of Talking Head Synthesis: Techniques for Portrait Generation, Driving Mechanisms, and Editing Ming Meng Yufei Zhao Bo Zhang Yonggui Zhu Weimin Shi Maxwell Wen Zhaoxin Fan VGen 46 1 0 15 Jun 2024
Controllable Talking Face Generation by Implicit Facial Keypoints Editing Dong Zhao Jiaying Shi Wenjun Li Shudong Wang Shenghui Xu Zhaoming Pan CVBM 49 0 0 05 Jun 2024
NeRFFaceSpeech: One-shot Audio-driven 3D Talking Head Synthesis via Generative Prior Gihoon Kim Kwanggyoon Seo Sihun Cha Junyong Noh DiffM 3DH 42 1 0 09 May 2024
Audio-Visual Speech Representation Expert for Enhanced Talking Face Video Generation and Evaluation Dogucan Yaman Fevziye Irem Eyiokur Leonard Barmann Seymanur Akti H. K. Ekenel Alexander H. Waibel EGVM 33 9 0 07 May 2024
GSTalker: Real-time Audio-Driven Talking Face Generation via Deformable Gaussian Splatting Bo Chen Shoukang Hu Qi Chen Chenpeng Du Ran Yi Yanmin Qian Xie Chen 3DGS 15 8 0 29 Apr 2024
TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splatting Jiahe Li Jiawei Zhang Xiao Bai Jin Zheng Xin Ning Jun Zhou Lin Gu 3DGS 48 15 0 23 Apr 2024
GaussianTalker: Speaker-specific Talking Head Synthesis via 3D Gaussian Splatting Hongyun Yu Zhan Qu Qihang Yu Jianchuan Chen Zhonghua Jiang ... Shengyu Zhang Jimin Xu Fei Wu Chengfei Lv Gang Yu 3DGS 38 12 0 22 Apr 2024
Talk3D: High-Fidelity Talking Portrait Synthesis via Personalized 3D Generative Prior Jaehoon Ko Kyusun Cho Joungbin Lee Heeji Yoon Sangmin Lee Sangjun Ahn Seungryong Kim 34 2 0 29 Mar 2024
MI-NeRF: Learning a Single Face NeRF from Multiple Identities Aggelina Chatziagapi Grigorios G. Chrysos Dimitris Samaras CVBM 45 2 0 29 Mar 2024
Beyond Talking -- Generating Holistic 3D Human Dyadic Motion for Communication Mingze Sun Chao Xu Xinyu Jiang Yang Liu Baigui Sun Ruqi Huang 49 3 0 28 Mar 2024
MoDiTalker: Motion-Disentangled Diffusion Model for High-Fidelity Talking Head Generation Seyeon Kim Siyoon Jin Jihye Park Kihong Kim Jiyoung Kim Jisu Nam Seungryong Kim DiffM VGen 66 3 0 28 Mar 2024
AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation Huawei Wei Zejun Yang Zhisheng Wang VGen DiffM 28 68 0 26 Mar 2024
VLOGGER: Multimodal Diffusion for Embodied Avatar Synthesis Enric Corona Andrei Zanfir Eduard Gabriel Bazavan Nikos Kolotouros Thiemo Alldieck C. Sminchisescu VGen DiffM 43 26 0 13 Mar 2024
Style2Talker: High-Resolution Talking Head Generation with Emotion Style and Art Style Shuai Tan Bin Ji Ye Pan 40 19 0 11 Mar 2024
Audio-Synchronized Visual Animation Lin Zhang Shentong Mo Yijing Zhang Pedro Morgado DiffM 43 19 0 08 Mar 2024
Learning Dynamic Tetrahedra for High-Quality Talking Head Synthesis Zicheng Zhang Ruobing Zheng Ziwen Liu Congying Han Tianqi Li Meng Wang Tiande Guo Jingdong Chen Bonan li Ming Yang 3DH 32 5 0 27 Feb 2024
NeRF-AD: Neural Radiance Field with Attention-based Disentanglement for Talking Face Synthesis Chongke Bi Xiaoxing Liu Zhilei Liu DiffM CVBM 29 4 0 23 Jan 2024
Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis Zhenhui Ye Tianyun Zhong Yi Ren Jiaqi Yang Weichuang Li ... Jinglin Liu Chen Zhang Xiang Yin Zejun Ma Zhou Zhao 32 45 0 16 Jan 2024
Dubbing for Everyone: Data-Efficient Visual Dubbing using Neural Rendering Priors Jack D. Saunders Vinay P. Namboodiri VGen DiffM 31 1 0 11 Jan 2024
DREAM-Talk: Diffusion-based Realistic Emotional Audio-driven Method for Single Image Talking Face Generation Chenxu Zhang Chao Wang Jianfeng Zhang Hongyi Xu Guoxian Song You Xie Linjie Luo Yapeng Tian Xiaohu Guo Jiashi Feng 38 19 0 21 Dec 2023