GSTalker: Real-time Audio-Driven Talking Face Generation via Deformable
Gaussian Splatting

GSTalker: Real-time Audio-Driven Talking Face Generation via Deformable Gaussian Splatting

29 April 2024

Chenpeng Du

Xie Chen

Papers citing "GSTalker: Real-time Audio-Driven Talking Face Generation via Deformable Gaussian Splatting"

12 / 12 papers shown

Title
3DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splatting Zhiyin Qian Shaofei Wang Marko Mihajlovic Andreas Geiger Siyu Tang 3DGS 53 110 0 14 Dec 2023
Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstruction Ziyi Yang Xinyu Gao Wenming Zhou Shaohui Jiao Yuqing Zhang Xiaogang Jin 3DGS 92 374 0 22 Sep 2023
GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesis Zhenhui Ye Ziyue Jiang Yi Ren Jinglin Liu Jinzheng He Zhou Zhao CVBM 63 125 0 31 Jan 2023
SPACE: Speech-driven Portrait Animation with Controllable Expression Francesco Ferroni Arun Mallya Ting-Chun Wang Rafael Valle Xuan Li VGen 46 47 0 17 Nov 2022
Instant Neural Graphics Primitives with a Multiresolution Hash Encoding Thomas Müller Alex Evans Christoph Schied A. Keller 257 3,970 0 16 Jan 2022
Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction Cheng Sun Min Sun Hwann-Tzong Chen 106 1,063 0 22 Nov 2021
HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units Wei-Ning Hsu Benjamin Bolte Yao-Hung Hubert Tsai Kushal Lakhotia Ruslan Salakhutdinov Abdel-rahman Mohamed SSL 127 2,879 0 14 Jun 2021
Nerfies: Deformable Neural Radiance Fields Keunhong Park U. Sinha Jonathan T. Barron Sofien Bouaziz Dan B. Goldman S. M. Seitz Ricardo Martín Brualla 3DH 115 1,123 0 25 Nov 2020
A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild Prajwal K R Rudrabha Mukhopadhyay Vinay P. Namboodiri C. V. Jawahar EGVM 77 772 0 23 Aug 2020
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations Alexei Baevski Henry Zhou Abdel-rahman Mohamed Michael Auli SSL 179 5,734 0 20 Jun 2020
MaskGAN: Towards Diverse and Interactive Facial Image Manipulation Cheng-Han Lee Ziwei Liu Lingyun Wu Ping Luo CVBM 134 1,070 0 27 Jul 2019
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric Richard Y. Zhang Phillip Isola Alexei A. Efros Eli Shechtman Oliver Wang EGVM 297 11,610 0 11 Jan 2018