v1v2 (latest)

Beyond Fixed Topologies: Unregistered Training and Comprehensive Evaluation Metrics for 3D Talking Heads

14 October 2024

Papers citing "Beyond Fixed Topologies: Unregistered Training and Comprehensive Evaluation Metrics for 3D Talking Heads"

50 / 52 papers shown

Title
EmoVOCA: Speech-Driven Emotional 3D Talking HeadsIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2024 Federico Nocentini Claudio Ferrari Stefano Berretti 267 9 0 19 Mar 2024
ScanTalk: 3D Talking Heads from Unregistered Scans Federico Nocentini T. Besnier Claudio Ferrari Sylvain Arguillere Stefano Berretti Mohamed Daoudi 275 12 0 16 Mar 2024
FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head ModelsComputer Vision and Pattern Recognition (CVPR), 2023 Shivangi Aneja Justus Thies Angela Dai Matthias Nießner DiffM VGen 339 50 0 13 Dec 2023
DiffPoseTalk: Speech-Driven Stylistic 3D Facial Animation and Head Pose Generation via Diffusion ModelsACM Transactions on Graphics (TOG), 2023 Zhiyao Sun Tian Lv Sheng Ye Matthieu Lin Jenny Sheng Yuhui Wen Minjing Yu Yong Liu DiffM 296 78 0 30 Sep 2023
FaceDiffuser: Speech-Driven 3D Facial Animation Synthesis Using DiffusionMotion in Games (MiG), 2023 Stefan Stan Kazi Injamamul Haque Zerrin Yumak DiffM 248 84 0 20 Sep 2023
Toward Mesh-Invariant 3D Generative Deep Learning with Geometric MeasuresComputers & graphics (CG), 2023 T. Besnier Sylvain Arguillere E. Pierson Mohamed Daoudi 3DH 152 10 0 27 Jun 2023
SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking FacesACM Multimedia (ACM MM), 2023 Ziqiao Peng Yihao Luo Yue Shi Hao-Xuan Xu Xiangyu Zhu Jun He Hongyan Liu Zhaoxin Fan 209 60 0 19 Jun 2023
Emotional Speech-Driven Animation with Content-Emotion DisentanglementACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia), 2023 Radek Danvevcek Kiran Chhatre Shashank Tripathi Yandong Wen Michael J. Black Timo Bolkart 224 98 0 15 Jun 2023
Emotional Talking Head Generation based on Memory-Sharing and Attention-Augmented NetworksInterspeech (Interspeech), 2023 Jianrong Wang Yaxin Zhao Li Liu Tian-Shun Xu Qi Li Sen Li 162 12 0 06 Jun 2023
Learning Landmarks Motion from Speech for Speaker-Agnostic 3D Talking Heads GenerationInternational Conference on Image Analysis and Processing (ICIAP), 2023 Federico Nocentini Claudio Ferrari Stefano Berretti 126 8 0 02 Jun 2023
Neural Face Rigging for Animating and Retargeting Facial Meshes in the WildInternational Conference on Computer Graphics and Interactive Techniques (SIGGRAPH), 2023 Dafei Qin Jun Saito Noam Aigerman Thibault Groueix Taku Komura 3DH CVBM 165 30 0 15 May 2023
Identity-Preserving Talking Face Generation with Landmark and Appearance PriorsComputer Vision and Pattern Recognition (CVPR), 2023 Wei‐Tao Zhong Chaowei Fang Yinqi Cai Pengxu Wei Gangming Zhao Liang Lin Guanbin Li 221 116 0 15 May 2023
4D Facial Expression Diffusion Model K. Zou S. Faisan Boyang Yu S. Valette Hyewon Seo 179 19 0 29 Mar 2023
EmoTalk: Speech-Driven Emotional Disentanglement for 3D Face AnimationIEEE International Conference on Computer Vision (ICCV), 2023 Ziqiao Peng Hao Wu Zhenbo Song Hao-Xuan Xu Xiangyu Zhu Jun He Hongyan Liu Zhaoxin Fan CVBM 301 155 0 20 Mar 2023
FaceXHuBERT: Text-less Speech-driven E(X)pressive 3D Facial Animation Synthesis Using Self-Supervised Speech Representation LearningInternational Conference on Multimodal Interaction (ICMI), 2023 Kazi Injamamul Haque Zerrin Yumak 151 39 0 09 Mar 2023
CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion PriorComputer Vision and Pattern Recognition (CVPR), 2023 Jinbo Xing Menghan Xia Yuechen Zhang Xiaodong Cun Jue Wang T. Wong 248 188 0 06 Jan 2023
Imitator: Personalized Speech-driven 3D Facial AnimationIEEE International Conference on Computer Vision (ICCV), 2022 Balamurugan Thambiraja I. Habibie S. Aliakbarian Darren Cosker Christian Theobalt Justus Thies CVBM 184 83 0 30 Dec 2022
Generating Holistic 3D Human Motion from SpeechComputer Vision and Pattern Recognition (CVPR), 2022 Hongwei Yi Hualin Liang Yifei Liu Qiong Cao Yandong Wen Timo Bolkart Dacheng Tao Michael J. Black SLR 225 188 0 08 Dec 2022
SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face AnimationComputer Vision and Pattern Recognition (CVPR), 2022 Wenxuan Zhang Xiaodong Cun Xuan Wang Yong Zhang Xiaodong Shen Yu-Xiao Guo Ying Shan Haiwei Yang VGen 187 369 0 22 Nov 2022
Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical PerspectivesIEEE International Conference on Computer Vision (ICCV), 2022 Haoning Wu Erli Zhang Liang Liao Chaofeng Chen Jingwen Hou Annan Wang Wenxiu Sun Qiong Yan Weisi Lin 187 287 0 09 Nov 2022
The Florence 4D Facial Expression DatasetIEEE International Conference on Automatic Face & Gesture Recognition (FG), 2022 F. Principi Stefano Berretti Claudio Ferrari N. Otberdout Mohamed Daoudi Marco Bertini 3DH 202 11 0 30 Oct 2022
Diffusion Motion: Generate Text-Guided 3D Human Motion by Diffusion ModelIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2022 Zhiyuan Ren Zhihong Pan Xingfa Zhou Le Kang VGen DiffM 248 50 0 22 Oct 2022
Talking Head from Speech Audio using a Pre-trained Image GeneratorACM Multimedia (ACM MM), 2022 M. M. Alghamdi He Wang A. Bulpitt David C. Hogg 188 23 0 09 Sep 2022
Generating Multiple 4D Expression Transitions by Learning Face Landmark TrajectoriesIEEE Transactions on Affective Computing (IEEE TAC), 2022 N. Otberdout Claudio Ferrari Mohamed Daoudi Stefano Berretti Marco Bertini CVBM 203 13 0 29 Jul 2022
3D Shape Sequence of Human Comparison and Classification using Current and VarifoldsEuropean Conference on Computer Vision (ECCV), 2022 E. Pierson Mohamed Daoudi Sylvain Arguillere 3DH 103 7 0 25 Jul 2022
Multiface: A Dataset for Neural Face Rendering Cheng-hsin Wuu N. Zheng Scott Ardisson Rohan Bali Danielle Belko ... Xinshuo Weng David Whitewolf Chenglei Wu Shoou-I Yu Yaser Sheikh 3DH CVBM 242 96 0 22 Jul 2022
EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion ModelInternational Conference on Computer Graphics and Interactive Techniques (SIGGRAPH), 2022 Xinya Ji Hang Zhou Kaisiyuan Wang Qianyi Wu Wayne Wu Feng Xu Xun Cao CVBM 344 201 0 30 May 2022
FaceFormer: Speech-Driven 3D Facial Animation with Transformers Yingruo Fan Mohammad Kachuee Jun Saito Wenping Wang Taku Komura CVBM 540 252 0 10 Dec 2021
One-shot Talking Face Generation from Single-speaker Audio-Visual Correlation LearningAAAI Conference on Artificial Intelligence (AAAI), 2021 Suzhe Wang Lincheng Li Yueqing Ding Xin Yu CVBM 206 131 0 06 Dec 2021
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing Sanyuan Chen Chengyi Wang Zhengyang Chen Yu-Huan Wu Shujie Liu ... Yao Qian Jian Wu Micheal Zeng Xiangzhan Yu Furu Wei SSL 735 2,543 0 26 Oct 2021
Unsupervised Diffeomorphic Surface Registration and Non-Linear Modelling Balder Croquet Daan Christiaens S. Weinberg M. Bronstein Dirk Vandermeulen P. Claes MedIm 139 11 0 28 Sep 2021
HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden UnitsIEEE/ACM Transactions on Audio Speech and Language Processing (TASLP), 2021 Wei-Ning Hsu Benjamin Bolte Yifan Hao Kushal Lakhotia Ruslan Salakhutdinov Abdel-rahman Mohamed SSL 468 3,862 0 14 Jun 2021
Sparse to Dense Dynamic 3D Facial Expression GenerationComputer Vision and Pattern Recognition (CVPR), 2021 N. Otberdout Claudio Ferrari Mohamed Daoudi Stefano Berretti Marco Bertini 3DH 181 29 0 16 May 2021
MeshTalk: 3D Face Animation from Speech using Cross-Modality DisentanglementIEEE International Conference on Computer Vision (ICCV), 2021 Alexander Richard Michael Zollhoefer Yandong Wen Fernando de la Torre Yaser Sheikh CVBM 252 239 0 16 Apr 2021
SDD-FIQA: Unsupervised Face Image Quality Assessment with Similarity Distribution DistanceComputer Vision and Pattern Recognition (CVPR), 2021 Fu-Zhao Ou Xingyu Chen Ruixin Zhang Yanhua Huang Shaoxin Li Jilin Li Yong Li Liujuan Cao Yuan-Gen Wang CVBM 211 115 0 10 Mar 2021
DiffusionNet: Discretization Agnostic Learning on SurfacesACM Transactions on Graphics (TOG), 2020 Nicholas Sharp Souhaib Attaiki Keenan Crane M. Ovsjanikov 3DH 268 256 0 01 Dec 2020
Dynamic Facial Asset and Rig Generation from a Single ScanACM Transactions on Graphics (TOG), 2020 Jiaman Li Zhengfei Kuang Yajie Zhao Mingming He Kalle Bladin Hao Li 3DH 219 38 0 01 Oct 2020
A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild Prajwal K R Rudrabha Mukhopadhyay Vinay P. Namboodiri C. V. Jawahar EGVM 351 977 0 23 Aug 2020
Talking-head Generation with Rhythmic Head MotionEuropean Conference on Computer Vision (ECCV), 2020 Lele Chen Guofeng Cui Celong Liu Zhong Li Ziyi Kou Yi Tian Xu Chenliang Xu 155 197 0 16 Jul 2020
A Sparse and Locally Coherent Morphable Face Model for Dense Semantic Correspondence Across Heterogeneous 3D Faces Claudio Ferrari Stefano Berretti P. Pala Marco Bertini 3DV 3DH CVBM 172 26 0 06 Jun 2020
SpiralNet++: A Fast and Highly Efficient Mesh Convolution Operator Shunwang Gong Lei Chen M. Bronstein Stefanos Zafeiriou 3DH 254 166 0 13 Nov 2019
Capture, Learning, and Synthesis of 3D Speaking StylesComputer Vision and Pattern Recognition (CVPR), 2019 Daniel Cudeiro Timo Bolkart Cassidy Laidlaw Anurag Ranjan Michael J. Black CVBM 3DH 239 389 0 08 May 2019
Neural 3D Morphable Models: Spiral Convolutional Networks for 3D Shape Representation Learning and GenerationIEEE International Conference on Computer Vision (ICCV), 2019 Giorgos Bouritsas Sergiy Bokhnyak Stylianos Ploumpis M. Bronstein Stefanos Zafeiriou MedIm 3DH 228 176 0 08 May 2019
wav2vec: Unsupervised Pre-training for Speech Recognition Steffen Schneider Alexei Baevski R. Collobert Michael Auli SSL 318 721 0 11 Apr 2019
A Simple Approach to Intrinsic Correspondence Learning on Unstructured 3D Meshes I. Lim A.C.A. Dielen M. Campen Leif Kobbelt 215 102 0 18 Sep 2018
Generating 3D faces using Convolutional Mesh Autoencoders Anurag Ranjan Timo Bolkart Soubhik Sanyal Michael J. Black CVBM 3DH 286 608 0 26 Jul 2018
Dynamic Graph CNN for Learning on Point Clouds Yue Wang Yongbin Sun Ziwei Liu Sanjay E. Sarma M. Bronstein Justin Solomon GNN 3DPC 805 6,813 0 24 Jan 2018
PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric SpaceNeural Information Processing Systems (NeurIPS), 2017 C. Qi L. Yi Hao Su Leonidas Guibas 3DPC 3DV 719 12,729 0 07 Jun 2017
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation C. Qi Hao Su Kaichun Mo Leonidas Guibas 3DH 3DPC 3DV PINN 1.1K 16,131 0 02 Dec 2016
Convolutional Neural Networks on Graphs with Fast Localized Spectral FilteringNeural Information Processing Systems (NeurIPS), 2016 M. Defferrard Xavier Bresson P. Vandergheynst GNN 789 8,169 0 30 Jun 2016