Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2401.15687
Cited By
v1
v2 (latest)
Media2Face: Co-speech Facial Animation Generation With Multi-Modality Guidance
28 January 2024
Qingcheng Zhao
Pengyu Long
Qixuan Zhang
Dafei Qin
Hanming Liang
Longwen Zhang
Yingliang Zhang
Jingyi Yu
Lan Xu
DiffM
3DH
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Media2Face: Co-speech Facial Animation Generation With Multi-Modality Guidance"
43 / 43 papers shown
Title
Supervising 3D Talking Head Avatars with Analysis-by-Audio-Synthesis
Radek Daněček
Carolin Schmitt
Senya Polikovsky
Michael J. Black
104
1
0
18 Apr 2025
ProbTalk3D: Non-Deterministic Emotion Controllable Speech-Driven 3D Facial Animation Synthesis Using VQ-VAE
Sichun Wu
Kazi Injamamul Haque
Zerrin Yumak
VGen
76
2
0
12 Sep 2024
DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Image
Qingxuan Wu
Zhiyang Dou
Sirui Xu
Soshi Shimada
Chen Wang
...
Taku Komura
Vladislav Golyanik
Christian Theobalt
Wenping Wang
Lingjie Liu
CVBM
3DH
132
5
0
26 Jun 2024
StreamDiffusion: A Pipeline-level Solution for Real-time Interactive Generation
Akio Kodaira
Chenfeng Xu
Toshiki Hazama
Takanori Yoshimoto
Kohei Ohno
Shogo Mitsuhori
Soichi Sugano
Hanying Cho
Zhijian Liu
Kurt Keutzer
78
36
0
19 Dec 2023
SpeechAct: Towards Generating Whole-body Motion from Speech
Jinsong Zhang
Minjie Zhu
Yuxiang Zhang
Yebin Liu
Kun Li
92
0
0
29 Nov 2023
FaceDiffuser: Speech-Driven 3D Facial Animation Synthesis Using Diffusion
Stefan Stan
Kazi Injamamul Haque
Zerrin Yumak
DiffM
81
57
0
20 Sep 2023
SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking Faces
Ziqiao Peng
Yihao Luo
Yue Shi
Hao-Xuan Xu
Xiangyu Zhu
Jun He
Hongyan Liu
Zhaoxin Fan
92
44
0
19 Jun 2023
ProSpect: Prompt Spectrum for Attribute-Aware Personalization of Diffusion Models
Yuxin Zhang
Weiming Dong
Fan Tang
Nisha Huang
Haibin Huang
Chongyang Ma
Tong-Yee Lee
Oliver Deussen
Changsheng Xu
DiffM
79
78
0
25 May 2023
DreamFace: Progressive Generation of Animatable 3D Faces under Text Guidance
Longwen Zhang
Qiwei Qiu
Hongyang Lin
Qixuan Zhang
Cheng Shi
Wei Yang
Ye Shi
Sibei Yang
Lan Xu
Jingyi Yu
3DH
86
78
0
01 Apr 2023
EmoTalk: Speech-Driven Emotional Disentanglement for 3D Face Animation
Ziqiao Peng
Hao Wu
Zhenbo Song
Hao-Xuan Xu
Xiangyu Zhu
Jun He
Hongyan Liu
Zhaoxin Fan
CVBM
92
108
0
20 Mar 2023
CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Prior
Jinbo Xing
Menghan Xia
Yuechen Zhang
Xiaodong Cun
Jue Wang
T. Wong
81
149
0
06 Jan 2023
Generating Holistic 3D Human Motion from Speech
Hongwei Yi
Hualin Liang
Yifei Liu
Qiong Cao
Yandong Wen
Timo Bolkart
Dacheng Tao
Michael J. Black
SLR
75
149
0
08 Dec 2022
An Implicit Parametric Morphable Dental Model
Congyi Zhang
Mohamed A. Elgharib
G. Fox
Min Gu
Christian Theobalt
Wenping Wang
3DH
MedIm
AI4CE
78
40
0
21 Nov 2022
Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Models
Simon Alexanderson
Rajmund Nagy
Jonas Beskow
G. Henter
DiffM
VGen
70
172
0
17 Nov 2022
Human Motion Diffusion Model
Guy Tevet
Sigal Raab
Brian Gordon
Yonatan Shafir
Daniel Cohen-Or
Amit H. Bermano
DiffM
VGen
270
766
0
29 Sep 2022
An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversion
Rinon Gal
Yuval Alaluf
Yuval Atzmon
Or Patashnik
Amit H. Bermano
Gal Chechik
Daniel Cohen-Or
164
1,894
0
02 Aug 2022
Classifier-Free Diffusion Guidance
Jonathan Ho
Tim Salimans
FaML
196
3,963
0
26 Jul 2022
Multiface: A Dataset for Neural Face Rendering
Cheng-hsin Wuu
N. Zheng
Scott Ardisson
Rohan Bali
Danielle Belko
...
Xinshuo Weng
David Whitewolf
Chenglei Wu
Shoou-I Yu
Yaser Sheikh
3DH
CVBM
92
81
0
22 Jul 2022
EMOCA: Emotion Driven Monocular Face Capture and Animation
Radek Daněček
Michael J. Black
Timo Bolkart
CVBM
3DH
87
208
0
24 Apr 2022
Learning to Listen: Modeling Non-Deterministic Dyadic Facial Motion
Evonne Ng
Hanbyul Joo
Liwen Hu
Hao Li
Trevor Darrell
Angjoo Kanazawa
Shiry Ginosar
VGen
63
95
0
18 Apr 2022
ImFace: A Nonlinear 3D Morphable Face Model with Implicit Neural Representations
Mingwu Zheng
Hongyu Yang
Di Huang
Liming Chen
3DH
78
59
0
28 Mar 2022
Implicit Neural Representations for Variable Length Human Motion Generation
Pablo Cervantes
Yusuke Sekikawa
Ikuro Sato
Koichi Shinoda
76
60
0
25 Mar 2022
BEAT: A Large-Scale Semantic and Emotional Multi-Modal Dataset for Conversational Gestures Synthesis
Haiyang Liu
Zihao Zhu
Naoya Iwamoto
Yichen Peng
Zhengqing Li
You Zhou
E. Bozkurt
Bo Zheng
SLR
CVBM
63
142
0
10 Mar 2022
Video-driven Neural Physically-based Facial Asset for Production
Longwen Zhang
Chuxiao Zeng
Qixuan Zhang
Hongyang Lin
Ruixiang Cao
Wei Yang
Lan Xu
Jingyi Yu
3DH
107
23
0
11 Feb 2022
High-Resolution Image Synthesis with Latent Diffusion Models
Robin Rombach
A. Blattmann
Dominik Lorenz
Patrick Esser
Bjorn Ommer
3DV
474
15,734
0
20 Dec 2021
FaceFormer: Speech-Driven 3D Facial Animation with Transformers
Yingruo Fan
Zhaojiang Lin
Jun Saito
Wenping Wang
Taku Komura
CVBM
90
204
0
10 Dec 2021
Joint Audio-Text Model for Expressive Speech-Driven 3D Facial Animation
Yingruo Fan
Zhaojiang Lin
Jun Saito
Wenping Wang
Taku Komura
60
22
0
04 Dec 2021
Learning Feature Aggregation for Deep 3D Morphable Models
Zhixiang Chen
Tae-Kyun Kim
3DPC
3DH
85
25
0
05 May 2021
MeshTalk: 3D Face Animation from Speech using Cross-Modality Disentanglement
Alexander Richard
Michael Zollhoefer
Yandong Wen
Fernando de la Torre
Yaser Sheikh
CVBM
66
200
0
16 Apr 2021
Learning an Animatable Detailed 3D Face Model from In-The-Wild Images
Yao Feng
Haiwen Feng
Michael J. Black
Timo Bolkart
CVBM
3DH
109
585
0
07 Dec 2020
Dynamic Facial Asset and Rig Generation from a Single Scan
Jiaman Li
Zhengfei Kuang
Yajie Zhao
Mingming He
Kalle Bladin
Hao Li
3DH
39
36
0
01 Oct 2020
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations
Alexei Baevski
Henry Zhou
Abdel-rahman Mohamed
Michael Auli
SSL
288
5,837
0
20 Jun 2020
Let's Face It: Probabilistic Multi-modal Interlocutor-aware Generation of Facial Gestures in Dyadic Settings
Patrik Jonell
Taras Kucherenko
G. Henter
Jonas Beskow
CVBM
59
61
0
11 Jun 2020
Learning Formation of Physically-Based Face Attributes
Ruilong Li
Kalle Bladin
Yajie Zhao
Chinmay Chinara
Owen Ingraham
...
Xinglei Ren
P. Prasad
B. Kishore
Jun Xing
Hao Li
CVBM
3DH
116
113
0
02 Apr 2020
3D Morphable Face Models -- Past, Present and Future
Bernhard Egger
W. Smith
A. Tewari
Stefanie Wuhrer
Michael Zollhoefer
...
Adam Kortylewski
S. Romdhani
Christian Theobalt
V. Blanz
T. Vetter
3DH
84
420
0
03 Sep 2019
Capture, Learning, and Synthesis of 3D Speaking Styles
Daniel Cudeiro
Timo Bolkart
Cassidy Laidlaw
Anurag Ranjan
Michael J. Black
CVBM
3DH
95
343
0
08 May 2019
Neural 3D Morphable Models: Spiral Convolutional Networks for 3D Shape Representation Learning and Generation
Giorgos Bouritsas
Sergiy Bokhnyak
Stylianos Ploumpis
M. Bronstein
Stefanos Zafeiriou
MedIm
3DH
68
165
0
08 May 2019
On Learning 3D Face Morphable Model from In-the-wild Images
Luan Tran
Xiaoming Liu
3DV
65
156
0
28 Aug 2018
VisemeNet: Audio-Driven Animator-Centric Speech Animation
Yang Zhou
Shan Xu
Chris Landreth
E. Kalogerakis
Subhransu Maji
Karan Singh
44
146
0
24 May 2018
Nonlinear 3D Face Morphable Model
Luan Tran
Xiaoming Liu
3DV
92
398
0
11 Apr 2018
Neural Discrete Representation Learning
Aaron van den Oord
Oriol Vinyals
Koray Kavukcuoglu
BDL
SSL
OCL
228
5,061
0
02 Nov 2017
3D Face Morphable Models "In-the-Wild"
James Booth
Xin Yuan
Gang Huang
Hong Jiang
Yannis Panagakis
Stefanos Zafeiriou
3DH
53
183
0
19 Jan 2017
Deep Unsupervised Learning using Nonequilibrium Thermodynamics
Jascha Narain Sohl-Dickstein
Eric A. Weiss
Niru Maheswaranathan
Surya Ganguli
SyDa
DiffM
306
7,005
0
12 Mar 2015
1