Audio- and Gaze-driven Facial Animation of Codec Avatars

11 August 2020

Juergen Gall

Papers citing "Audio- and Gaze-driven Facial Animation of Codec Avatars"

26 / 26 papers shown

Title
ProbTalk3D: Non-Deterministic Emotion Controllable Speech-Driven 3D Facial Animation Synthesis Using VQ-VAE Sichun Wu Kazi Injamamul Haque Zerrin Yumak VGen 58 2 0 12 Sep 2024
Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Models Yuge Shi Siddharth Narayanaswamy Brooks Paige Philip Torr DRL 65 267 0 08 Nov 2019
Realistic Speech-Driven Facial Animation with GANs Konstantinos Vougioukas Stavros Petridis Maja Pantic 113 291 0 14 Jun 2019
What Makes Training Multi-Modal Classification Networks Hard? Weiyao Wang Du Tran Matt Feiszli 95 448 0 29 May 2019
Capture, Learning, and Synthesis of 3D Speaking Styles Daniel Cudeiro Timo Bolkart Cassidy Laidlaw Anurag Ranjan Michael J. Black CVBM 3DH 81 343 0 08 May 2019
Deep Audio-Visual Speech Recognition Triantafyllos Afouras Joon Son Chung A. Senior Oriol Vinyals Andrew Zisserman 58 696 0 06 Sep 2018
Deep Appearance Models for Face Rendering Stephen Lombardi Jason M. Saragih Tomas Simon Yaser Sheikh CVBM 3DH 51 283 0 01 Aug 2018
Talking Face Generation by Adversarially Disentangled Audio-Visual Representation Hang Zhou Yu Liu Ziwei Liu Ping Luo Xiaogang Wang CVBM 66 438 0 20 Jul 2018
VisemeNet: Audio-Driven Animator-Centric Speech Animation Yang Zhou Shan Xu Chris Landreth E. Kalogerakis Subhransu Maji Karan Singh 44 146 0 24 May 2018
End-to-End Speech-Driven Facial Animation with Temporal GANs Konstantinos Vougioukas Stavros Petridis Maja Pantic CVBM 57 103 0 23 May 2018
A Universal Music Translation Network Noam Mor Lior Wolf Adam Polyak Yaniv Taigman 60 110 0 21 May 2018
Talking Face Generation by Conditional Recurrent Adversarial Network Yang Song Jingwen Zhu Dawei Li Xiaolong Wang Hairong Qi CVBM 113 194 0 13 Apr 2018
Generating Talking Face Landmarks from Speech Sefik Emre Eskimez R. Maddox Chenliang Xu Z. Duan CVBM 30 56 0 26 Mar 2018
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling Shaojie Bai J. Zico Kolter V. Koltun DRL 75 4,759 0 04 Mar 2018
Multimodal Generative Models for Scalable Weakly-Supervised Learning Mike Wu Noah D. Goodman DRL 64 379 0 14 Feb 2018
State-of-the-art Speech Recognition With Sequence-to-Sequence Models Chung-Cheng Chiu Tara N. Sainath Yonghui Wu Rohit Prabhavalkar Patrick Nguyen ... Katya Gonina Navdeep Jaitly Yue Liu J. Chorowski M. Bacchiani AI4TS 84 1,150 0 05 Dec 2017
Neural Discrete Representation Learning Aaron van den Oord Oriol Vinyals Koray Kavukcuoglu BDL SSL OCL 173 4,928 0 02 Nov 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 501 129,831 0 12 Jun 2017
Multimodal Machine Learning: A Survey and Taxonomy T. Baltrušaitis Chaitanya Ahuja Louis-Philippe Morency 70 2,890 0 26 May 2017
You said that? Joon Son Chung A. Jamaludin Andrew Zisserman CVBM 62 258 0 08 May 2017
Unsupervised Image-to-Image Translation Networks Ming-Yuan Liu Thomas Breuel Jan Kautz VLM 131 2,731 0 02 Mar 2017
Temporal Convolutional Networks for Action Segmentation and Detection Colin S. Lea Michael D. Flynn René Vidal A. Reiter Gregory Hager 89 1,478 0 16 Nov 2016
Categorical Reparameterization with Gumbel-Softmax Eric Jang S. Gu Ben Poole BDL 227 5,323 0 03 Nov 2016
WaveNet: A Generative Model for Raw Audio Aaron van den Oord Sander Dieleman Heiga Zen Karen Simonyan Oriol Vinyals Alex Graves Nal Kalchbrenner A. Senior Koray Kavukcuoglu DiffM 322 7,361 0 12 Sep 2016
Auto-Encoding Variational Bayes Diederik P. Kingma Max Welling BDL 380 16,962 0 20 Dec 2013
Speech Recognition with Deep Recurrent Neural Networks Alex Graves Abdel-rahman Mohamed Geoffrey E. Hinton 176 8,503 0 22 Mar 2013