Style Transfer for Co-Speech Gesture Animation: A Multi-Speaker Conditional-Mixture Approach

24 July 2020

Chaitanya Ahuja

Dong Won Lee

Y. Nakano

Louis-Philippe Morency

ArXiv PDF HTML

Papers citing "Style Transfer for Co-Speech Gesture Animation: A Multi-Speaker Conditional-Mixture Approach"

37 / 37 papers shown

Title
PianoMotion10M: Dataset and Benchmark for Hand Motion Generation in Piano Performance Qijun Gan Song Wang Shengtao Wu Jianke Zhu 185 1 0 13 Jun 2024
CoCoGesture: Toward Coherent Co-speech 3D Gesture Generation in the Wild Xingqun Qi Hengyuan Zhang Yatian Wang J. Pan Chen Liu ... Qixun Zhang Shanghang Zhang Wenhan Luo Qifeng Liu Qi-fei Liu DiffM SLR 125 6 0 27 May 2024
SpeechAct: Towards Generating Whole-body Motion from Speech Jinsong Zhang Minjie Zhu Yuxiang Zhang Yebin Liu Kun Li 65 0 0 29 Nov 2023
Disentangled Speech Embeddings using Cross-modal Self-supervision Arsha Nagrani Joon Son Chung Samuel Albanie Andrew Zisserman SSL 57 88 0 20 Feb 2020
Dancing to Music Hsin-Ying Lee Xiaodong Yang Xuan Li Ting-Chun Wang Yu-Ding Lu Ming-Hsuan Yang Jan Kautz 49 15 0 05 Nov 2019
To React or not to React: End-to-End Visual Pose Forecasting for Personalized Avatar during Dyadic Conversations Chaitanya Ahuja Shugao Ma Louis-Philippe Morency Yaser Sheikh 39 59 0 05 Oct 2019
Disentangling Speech and Non-Speech Components for Building Robust Acoustic Models from Found Data Nishant Gurunath Sai Krishna Rallabandi A. Black DRL 22 4 0 25 Sep 2019
Language2Pose: Natural Language Grounded Pose Forecasting Chaitanya Ahuja Louis-Philippe Morency 65 273 0 02 Jul 2019
Learning Individual Styles of Conversational Gesture Shiry Ginosar Amir Bar Gefen Kohavi Caroline Chan Andrew Owens Jitendra Malik SLR 43 332 0 10 Jun 2019
DRIT++: Diverse Image-to-Image Translation via Disentangled Representations Hsin-Ying Lee Hung-Yu Tseng Qi Mao Jia-Bin Huang Yu-Ding Lu Maneesh Kumar Singh Ming-Hsuan Yang DRL 74 782 0 02 May 2019
Multi-reference Tacotron by Intercross Training for Style Disentangling,Transfer and Control in Speech Synthesis Yanyao Bian Changbin Chen Yongguo Kang Zhenglin Pan 35 46 0 04 Apr 2019
Analyzing Input and Output Representations for Speech-Driven Gesture Generation Taras Kucherenko Dai Hasegawa G. Henter Naoshi Kaneko Hedvig Kjellström 34 153 0 08 Mar 2019
OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields Zhe Cao Gines Hidalgo Tomas Simon S. Wei Yaser Sheikh 3DH CVBM 118 4,572 0 18 Dec 2018
Recycle-GAN: Unsupervised Video Retargeting Aayush Bansal Shugao Ma Deva Ramanan Yaser Sheikh VGen DiffM 59 297 0 15 Aug 2018
MIXGAN: Learning Concepts from Different Domains for Mixture Generation Guang-Yuan Hao Hong-Xing Yu Weishi Zheng GAN 41 12 0 04 Jul 2018
Multimodal Unsupervised Image-to-Image Translation Xun Huang Ming-Yuan Liu Serge J. Belongie Jan Kautz 120 2,481 0 12 Apr 2018
Style Tokens: Unsupervised Style Modeling, Control and Transfer in End-to-End Speech Synthesis Yuxuan Wang Daisy Stanton Yu Zhang RJ Skerry-Ryan Eric Battenberg Joel Shor Y. Xiao Fei Ren Ye Jia Rif A. Saurous 64 825 0 23 Mar 2018
Audio to Body Dynamics Eli Shlizerman Lucio Dery Hayden Schoen Ira Kemelmacher-Shlizerman VGen 77 154 0 19 Dec 2017
Toward Multimodal Image-to-Image Translation Jun-Yan Zhu Richard Y. Zhang Deepak Pathak Trevor Darrell Alexei A. Efros Oliver Wang Eli Shechtman 116 1,351 0 30 Nov 2017
XGAN: Unsupervised Image-to-Image Translation for Many-to-Many Mappings Amelie Royer Konstantinos Bousmalis Stephan Gouws Fred Bertsch Inbar Mosseri Forrester Cole Kevin Patrick Murphy GAN 102 143 0 14 Nov 2017
Decomposing Motion and Content for Natural Video Sequence Prediction Ruben Villegas Jimei Yang Seunghoon Hong Xunyu Lin Honglak Lee 59 596 0 25 Jun 2017
Variational Approaches for Auto-Encoding Generative Adversarial Networks Mihaela Rosca Balaji Lakshminarayanan David Warde-Farley S. Mohamed DRL GAN 56 264 0 15 Jun 2017
Unsupervised Learning of Disentangled Representations from Video Emily L. Denton Vighnesh Birodkar DRL CoGe OOD 76 553 0 31 May 2017
Hand Keypoint Detection in Single Images using Multiview Bootstrapping Tomas Simon Hanbyul Joo I. Matthews Yaser Sheikh 3DH 73 1,112 0 25 Apr 2017
Unsupervised Image-to-Image Translation Networks Ming-Yuan Liu Thomas Breuel Jan Kautz VLM 143 2,732 0 02 Mar 2017
Generalization and Equilibrium in Generative Adversarial Nets (GANs) Sanjeev Arora Rong Ge Yingyu Liang Tengyu Ma Yi Zhang GAN 54 688 0 02 Mar 2017
Wasserstein GAN Martín Arjovsky Soumith Chintala Léon Bottou GAN 161 4,825 0 26 Jan 2017
Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields Zhe Cao Tomas Simon S. Wei Yaser Sheikh 3DH 147 6,528 0 24 Nov 2016
Image-to-Image Translation with Conditional Adversarial Networks Phillip Isola Jun-Yan Zhu Tinghui Zhou Alexei A. Efros SSeg 306 19,610 0 21 Nov 2016
Coupled Generative Adversarial Networks Ming-Yuan Liu Oncel Tuzel OOD GAN 84 1,625 0 24 Jun 2016
Improved Techniques for Training GANs Tim Salimans Ian Goodfellow Wojciech Zaremba Vicki Cheung Alec Radford Xi Chen GAN 452 9,025 0 10 Jun 2016
Perceptual Losses for Real-Time Style Transfer and Super-Resolution Justin Johnson Alexandre Alahi Li Fei-Fei SupR 209 10,229 0 27 Mar 2016
Rethinking the Inception Architecture for Computer Vision Christian Szegedy Vincent Vanhoucke Sergey Ioffe Jonathon Shlens Z. Wojna 3DV BDL 652 27,300 0 02 Dec 2015
A Neural Algorithm of Artistic Style Leon A. Gatys Alexander S. Ecker Matthias Bethge GAN 76 2,855 0 26 Aug 2015
U-Net: Convolutional Networks for Biomedical Image Segmentation Olaf Ronneberger Philipp Fischer Thomas Brox SSeg 3DV 1.5K 76,894 0 18 May 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.3K 149,820 0 22 Dec 2014
Generative Adversarial Networks Ian Goodfellow Jean Pouget-Abadie M. Berk Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville Yoshua Bengio GAN 135 2,191 0 10 Jun 2014