OSM-Net: One-to-Many One-shot Talking Head Generation with Spontaneous Head Motions

28 September 2023

Papers citing "OSM-Net: One-to-Many One-shot Talking Head Generation with Spontaneous Head Motions"

36 / 36 papers shown

Title
Audio-Driven Dubbing for User Generated Contents via Style-Aware Semi-Parametric Synthesis Linsen Song Wayne Wu Chaoyou Fu Chen Change Loy Ran He 68 12 0 31 Aug 2023
FONT: Flow-guided One-shot Talking Head Generation with Natural Head Motions Jin Liu Xi Wang Xiaomeng Fu Yesheng Chai Cai Yu Jiao Dai Jizhong Han 98 6 0 31 Mar 2023
OPT: One-shot Pose-Controllable Talking Head Generation Jin Liu Xi Wang Xiaomeng Fu Yesheng Chai Cai Yu Jiao Dai Jizhong Han 32 5 0 16 Feb 2023
Talking Head Generation with Probabilistic Audio-to-Visual Diffusion Priors Zhentao Yu Zixin Yin Deyu Zhou Duomin Wang Finn Wong Baoyuan Wang DiffM 68 37 0 07 Dec 2022
Compressing Video Calls using Synthetic Talking Heads Madhav Agarwal Anchit Gupta Rudrabha Mukhopadhyay Vinay P. Namboodiri C. V. Jawahar 44 11 0 07 Oct 2022
Depth-Aware Generative Adversarial Network for Talking Head Video Generation Fa-Ting Hong Longhao Zhang Li Shen Dan Xu 3DH CVBM 74 174 0 13 Mar 2022
One-shot Talking Face Generation from Single-speaker Audio-Visual Correlation Learning Suzhe Wang Lincheng Li Yueqing Ding Xin Yu CVBM 92 119 0 06 Dec 2021
PIRenderer: Controllable Portrait Image Generation via Semantic Neural Rendering Yurui Ren Gezhong Li Yuanqi Chen Thomas H. Li Shan Liu DiffM VGen 113 227 0 17 Sep 2021
FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute Learning Chenxu Zhang Yifan Zhao Yifei Huang Ming Zeng Saifeng Ni M. Budagavi Xiaohu Guo CVBM 68 125 0 18 Aug 2021
Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion Suzhe Wang Lincheng Li Yu-qiong Ding Changjie Fan Xin Yu VGen 96 165 0 20 Jul 2021
LipSync3D: Data-Efficient Learning of Personalized 3D Talking Faces from Video using Pose and Lighting Normalization A. Lahiri Vivek Kwatra C. Frueh J. P. Lewis C. Bregler 3DH 73 101 0 08 Jun 2021
Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation Hang Zhou Yasheng Sun Wayne Wu Chen Change Loy Xiaogang Wang Ziwei Liu CVBM 107 369 0 22 Apr 2021
One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencing Ting-Chun Wang Arun Mallya Xuan Li 3DH 105 483 0 30 Nov 2020
A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild Prajwal K R Rudrabha Mukhopadhyay Vinay P. Namboodiri C. V. Jawahar EGVM 103 787 0 23 Aug 2020
Talking-head Generation with Rhythmic Head Motion Lele Chen Guofeng Cui Celong Liu Zhong Li Ziyi Kou Yi Tian Xu Chenliang Xu 57 182 0 16 Jul 2020
MakeItTalk: Speaker-Aware Talking-Head Animation Yang Zhou Xintong Han Eli Shechtman J. Echevarria E. Kalogerakis Dingzeyu Li 63 423 0 27 Apr 2020
Neural Head Reenactment with Latent Pose Descriptors Egor Burkov I. Pasechnik Artur Grigorev Victor Lempitsky 3DH 96 131 0 24 Apr 2020
Realistic Face Reenactment via Self-Supervised Disentangling of Identity and Pose Xianfang Zeng Yusu Pan Mengmeng Wang Jiangning Zhang Yong Liu CVBM 125 42 0 29 Mar 2020
Towards Automatic Face-to-Face Translation Prajwal K R Rudrabha Mukhopadhyay Jerin Philip Abhishek Jha Vinay P. Namboodiri C. V. Jawahar CVBM 98 175 0 01 Mar 2020
First Order Motion Model for Image Animation Aliaksandr Siarohin Stéphane Lathuilière Sergey Tulyakov Elisa Ricci N. Sebe VGen DiffM 98 932 0 29 Feb 2020
Audio-driven Talking Face Video Generation with Learning-based Personalized Head Pose Ran Yi Zipeng Ye Juyong Zhang Hujun Bao Yong Liu CVBM 75 123 0 24 Feb 2020
Analyzing and Improving the Image Quality of StyleGAN Tero Karras S. Laine M. Aittala Janne Hellsten J. Lehtinen Timo Aila GAN 306 5,823 0 03 Dec 2019
MarioNETte: Few-shot Face Reenactment Preserving Identity of Unseen Targets S. Ha Martin Kersner Beomsu Kim Seokjun Seo Dongyoung Kim CVBM 103 165 0 19 Nov 2019
Neural Style-Preserving Visual Dubbing Hyeongwoo Kim Mohamed A. Elgharib Michael Zollhöfer Hans-Peter Seidel Thabo Beeler Christian Richardt Christian Theobalt VGen 49 94 0 05 Sep 2019
Realistic Speech-Driven Facial Animation with GANs Konstantinos Vougioukas Stavros Petridis Maja Pantic 133 296 0 14 Jun 2019
Text-based Editing of Talking-head Video Ohad Fried A. Tewari Michael Zollhöfer Adam Finkelstein Eli Shechtman Dan B. Goldman Kyle Genova Zeyu Jin Christian Theobalt Maneesh Agrawala VGen 66 262 0 04 Jun 2019
Few-Shot Adversarial Learning of Realistic Neural Talking Head Models Egor Zakharov Aliaksandra Shysheya Egor Burkov Victor Lempitsky 3DH 147 629 0 20 May 2019
Animating Arbitrary Objects via Deep Motion Transfer Aliaksandr Siarohin Stéphane Lathuilière Sergey Tulyakov Elisa Ricci N. Sebe 68 347 0 20 Dec 2018
Arbitrary Talking Face Generation via Attentional Audio-Visual Coherence Learning Hao Zhu Huaibo Huang Yi Li Aihua Zheng Ran He CVBM 56 58 0 17 Dec 2018
A Style-Based Generator Architecture for Generative Adversarial Networks Tero Karras S. Laine Timo Aila 593 10,561 0 12 Dec 2018
Talking Face Generation by Adversarially Disentangled Audio-Visual Representation Hang Zhou Yu Liu Ziwei Liu Ping Luo Xiaogang Wang CVBM 92 442 0 20 Jul 2018
Talking Face Generation by Conditional Recurrent Adversarial Network Yang Song Jingwen Zhu Dawei Li Xiaolong Wang Hairong Qi CVBM 132 195 0 13 Apr 2018
High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs Ting-Chun Wang Ming-Yuan Liu Jun-Yan Zhu Andrew Tao Jan Kautz Bryan Catanzaro SSeg 176 3,943 0 30 Nov 2017
How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks) Adrian Bulat Georgios Tzimiropoulos 3DH CVBM 3DV 106 1,478 0 21 Mar 2017
Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization Xun Huang Serge J. Belongie OOD 179 4,368 0 20 Mar 2017
Memory Networks Jason Weston S. Chopra Antoine Bordes GNN KELM 147 1,708 0 15 Oct 2014