A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild

23 August 2020

Prajwal K R

Rudrabha Mukhopadhyay

Papers citing "A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild"

50 / 410 papers shown

Title
Audio-Driven 3D Facial Animation from In-the-Wild Videos Liying Lu Tianke Zhang Yunfei Liu Xuangeng Chu Yu Li VGen 47 3 0 20 Jun 2023
Instruct-NeuralTalker: Editing Audio-Driven Talking Radiance Fields with Instructions Yuqi Sun Reian He Weimin Tan Bo Yan DiffM 32 2 0 19 Jun 2023
SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking Faces Ziqiao Peng Yihao Luo Yue Shi Hao-Xuan Xu Xiangyu Zhu Jun He Hongyan Liu Zhaoxin Fan 55 40 0 19 Jun 2023
Unsupervised Learning of Style-Aware Facial Animation from Real Acting Performances Wolfgang Paier A. Hilsmann Peter Eisert 3DH 27 10 0 16 Jun 2023
Emotional Speech-Driven Animation with Content-Emotion Disentanglement Radek Danvevcek Kiran Chhatre Shashank Tripathi Yandong Wen Michael J. Black Timo Bolkart 16 66 0 15 Jun 2023
Parametric Implicit Face Representation for Audio-Driven Facial Reenactment Ricong Huang Puxiang Lai Yipeng Qin Guanbin Li CVBM DiffM 27 14 0 13 Jun 2023
Emotional Talking Head Generation based on Memory-Sharing and Attention-Augmented Networks Jianrong Wang Yaxin Zhao Li Liu Tian-Shun Xu Qi Li Sen Li 16 9 0 06 Jun 2023
Ada-TTA: Towards Adaptive High-Quality Text-to-Talking Avatar Synthesis Zhe Ye Ziyue Jiang Yi Ren Jinglin Liu Chen Zhang Xiang Yin Zejun Ma Zhou Zhao 47 4 0 06 Jun 2023
Exploring Phonetic Context-Aware Lip-Sync For Talking Face Generation Se Jin Park Minsu Kim J. Choi Y. Ro CVBM 27 4 0 31 May 2023
CPNet: Exploiting CLIP-based Attention Condenser and Probability Map Guidance for High-fidelity Talking Face Generation Jingning Xu Benlai Tang Mingjie Wang Minghao Li Meirong Ma CVBM 21 0 0 23 May 2023
Building an Invisible Shield for Your Portrait against Deepfakes Jiazhi Guan Tianshu Hu Hang Zhou Zhizhi Guo Lirui Deng Chengbin Quan Errui Ding Youjian Zhao PICV 29 4 0 22 May 2023
LPMM: Intuitive Pose Control for Neural Talking-Head Model via Landmark-Parameter Morphable Model K. Lee Patrick Kwon Myung Ki Lee Namhyuk Ahn Junsoo Lee 9 1 0 17 May 2023
Laughing Matters: Introducing Laughing-Face Generation using Diffusion Models Antoni Bigata Casademunt Rodrigo Mira Nikita Drobyshev Konstantinos Vougioukas Stavros Petridis M. Pantic DiffM 64 2 0 15 May 2023
Identity-Preserving Talking Face Generation with Landmark and Appearance Priors Wei‐Tao Zhong Chaowei Fang Yinqi Cai Pengxu Wei Gangming Zhao Liang Lin Guanbin Li 23 75 0 15 May 2023
StyleSync: High-Fidelity Generalized and Personalized Lip Sync in Style-based Generator Jiazhi Guan Zhanwang Zhang Hang Zhou Tianshu Hu Kaisiyuan Wang ... Haocheng Feng Jingtuo Liu Errui Ding Ziwei Liu Jingdong Wang 42 57 0 09 May 2023
Multimodal-driven Talking Face Generation via a Unified Diffusion-based Generator Chao Xu Shaoting Zhu Junwei Zhu Alexander I. Rudnicky Jiangning Zhang Ying Tai Yong Liu DiffM 57 14 0 04 May 2023
High-fidelity Generalized Emotional Talking Face Generation with Multi-modal Emotion Space Learning Chao Xu Sijun Tan Jibang Wu Yue Han Wenqing Chu Xiaohui Bei Chengjie Wang Haifeng Xu Yong Liu CVBM 54 36 0 04 May 2023
Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localization Théophile Cabannes Shreya Ghosh Raphaël Marinier Tom Gedeon Alexandre M. Bayen Munawar Hayat 86 22 0 03 May 2023
GeneFace++: Generalized and Stable Real-Time Audio-Driven 3D Talking Face Generation Zhenhui Ye Jinzheng He Ziyue Jiang Rongjie Huang Jia-Bin Huang Jinglin Liu Yixiang Ren Xiang Yin Zejun Ma Zhou Zhao CVBM 59 29 0 01 May 2023
StyleLipSync: Style-based Personalized Lip-sync Video Generation Taekyung Ki Dong Min 45 11 0 30 Apr 2023
Can deepfakes be created by novice users? Pulak Mehta Gauri Jagatap Kevin Gallagher Brian Timmerman Progga Deb S. Garg Rachel Greenstadt Brendan Dolan-Gavitt HAI 27 3 0 28 Apr 2023
AVFace: Towards Detailed Audio-Visual 4D Face Reconstruction Aggelina Chatziagapi Dimitris Samaras 3DH CVBM 33 3 0 25 Apr 2023
Audio-Driven Talking Face Generation with Diverse yet Realistic Facial Animations Rongliang Wu Yingchen Yu Fangneng Zhan Jiahui Zhang Xiaoqin Zhang Shijian Lu CVBM 24 9 0 18 Apr 2023
That's What I Said: Fully-Controllable Talking Face Generation Youngjoon Jang Kyeongha Rho Jong-Bin Woo Hyeongkeun Lee Jihwan Park Youshin Lim Byeong-Yeol Kim Joon Son Chung CVBM 19 9 0 06 Apr 2023
A Unified Compression Framework for Efficient Speech-Driven Talking-Face Generation Bo-Kyeong Kim Jaemin Kang Daeun Seo Hancheol Park Shinkook Choi Hyoung-Kyu Song Hyungshin Kim Sungsu Lim 29 0 0 02 Apr 2023
TalkCLIP: Talking Head Generation with Text-Guided Expressive Speaking Styles Yifeng Ma Suzhe Wang Yu-qiong Ding Lincheng Li Bowen Ma Tangjie Lv Changjie Fan Zhipeng Hu Zhidong Deng Xin Yu CLIP 37 21 0 01 Apr 2023
FONT: Flow-guided One-shot Talking Head Generation with Natural Head Motions Jin Liu Xi Wang Xiaomeng Fu Yesheng Chai Cai Yu Jiao Dai Jizhong Han 24 6 0 31 Mar 2023
DAE-Talker: High Fidelity Speech-Driven Talking Face Generation with Diffusion Autoencoder Chenpeng Du Qi Chen Xie Chen K. Yu DiffM 37 50 0 30 Mar 2023
Seeing What You Said: Talking Face Generation Guided by a Lip Reading Expert Jiadong Wang Xinyuan Qian Malu Zhang R. Tan Haizhou Li EGVM 22 93 0 29 Mar 2023
OTAvatar: One-shot Talking Face Avatar with Controllable Tri-plane Rendering Zhiyuan Ma Xiangyu Zhu Guojun Qi Zhen Lei Lefei Zhang CVBM 44 58 0 26 Mar 2023
MusicFace: Music-driven Expressive Singing Face Synthesis Peng Liu W. Deng Hengda Li Jintai Wang Yinglin Zheng Yiwei Ding Xiaohu Guo Ming Zeng CVBM 35 10 0 24 Mar 2023
A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need? Chaoning Zhang Chenshuang Zhang Sheng Zheng Yu Qiao Chenghao Li ... Lik-Hang Lee Yang Yang Heng Tao Shen In So Kweon Choong Seon Hong 85 159 0 21 Mar 2023
Information-containing Adversarial Perturbation for Combating Facial Manipulation Systems Yao Zhu YueFeng Chen Xiaodan Li Rong Zhang Xiang Tian Bo Zheng Yao-wu Chen AAML 41 11 0 21 Mar 2023
ModEFormer: Modality-Preserving Embedding for Audio-Video Synchronization using Transformers Akash Gupta Rohun Tripathi Won-Kap Jang 29 6 0 21 Mar 2023
Emotionally Enhanced Talking Face Generation Sahil Goyal Shagun Uppal Sarthak Bhagat Yi Yu Yifang Yin R. Shah CVBM 31 14 0 21 Mar 2023
MMFace4D: A Large-Scale Multi-Modal 4D Face Dataset for Audio-Driven 3D Face Animation Haozhe Wu Jia Jia Junliang Xing Hongwei Xu Xiangyuan Wang Jelo Wang CVBM 32 7 0 17 Mar 2023
DisCoHead: Audio-and-Video-Driven Talking Head Generation by Disentangled Control of Head Pose and Facial Expressions Geumbyeol Hwang Sunwon Hong Seunghyun Lee Sungwoo Park Gyeongsu Chae VGen 32 5 0 14 Mar 2023
Reference-Guided Large-Scale Face Inpainting with Identity and Texture Control Wuyang Luo Su Yang Weishan Zhang DiffM 47 10 0 13 Mar 2023
Progressive Open Space Expansion for Open-Set Model Attribution Tianyun Yang Danding Wang Fan Tang Xinying Zhao Juan Cao Sheng Tang 31 17 0 13 Mar 2023
Improving Few-Shot Learning for Talking Face System with TTS Data Augmentation Qi Chen Ziyang Ma Tao Liu Xuejiao Tan Qu Lu Xie Chen K. Yu CVBM 35 5 0 09 Mar 2023
MixSpeech: Cross-Modality Self-Learning with Audio-Visual Stream Mixup for Visual Speech Translation and Recognition Xize Cheng Lin Li Tao Jin Rongjie Huang Wang Lin Zehan Wang Huangdai Liu Yejin Wang Aoxiong Yin Zhou Zhao 26 24 0 09 Mar 2023
DINet: Deformation Inpainting Network for Realistic Face Visually Dubbing on High Resolution Video Zhimeng Zhang Zhipeng Hu W. Deng Changjie Fan Tangjie Lv Yu-qiong Ding 3DH CVBM 38 59 0 07 Mar 2023
READ Avatars: Realistic Emotion-controllable Audio Driven Avatars Jack D. Saunders Vinay P. Namboodiri VGen 21 11 0 01 Mar 2023
UniFLG: Unified Facial Landmark Generator from Text or Speech Kentaro Mitsui Yukiya Hono Kei Sawada CVBM 16 6 0 28 Feb 2023
OPT: One-shot Pose-Controllable Talking Head Generation Jin Liu Xi Wang Xiaomeng Fu Yesheng Chai Cai Yu Jiao Dai Jizhong Han 22 5 0 16 Feb 2023
GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesis Zhenhui Ye Ziyue Jiang Yi Ren Jinglin Liu Jinzheng He Zhou Zhao CVBM 30 122 0 31 Jan 2023
What Decreases Editing Capability? Domain-Specific Hybrid Refinement for Improved GAN Inversion Pu Cao Lu Yang Dongxu Liu Zhiwei Liu Shan Li Q. Song 27 6 0 28 Jan 2023
DPE: Disentanglement of Pose and Expression for General Video Portrait Editing Youxin Pang Yong Zhang Weize Quan Yanbo Fan Xiaodong Cun Ying Shan Dong-ming Yan VGen 32 33 0 16 Jan 2023
Speech Driven Video Editing via an Audio-Conditioned Diffusion Model Dan Bigioi Shubhajit Basak Michał Stypułkowski Maciej Ziȩba H. Jordan R. Mcdonnell Peter Corcoran DiffM VGen 24 35 0 10 Jan 2023
DiffTalk: Crafting Diffusion Models for Generalized Audio-Driven Portraits Animation Shuai Shen Wenliang Zhao Zibin Meng Wanhua Li Zhengbiao Zhu Jie Zhou Jiwen Lu DiffM VGen 44 99 0 10 Jan 2023