X2Face: A network for controlling face generation by using images, audio, and pose codes

27 July 2018

A. Sophia Koepke

Papers citing "X2Face: A network for controlling face generation by using images, audio, and pose codes"

50 / 90 papers shown

Title
GenSync: A Generalized Talking Head Framework for Audio-driven Multi-Subject Lip-Sync using 3D Gaussian Splatting Anushka Agarwal Muhammad Yusuf Hassan Talha Chafekar 3DGS 26 0 0 03 May 2025
SEGA: Drivable 3D Gaussian Head Avatar from a Single Image Chen Guo Zhuo Su Jian Wang Shuang Li Xu Chang Zhaohu Li Yang Zhao Guidong Wang Ruqi Huang 3DGS 122 0 0 19 Apr 2025
GHOST 2.0: generative high-fidelity one shot transfer of heads A. Groshev Anastasiia Iashchenko Pavel Paramonov Denis Dimitrov Andrey Kuznetsov 65 0 0 25 Feb 2025
Steganography Beyond Space-Time with Chain of Multimodal AI Ching-Chun Chang Isao Echizen 74 0 0 25 Feb 2025
EmoGene: Audio-Driven Emotional 3D Talking-Head Generation Wenqing Wang Yun Fu VGen 79 0 0 07 Oct 2024
HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priors Xiaozheng Zheng Chao Wen Zhaohu Li Weiyi Zhang Zhuo Su ... Zheng Lv Xiaoyuan Zhang Yongjie Zhang Guidong Wang Lan Xu 3DGS 55 11 0 12 Aug 2024
Learning Online Scale Transformation for Talking Head Video Generation Fa-Ting Hong Dan Xu 60 1 0 13 Jul 2024
Dance Any Beat: Blending Beats with Visuals in Dance Video Generation Xuanchen Wang Heng Wang Dongnan Liu Weidong Cai 38 3 0 15 May 2024
Unmasking Illusions: Understanding Human Perception of Audiovisual Deepfakes Ammarah Hashmi Sahibzada Adil Shahzad Chia-Wen Lin Yu Tsao Hsin-Min Wang 46 3 0 07 May 2024
FSRT: Facial Scene Representation Transformer for Face Reenactment from Factorized Appearance, Head-pose, and Facial Expression Features Andre Rochow Max Schwarz Sven Behnke ViT 48 6 0 15 Apr 2024
Talk3D: High-Fidelity Talking Portrait Synthesis via Personalized 3D Generative Prior Jaehoon Ko Kyusun Cho Joungbin Lee Heeji Yoon Sangmin Lee Sangjun Ahn Seungryong Kim 34 2 0 29 Mar 2024
Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfer Danah Yatim Rafail Fridman Omer Bar-Tal Yoni Kasten Tali Dekel DiffM VGen 29 50 0 28 Nov 2023
AniPortraitGAN: Animatable 3D Portrait Generation from 2D Image Collections Yue Wu Sicheng Xu Jianfeng Xiang Fangyun Wei Qifeng Chen Jiaolong Yang Xin Tong 3DH 29 16 0 05 Sep 2023
Audio-Driven Dubbing for User Generated Contents via Style-Aware Semi-Parametric Synthesis Linsen Song Wayne Wu Chaoyou Fu Chen Change Loy Ran He 31 10 0 31 Aug 2023
AI-Generated Content (AIGC) for Various Data Modalities: A Survey Lin Geng Foo Hossein Rahmani Xiaozhong Liu 78 31 0 27 Aug 2023
HyperReenact: One-Shot Reenactment via Jointly Learning to Refine and Retarget Faces Stella Bounareli Christos Tzelepis Vasileios Argyriou Ioannis Patras Georgios Tzimiropoulos CVBM 31 35 0 20 Jul 2023
POCE: Pose-Controllable Expression Editing Rongliang Wu Yingchen Yu Fangneng Zhan Jiahui Zhang Tianran Ouyang Shijian Lu CVBM 37 2 0 18 Apr 2023
Conditional Image-to-Video Generation with Latent Flow Diffusion Models Haomiao Ni Changhao Shi Kaican Li Sharon X. Huang Martin Renqiang Min VGen DiffM 27 164 0 24 Mar 2023
Cyber Vaccine for Deepfake Immunity Ching-Chun Chang H. Nguyen Junichi Yamagishi Isao Echizen 26 6 0 05 Mar 2023
Interactive Face Video Coding: A Generative Compression Framework Bo Chen Zhao Wang Binzhe Li Shurun Wang Shiqi Wang Yan Ye VGen 16 16 0 20 Feb 2023
One-Shot Face Video Re-enactment using Hybrid Latent Spaces of StyleGAN2 Trevine Oorloff Yaser Yacoob CVBM 32 3 0 15 Feb 2023
Semantic 3D-aware Portrait Synthesis and Manipulation Based on Compositional Neural Radiance Field Tianxiang Ma Bingchuan Li Qian He Jing Dong Tieniu Tan 30 12 0 03 Feb 2023
GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesis Zhenhui Ye Ziyue Jiang Yi Ren Jinglin Liu Jinzheng He Zhou Zhao CVBM 25 122 0 31 Jan 2023
Unsupervised Volumetric Animation Aliaksandr Siarohin Willi Menapace Ivan Skorokhodov Kyle Olszewski Jian Ren Hsin-Ying Lee Menglei Chai Sergey Tulyakov 50 20 0 26 Jan 2023
All's well that FID's well? Result quality and metric scores in GAN models for lip-sychronization tasks Carina Geldhauser Johan Liljegren Pontus Nordqvist 16 0 0 28 Dec 2022
Fighting Malicious Media Data: A Survey on Tampering Detection and Deepfake Detection Junke Wang Zhenxin Li Chao Zhang Jingjing Chen Zuxuan Wu Larry S. Davis Yueping Jiang AAML 37 5 0 12 Dec 2022
Audio-Driven Co-Speech Gesture Video Generation Xian Liu Qianyi Wu Hang Zhou Yuanqi Du Wayne Wu Dahua Lin Ziwei Liu SLR VGen 34 47 0 05 Dec 2022
Face Animation with Multiple Source Images Zhaoying Pan Jinge Ma 3DH CVBM 32 0 0 01 Dec 2022
AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxels Yuelang Xu Lizhen Wang Xiaochen Zhao Hongwen Zhang Yebin Liu 3DH 46 62 0 23 Nov 2022
Controllable Radiance Fields for Dynamic Face Synthesis Peiye Zhuang Liqian Ma Oluwasanmi Koyejo A. Schwing CVBM 3DH 18 11 0 11 Oct 2022
Implicit Warping for Animation with Image Sets Arun Mallya Ting-Chun Wang Xuan Li VGen 119 41 0 04 Oct 2022
Motion Transformer for Unsupervised Image Animation Jiale Tao Biao Wang T. Ge Yuning Jiang Wen Li Lixin Duan ViT 24 9 0 28 Sep 2022
FNeVR: Neural Volume Rendering for Face Animation Bo-Wen Zeng Bo-Ye Liu Hong Li Xuhui Liu Jianzhuang Liu Dapeng Chen Wei Peng Baochang Zhang CVBM 3DH 48 26 0 21 Sep 2022
StableFace: Analyzing and Improving Motion Stability for Talking Face Generation Jun Ling Xuejiao Tan Liyang Chen Runnan Li Yuchao Zhang Sheng Zhao Liang Song CVBM 47 13 0 29 Aug 2022
Temporal and cross-modal attention for audio-visual zero-shot learning Otniel-Bogdan Mercea Thomas Hummel A. Sophia Koepke Zeynep Akata 38 25 0 20 Jul 2022
Text/Speech-Driven Full-Body Animation Wenlin Zhuang Jinwei Qi Peng Zhang Bang Zhang Ping Tan 33 6 0 31 May 2022
F3A-GAN: Facial Flow for Face Animation with Generative Adversarial Networks Xintian Wu Qihang Zhang Yiming Wu Huanyu Wang Songyuan Li Lingyun Sun Xi Li CVBM 3DH 39 7 0 12 May 2022
3D GAN Inversion for Controllable Portrait Image Animation Connor Z. Lin David B. Lindell E. R. Chan Gordon Wetzstein 3DH 21 61 0 25 Mar 2022
On the role of Lip Articulation in Visual Speech Perception Zakaria Aldeneh Masha Fedzechkina Skyler Seto Katherine Metcalf Miguel Sarabia N. Apostoloff B. Theobald 19 1 0 18 Mar 2022
Efficient conditioned face animation using frontally-viewed embedding Maxime Oquab Daniel Haziza Ludovic Schwartz Tao Xu Katayoun Zand Rui Wang Peirong Liu Camille Couprie CVBM 25 0 0 16 Mar 2022
Depth-Aware Generative Adversarial Network for Talking Head Video Generation Fa-Ting Hong Longhao Zhang Li Shen Dan Xu 3DH CVBM 28 170 0 13 Mar 2022
StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGAN Fei Yin Yong Zhang Xiaodong Cun Ming Cao Yanbo Fan Xuanxia Wang Qingyan Bai Baoyuan Wu Jue Wang Yujiu Yang CVBM 34 171 0 08 Mar 2022
Thinking the Fusion Strategy of Multi-reference Face Reenactment T. Yashima T. Narihira Tamaki Kojima DiffM CVBM 35 1 0 22 Feb 2022
Robust Deepfake On Unrestricted Media: Generation And Detection Trung-Nghia Le H. Nguyen Junichi Yamagishi Isao Echizen 36 7 0 13 Feb 2022
Audio-Driven Talking Face Video Generation with Dynamic Convolution Kernels Zipeng Ye Mengfei Xia Ran Yi Juyong Zhang Yu-Kun Lai Xuanteng Huang Guoxin Zhang Yong-jin Liu CVBM 22 39 0 16 Jan 2022
FaceFormer: Speech-Driven 3D Facial Animation with Transformers Yingruo Fan Zhaojiang Lin Jun Saito Wenping Wang Taku Komura CVBM 43 195 0 10 Dec 2021
Joint Audio-Text Model for Expressive Speech-Driven 3D Facial Animation Yingruo Fan Zhaojiang Lin Jun Saito Wenping Wang Taku Komura 31 21 0 04 Dec 2021
Imitating Arbitrary Talking Style for Realistic Audio-DrivenTalking Face Synthesis Haozhe Wu Jia Jia Haoyu Wang Yishun Dou Chao Duan Qingshan Deng CVBM 11 73 0 30 Oct 2021
Neural Dubber: Dubbing for Videos According to Scripts Chenxu Hu Qiao Tian Tingle Li Yuping Wang Yuxuan Wang Hang Zhao DiffM VGen 36 39 0 15 Oct 2021
Live Speech Portraits: Real-Time Photorealistic Talking-Head Animation Yuanxun Lu Jinxiang Chai Xun Cao 29 82 0 22 Sep 2021