Text-based Editing of Talking-head Video

4 June 2019

Michael Zollhöfer

Papers citing "Text-based Editing of Talking-head Video"

44 / 44 papers shown

Title
Explainable Deepfake Video Detection using Convolutional Neural Network and CapsuleNet Gazi Hasin Ishrak Zalish Mahmud Md. Zami Al Zunaed Farabe Tahera Khanom Tinni Tanzim Reza Mohammad Zavid Parvez 48 3 0 19 Apr 2024
LAVE: LLM-Powered Agent Assistance and Language Augmentation for Video Editing Bryan Wang Yuliang Li Zhaoyang Lv Haijun Xia Yan Xu Raj Sodhi 35 39 0 15 Feb 2024
InvertAvatar: Incremental GAN Inversion for Generalized Head Avatars Xiaochen Zhao Jingxiang Sun Lizhen Wang Jinli Suo Yebin Liu DiffM 40 2 0 03 Dec 2023
Audio-Driven Dubbing for User Generated Contents via Style-Aware Semi-Parametric Synthesis Linsen Song Wayne Wu Chaoyou Fu Chen Change Loy Ran He 31 10 0 31 Aug 2023
MusicFace: Music-driven Expressive Singing Face Synthesis Peng Liu W. Deng Hengda Li Jintai Wang Yinglin Zheng Yiwei Ding Xiaohu Guo Ming Zeng CVBM 35 10 0 24 Mar 2023
DPE: Disentanglement of Pose and Expression for General Video Portrait Editing Youxin Pang Yong Zhang Weize Quan Yanbo Fan Xiaodong Cun Ying Shan Dong-ming Yan VGen 32 33 0 16 Jan 2023
VideoMap: Supporting Video Editing Exploration, Brainstorming, and Prototyping in the Latent Space David Chuan-En Lin Fabian Caba Heilbron Joon-Young Lee Oliver Wang Nikolas Martelaro VGen 23 4 0 22 Nov 2022
Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatars Jingxiang Sun Xuanxia Wang Lizhen Wang Xiaoyu Li Yong Zhang Hongwen Zhang Yebin Liu 3DH 22 114 0 21 Nov 2022
Temporal and Contextual Transformer for Multi-Camera Editing of TV Shows Anyi Rao Xuekun Jiang Sichen Wang Yuwei Guo Zihao Liu Bo Dai Long Pang Xiaoyu Wu Dahua Lin Libiao Jin 21 6 0 17 Oct 2022
StableFace: Analyzing and Improving Motion Stability for Talking Face Generation Jun Ling Xuejiao Tan Liyang Chen Runnan Li Yuchao Zhang Sheng Zhao Liang Song CVBM 47 13 0 29 Aug 2022
Extreme-scale Talking-Face Video Upsampling with Audio-Visual Priors Sindhu B. Hegde Rudrabha Mukhopadhyay Vinay P. Namboodiri C. V. Jawahar CVBM 16 1 0 17 Aug 2022
NARRATE: A Normal Assisted Free-View Portrait Stylizer Youjia Wang Teng Xu Yiwen Wu Minzhang Li Wenzheng Chen Lan Xu Jingyi Yu DiffM 3DH 27 4 0 03 Jul 2022
RetrieverTTS: Modeling Decomposed Factors for Text-Based Speech Insertion Dacheng Yin Chuanxin Tang Yanqing Liu Xiaoqiang Wang Zhiyuan Zhao Yucheng Zhao Zhiwei Xiong Sheng Zhao Chong Luo 23 12 0 28 Jun 2022
Cross-Forgery Analysis of Vision Transformers and CNNs for Deepfake Image Detection D. Coccomini R. Caldelli Fabrizio Falchi Claudio Gennaro Giuseppe Amato ViT 105 30 0 28 Jun 2022
FlexLip: A Controllable Text-to-Lip System Dan Oneaţă Beáta Lőrincz Adriana Stan H. Cucu 26 3 0 07 Jun 2022
EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Model Xinya Ji Hang Zhou Kaisiyuan Wang Qianyi Wu Wayne Wu Feng Xu Xun Cao CVBM 57 157 0 30 May 2022
F3A-GAN: Facial Flow for Face Animation with Generative Adversarial Networks Xintian Wu Qihang Zhang Yiming Wu Huanyu Wang Songyuan Li Lingyun Sun Xi Li CVBM 3DH 39 7 0 12 May 2022
StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGAN Fei Yin Yong Zhang Xiaodong Cun Ming Cao Yanbo Fan Xuanxia Wang Qingyan Bai Baoyuan Wu Jue Wang Yujiu Yang CVBM 37 171 0 08 Mar 2022
Freeform Body Motion Generation from Speech Jing-Fen Xu Wei Zhang Yalong Bai Qi-Biao Sun Tao Mei SLR 39 18 0 04 Mar 2022
FSGANv2: Improved Subject Agnostic Face Swapping and Reenactment Y. Nirkin Y. Keller Tal Hassner PICV CVBM 27 34 0 25 Feb 2022
Robust Deepfake On Unrestricted Media: Generation And Detection Trung-Nghia Le H. Nguyen Junichi Yamagishi Isao Echizen 36 7 0 13 Feb 2022
Audio-Driven Talking Face Video Generation with Dynamic Convolution Kernels Zipeng Ye Mengfei Xia Ran Yi Juyong Zhang Yu-Kun Lai Xuanteng Huang Guoxin Zhang Yong-jin Liu CVBM 22 39 0 16 Jan 2022
Semantic Communications: Principles and Challenges Zhijin Qin Xiaoming Tao Jianhua Lu Wen Tong Geoffrey Ye Li 31 338 0 30 Dec 2021
ForgeryNet -- Face Forgery Analysis Challenge 2021: Methods and Results Yinan He Lu Sheng Jing Shao Ziwei Liu Zhaofan Zou ... Mingwen Zhang Zhiheng Wang Zhenhang Huang Tianming Zhang Ningning Zhao CVBM 31 2 0 15 Dec 2021
FaceFormer: Speech-Driven 3D Facial Animation with Transformers Yingruo Fan Zhaojiang Lin Jun Saito Wenping Wang Taku Komura CVBM 46 195 0 10 Dec 2021
CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields Can Wang Menglei Chai Mingming He Dongdong Chen Jing Liao CLIP 29 377 0 09 Dec 2021
Live Speech Portraits: Real-Time Photorealistic Talking-Head Animation Yuanxun Lu Jinxiang Chai Xun Cao 29 82 0 22 Sep 2021
Sparse to Dense Motion Transfer for Face Image Animation Ruiqi Zhao Tianyi Wu Guodong Guo 3DH CVBM 27 27 0 01 Sep 2021
Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion Suzhe Wang Lincheng Li Yu-qiong Ding Changjie Fan Xin Yu VGen 41 160 0 20 Jul 2021
HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields Keunhong Park U. Sinha Peter Hedman Jonathan T. Barron Sofien Bouaziz Dan B. Goldman Ricardo Martín Brualla S. M. Seitz 34 226 0 24 Jun 2021
LipSync3D: Data-Efficient Learning of Personalized 3D Talking Faces from Video using Pose and Lighting Normalization A. Lahiri Vivek Kwatra C. Frueh J. P. Lewis C. Bregler 3DH 38 99 0 08 Jun 2021
Learned Spatial Representations for Few-shot Talking-Head Synthesis Moustafa Meshry Saksham Suri Larry S. Davis Abhinav Shrivastava 29 42 0 29 Apr 2021
ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysis Yinan He Bei Gan Siyu Chen Yichun Zhou Guojun Yin Luchuan Song Lu Sheng Jing Shao Ziwei Liu AAML 29 130 0 09 Mar 2021
One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencing Ting-Chun Wang Arun Mallya Xuan Li 3DH 37 469 0 30 Nov 2020
Nerfies: Deformable Neural Radiance Fields Keunhong Park U. Sinha Jonathan T. Barron Sofien Bouaziz Dan B. Goldman S. M. Seitz Ricardo Martín Brualla 3DH 76 1,107 0 25 Nov 2020
A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild Prajwal K R Rudrabha Mukhopadhyay Vinay P. Namboodiri C. V. Jawahar EGVM 22 757 0 23 Aug 2020
Describe What to Change: A Text-guided Unsupervised Image-to-Image Translation Approach Yahui Liu Marco De Nadai Deng Cai Huayang Li Xavier Alameda-Pineda N. Sebe Bruno Lepri 38 59 0 10 Aug 2020
Generative Adversarial Networks for Image and Video Synthesis: Algorithms and Applications Xuan Li Xun Huang Jiahui Yu Ting-Chun Wang Arun Mallya GAN 30 153 0 06 Aug 2020
What comprises a good talking-head video generation?: A Survey and Benchmark Lele Chen Guofeng Cui Ziyi Kou Haitian Zheng Chenliang Xu EGVM 23 58 0 07 May 2020
State of the Art on Neural Rendering A. Tewari Ohad Fried Justus Thies Vincent Sitzmann Stephen Lombardi ... Christian Theobalt Maneesh Agrawala Eli Shechtman Dan B. Goldman Michael Zollhöfer 3DH 3DV 39 466 0 08 Apr 2020
A Neural Lip-Sync Framework for Synthesizing Photorealistic Virtual News Anchors Ruobing Zheng Zhou Zhu Bo Song Changjiang Ji 3DH 19 2 0 20 Feb 2020
DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detection Ruben Tolosana R. Vera-Rodríguez Julian Fierrez Aythami Morales J. Ortega-Garcia 3DPC CVBM 51 775 0 01 Jan 2020
Forbidden knowledge in machine learning -- Reflections on the limits of research and publication Thilo Hagendorff 14 14 0 19 Nov 2019
Deep Learning for Deepfakes Creation and Detection: A Survey Thanh Thi Nguyen Quoc Viet Hung Nguyen Dung Nguyen D. Nguyen Thien Huynh-The S. Nahavandi Thanh Tam Nguyen Viet Quoc Pham Cu Nguyen 31 433 0 25 Sep 2019