Do You Really Mean That? Content Driven Audio-Visual Deepfake Dataset and Multimodal Method for Temporal Forgery Localization

13 April 2022

Zhixi Cai

Kalin Stefanov

Abhinav Dhall

Munawar Hayat

ArXiv PDF HTML

Papers citing "Do You Really Mean That? Content Driven Audio-Visual Deepfake Dataset and Multimodal Method for Temporal Forgery Localization"

50 / 56 papers shown

Title
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 267 30,123 0 01 Mar 2022
Evaluation of an Audio-Video Multimodal Deepfake Dataset using Unimodal and Multimodal Detectors Hasam Khalid Minhan Kim Shahroz Tariq Simon S. Woo 48 86 0 07 Sep 2021
Spatiotemporal Inconsistency Learning for DeepFake Video Detection Zhihao Gu Yang Chen Taiping Yao Shouhong Ding Jilin Li Feiyue Huang Lizhuang Ma 75 154 0 04 Sep 2021
FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Dataset Hasam Khalid Shahroz Tariq Minha Kim Simon S. Woo 95 193 0 11 Aug 2021
OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery Detection And Segmentation In-The-Wild Trung-Nghia Le H. Nguyen Junichi Yamagishi Isao Echizen AAML 61 61 0 30 Jul 2021
Combining EfficientNet and Vision Transformers for Video Deepfake Detection D. Coccomini Nicola Messina Claudio Gennaro Fabrizio Falchi ViT 76 172 0 06 Jul 2021
Hear Me Out: Fusional Approaches for Audio Augmented Temporal Action Localization Anurag Bagchi Jazib Mahmood Dolton Fernandes Ravi Kiran Sarvadevabhatla 90 22 0 27 Jun 2021
M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection Junke Wang Zuxuan Wu Wenhao Ouyang Xintong Han Jingjing Chen Ser-Nam Lim Yu-Gang Jiang ViT 149 266 0 20 Apr 2021
Deepfake Detection Scheme Based on Vision Transformer and Distillation Young-Jin Heo Y. Choi Young-Woon Lee Byung-Gyu Kim ViT 34 56 0 03 Apr 2021
SC-GlowTTS: an Efficient Zero-Shot Multi-Speaker Text-To-Speech Model Edresson Casanova C. Shulby Eren Golge Nicolas Müller F. S. Oliveira Arnaldo Cândido Júnior A. S. Soares S. Aluísio M. Ponti 54 100 0 02 Apr 2021
ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysis Yinan He Bei Gan Siyu Chen Yichun Zhou Guojun Yin Luchuan Song Lu Sheng Jing Shao Ziwei Liu AAML 67 137 0 09 Mar 2021
Deepfake Video Detection Using Convolutional Vision Transformer Deressa Wodajo Solomon Atnafu ViT 105 176 0 22 Feb 2021
Expressive Neural Voice Cloning Paarth Neekhara Shehzeen Samarah Hussain Shlomo Dubnov F. Koushanfar Julian McAuley DiffM 51 30 0 30 Jan 2021
Activity Graph Transformer for Temporal Action Localization Megha Nawhal Greg Mori 81 71 0 21 Jan 2021
WildDeepfake: A Challenging Real-World Dataset for Deepfake Detection Bojia Zi Minghao Chang Jingjing Chen Xingjun Ma Yu-Gang Jiang CVBM 127 386 0 05 Jan 2021
Multi-shot Temporal Event Localization: a Benchmark Xiaolong Liu Yao Hu S. Bai Fei Ding X. Bai Philip Torr 66 83 0 17 Dec 2020
BSN++: Complementary Boundary Regressor with Scale-Balanced Relation Modeling for Temporal Action Proposal Generation Haisheng Su Weihao Gan Wei Wu Yu Qiao Junjie Yan 80 125 0 15 Sep 2020
A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild Prajwal K R Rudrabha Mukhopadhyay Vinay P. Namboodiri C. V. Jawahar EGVM 101 777 0 23 Aug 2020
Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Clues Yuyang Qian Guojun Yin Lu Sheng Zixuan Chen Jing Shao CVBM 128 688 0 18 Jul 2020
Deepfake Detection using Spatiotemporal Convolutional Networks Oscar de Lima Sean Franklin Shreshtha Basu Blake Karwoski A. George 3DPC 54 110 0 26 Jun 2020
Not made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localization Komal Chugh Parul Gupta Abhinav Dhall Ramanathan Subramanian 63 170 0 29 May 2020
Deepfakes Detection with Automatic Face Weighting D. M. Montserrat Hanxiang Hao S. Yarlagadda Sriram Baireddy Ruiting Shao ... Emily R. Bartusiak Justin Yang David Guera Fengqing Zhu Edward J. Delp CVBM 69 117 0 25 Apr 2020
DeepFake Detection by Analyzing Convolutional Traces Luca Guarnera O. Giudice Sebastiano Battiato CVBM 46 222 0 22 Apr 2020
Emotions Don't Lie: An Audio-Visual Deepfake Detection Method Using Affective Cues Trisha Mittal Uttaran Bhattacharya Rohan Chandra Aniket Bera Tianyi Zhou 66 260 0 14 Mar 2020
Towards Automatic Face-to-Face Translation Prajwal K R Rudrabha Mukhopadhyay Jerin Philip Abhishek Jha Vinay P. Namboodiri C. V. Jawahar CVBM 89 174 0 01 Mar 2020
DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detection Liming Jiang Ren Li Wayne Wu Chao Qian Chen Change Loy CVBM PICV 96 443 0 09 Jan 2020
Neural Voice Puppetry: Audio-driven Facial Reenactment Justus Thies Mohamed A. Elgharib A. Tewari Christian Theobalt Matthias Nießner VGen 3DH 80 369 0 11 Dec 2019
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 493 42,407 0 03 Dec 2019
G-TAD: Sub-Graph Localization for Temporal Action Detection Mengmeng Xu Chen Zhao D. Rojas Ali K. Thabet Guohao Li 111 437 0 26 Nov 2019
Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensics Yuezun Li Xin Yang Pu Sun H. Qi Siwei Lyu 200 1,075 0 27 Sep 2019
Graph Convolutional Networks for Temporal Action Localization Runhao Zeng Wenbing Huang Mingkui Tan Yu Rong P. Zhao Junzhou Huang Chuang Gan GNN 82 478 0 07 Sep 2019
FSGAN: Subject Agnostic Face Swapping and Reenactment Y. Nirkin Y. Keller Tal Hassner CVBM PICV 140 575 0 16 Aug 2019
BMN: Boundary-Matching Network for Temporal Action Proposal Generation Tianwei Lin Xiao-Chang Liu Xin Li Errui Ding Shilei Wen 131 605 0 23 Jul 2019
Hierarchical Cross-Modal Talking Face Generationwith Dynamic Pixel-Wise Loss Lele Chen R. Maddox Z. Duan Chenliang Xu CVBM 68 398 0 09 May 2019
FaceForensics++: Learning to Detect Manipulated Facial Images Andreas Rossler D. Cozzolino L. Verdoliva Christian Riess Justus Thies Matthias Nießner CVBM 111 2,076 0 25 Jan 2019
DeepFakes: a New Threat to Face Recognition? Assessment and Detection Pavel Korshunov S´ebastien Marcel PICV CVBM 65 604 0 20 Dec 2018
Exposing Deep Fakes Using Inconsistent Head Poses Xin Yang Yuezun Li Siwei Lyu CVBM 70 882 0 01 Nov 2018
Exposing DeepFake Videos By Detecting Face Warping Artifacts Yuezun Li Siwei Lyu AAML CVBM 60 911 0 01 Nov 2018
MesoNet: a Compact Facial Video Forgery Detection Network Darius Afchar Vincent Nozick Junichi Yamagishi Isao Echizen CVBM PICV 72 1,248 0 04 Sep 2018
CTAP: Complementary Temporal Action Proposal Generation J. Gao Kan Chen Ram Nevatia ViT 51 178 0 12 Jul 2018
VoxCeleb2: Deep Speaker Recognition Joon Son Chung Arsha Nagrani Andrew Zisserman 350 2,276 0 14 Jun 2018
Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis Ye Jia Yu Zhang Ron J. Weiss Quan Wang Jonathan Shen ... Zhiwen Chen Patrick Nguyen Ruoming Pang Ignacio López Moreno Yonghui Wu 254 830 0 12 Jun 2018
BSN: Boundary Sensitive Network for Temporal Action Proposal Generation Tianwei Lin Xu Zhao Haisheng Su Chongjing Wang Ming Yang 201 705 0 08 Jun 2018
Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictions Jonathan Shen Ruoming Pang Ron J. Weiss M. Schuster Navdeep Jaitly ... Yuxuan Wang RJ Skerry-Ryan Rif A. Saurous Yannis Agiomyrgiannakis Yonghui Wu 77 2,697 0 16 Dec 2017
Single Shot Temporal Action Detection Tianwei Lin Xu Zhao Zheng Shou 64 454 0 17 Oct 2017
Exploring Temporal Preservation Networks for Precise Temporal Action Localization Ke Yang Peng Qiao Dongsheng Li Shaohe Lv Y. Dou 58 63 0 10 Aug 2017
MoCoGAN: Decomposing Motion and Content for Video Generation Sergey Tulyakov Ming-Yuan Liu Xiaodong Yang Jan Kautz GAN 129 1,147 0 17 Jul 2017
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset João Carreira Andrew Zisserman 229 8,015 0 22 May 2017
Temporal Action Detection with Structured Segment Networks Yue Zhao Yuanjun Xiong Limin Wang Zhirong Wu Xiaoou Tang Dahua Lin 67 915 0 20 Apr 2017
Soft-NMS -- Improving Object Detection With One Line of Code Navaneeth Bodla Bharat Singh Rama Chellappa L. Davis ObjD 85 1,788 0 14 Apr 2017