Not made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localization

29 May 2020

Komal Chugh

Parul Gupta

Abhinav Dhall

Ramanathan Subramanian

ArXiv PDF HTML

Papers citing "Not made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localization"

50 / 61 papers shown

Title
FauForensics: Boosting Audio-Visual Deepfake Detection with Facial Action Units Jian Wang Baoyuan Wu Li Liu Qingshan Liu AAML 36 0 0 13 May 2025
Cross-Branch Orthogonality for Improved Generalization in Face Deepfake Detection Tharindu Fernando Clinton Fookes Sridha Sridharan Simon Denman 43 0 0 08 May 2025
Active Light Modulation to Counter Manipulation of Speech Visual Content Hadleigh Schwartz Xiaofeng Yan Charles J. Carver Xia Zhou 68 0 0 30 Apr 2025
Circumventing shortcuts in audio-visual deepfake detection datasets with unsupervised learning Dragos-Alexandru Boldisor Stefan Smeu Dan Oneaţă Elisabeta Oneata 103 1 0 29 Nov 2024
Passive Deepfake Detection Across Multi-modalities: A Comprehensive Survey Hong-Hanh Nguyen-Le Van-Tuan Tran Dinh-Thuc Nguyen Nhien-An Le-Khac AAML 110 1 0 26 Nov 2024
DiMoDif: Discourse Modality-information Differentiation for Audio-visual Deepfake Detection and Localization C. Koutlis Symeon Papadopoulos 58 2 0 15 Nov 2024
Generalized Multimodal Fusion via Poisson-Nernst-Planck Equation Jiayu Xiong Jing Wang Hengjing Xiang Jun Xue Chen Xu Zhouqiang Jiang 35 0 0 20 Oct 2024
Gumbel Rao Monte Carlo based Bi-Modal Neural Architecture Search for Audio-Visual Deepfake Detection Aravinda Reddy PN Raghavendra Ramachandra K. S. Rao Pabitra Mitra Vinod Rathod 28 0 0 09 Oct 2024
Deep Learning Technology for Face Forgery Detection: A Survey Lixia Ma Puning Yang Yuting Xu Ziming Yang Peipei Li Huaibo Huang 45 1 0 22 Sep 2024
1M-Deepfakes Detection Challenge Zhixi Cai Abhinav Dhall Shreya Ghosh Munawar Hayat D. Kollias Kalin Stefanov Usman Tariq 42 1 0 11 Sep 2024
Detecting Audio-Visual Deepfakes with Fine-Grained Inconsistencies Marcella Astrid Enjie Ghorbel Djamila Aouada 45 4 0 13 Aug 2024
Contextual Cross-Modal Attention for Audio-Visual Deepfake Detection and Localization Vinaya Sree Katamneni A. Rattani 40 4 0 02 Aug 2024
Statistics-aware Audio-visual Deepfake Detector Marcella Astrid Enjie Ghorbel Djamila Aouada 53 5 0 16 Jul 2024
The Tug-of-War Between Deepfake Generation and Detection Hannah Lee Changyeon Lee Kevin Farhat Lin Qiu Steve Geluso Aerin Kim O. Etzioni 34 1 0 08 Jul 2024
A Multi-Stream Fusion Approach with One-Class Learning for Audio-Visual Deepfake Detection Kyungbok Lee You Zhang Zhiyao Duan 27 0 0 20 Jun 2024
Straight Through Gumbel Softmax Estimator based Bimodal Neural Architecture Search for Audio-Visual Deepfake Detection Aravinda Reddy PN Raghavendra Ramachandra K. S. Rao Pabitra Mitra Vinod Rathod 42 2 0 19 Jun 2024
Zero-Shot Fake Video Detection by Audio-Visual Consistency Xiaolou Li Zehua Liu Chen Chen Lantian Li Li Guo D. Wang 63 4 0 12 Jun 2024
AVFF: Audio-Visual Feature Fusion for Video Deepfake Detection Trevine Oorloff Surya Koppisetti Nicolo Bonettini Divyaraj Solanki Ben Colman Yaser Yacoob Ali Shahriyari Gaurav Bharaj 42 21 0 05 Jun 2024
Explicit Correlation Learning for Generalizable Cross-Modal Deepfake Detection Cai Yu Shan Jia Xiaomeng Fu Jin Liu Jiahe Tian Jiao Dai Xi Wang Siwei Lyu Jizhong Han 42 5 0 30 Apr 2024
AVT2-DWF: Improving Deepfake Detection with Audio-Visual Fusion and Dynamic Weighting Strategies Rui Wang Dengpan Ye Long Tang Yunming Zhang Jiacheng Deng ViT 35 9 0 22 Mar 2024
Exposing the Deception: Uncovering More Forgery Clues for Deepfake Detection Zhongjie Ba Qingyu Liu Zhenguang Liu Shuang Wu Feng Lin Liwang Lu Kui Ren AAML 38 34 0 04 Mar 2024
Lips Are Lying: Spotting the Temporal Inconsistency between Audio and Visual in Lip-Syncing DeepFakes Weifeng Liu Tianyi She Jiawei Liu Run Wang Dongyu Yao Ziyou Liang 37 5 0 28 Jan 2024
Datasets, Clues and State-of-the-Arts for Multimedia Forensics: An Extensive Review Ankit Yadav Dinesh Kumar Vishwakarma AAML 32 6 0 13 Jan 2024
Unsupervised Multimodal Deepfake Detection Using Intra- and Cross-Modal Inconsistencies Mulin Tian Mahyar Khayatkhoei Joe Mathai Wael AbdAlmageed 35 6 0 28 Nov 2023
AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Dataset Zhixi Cai Shreya Ghosh Aman Pankaj Adatia Munawar Hayat Abhinav Dhall Kalin Stefanov 21 27 0 26 Nov 2023
AV-Lip-Sync+: Leveraging AV-HuBERT to Exploit Multimodal Inconsistency for Video Deepfake Detection Sahibzada Adil Shahzad Ammarah Hashmi Yan-Tsung Peng Yu Tsao Hsin-Min Wang 32 5 0 05 Nov 2023
Detecting Deepfakes Without Seeing Any Tal Reiss Bar Cavia Yedid Hoshen AAML 28 17 0 02 Nov 2023
AVTENet: Audio-Visual Transformer-based Ensemble Network Exploiting Multiple Experts for Video Deepfake Detection Ammarah Hashmi Sahibzada Adil Shahzad Chia-Wen Lin Yu Tsao Hsin-Min Wang ViT 53 6 0 19 Oct 2023
MIS-AVoiDD: Modality Invariant and Specific Representation for Audio-Visual Deepfake Detection Vinaya Sree Katamneni A. Rattani 33 12 0 03 Oct 2023
DF-TransFusion: Multimodal Deepfake Detection via Lip-Audio Cross-Attention and Facial Self-Attention Aaditya Kharel Manas Paranjape Aniket Bera 36 3 0 12 Sep 2023
UMMAFormer: A Universal Multimodal-adaptive Transformer Framework for Temporal Forgery Localization Rui Zhang Hongxia Wang Ming-han Du Hanqing Liu Yangqiaoyu Zhou Q. Zeng 31 21 0 28 Aug 2023
COMICS: End-to-end Bi-grained Contrastive Learning for Multi-face Forgery Detection Cong Zhang H. Qi Shuhui Wang Yuezun Li Siwei Lyu CVBM 41 6 0 03 Aug 2023
A Unified Framework for Modality-Agnostic Deepfakes Detection Cai Yu Peng-Wen Chen Jiahe Tian Jin Liu Jiao Dai Xi Wang Yesheng Chai Shan Jia Siwei Lyu Jizhong Han 32 0 0 26 Jul 2023
FTFDNet: Learning to Detect Talking Face Video Manipulation with Tri-Modality Interaction Gang Wang Peng Zhang Jun Xiong Fei Yang Wei Huang Yufei Zha CVBM 25 1 0 08 Jul 2023
NPVForensics: Jointing Non-critical Phonemes and Visemes for Deepfake Detection Yu Chen Yang Yu R. Ni Yao-Min Zhao Haoliang Li 34 2 0 12 Jun 2023
Undercover Deepfakes: Detecting Fake Segments in Videos Sanjay Saha Rashindrie Perera Sachith Seneviratne T. Malepathirana Sanka Rasnayaka Deshani Geethika Terence Sim Saman K. Halgamuge DiffM 22 7 0 11 May 2023
Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localization Théophile Cabannes Shreya Ghosh Raphaël Marinier Tom Gedeon Alexandre M. Bayen Munawar Hayat 86 22 0 03 May 2023
Self-Supervised Video Forensics by Audio-Visual Anomaly Detection Chao Feng Ziyang Chen Andrew Owens 31 71 0 04 Jan 2023
Fighting Malicious Media Data: A Survey on Tampering Detection and Deepfake Detection Junke Wang Zhenxin Li Chao Zhang Jingjing Chen Zuxuan Wu Larry S. Davis Yueping Jiang AAML 37 5 0 12 Dec 2022
FakeOut: Leveraging Out-of-domain Self-supervision for Multi-modal Video Deepfake Detection Gil Knafo Ohad Fried 23 5 0 01 Dec 2022
Cross-Domain Local Characteristic Enhanced Deepfake Video Detection Zihan Liu Hanyi Wang Shilin Wang ViT 29 6 0 07 Nov 2022
Combining Automatic Speaker Verification and Prosody Analysis for Synthetic Speech Detection L. Attorresi Davide Salvi Clara Borrelli Paolo Bestagini Stefano Tubaro 18 22 0 31 Oct 2022
Exploring Spatial-Temporal Features for Deepfake Detection and Localization Haiwei Wu Jiantao Zhou Shile Zhang Jinyu Tian 39 4 0 28 Oct 2022
Learning Second Order Local Anomaly for General Face Forgery Detection Jianwei Fei Yunshu Dai Peipeng Yu Tianrun Shen Zhihua Xia Jian Weng CVBM 127 52 0 30 Sep 2022
Exploring Disentangled Content Information for Face Forgery Detection Jiahao Liang Huafeng Shi Weihong Deng CVBM 44 38 0 19 Jul 2022
Visual Representations of Physiological Signals for Fake Video Detection Kalin Stefanov Bhawna Paliwal Abhinav Dhall 14 4 0 18 Jul 2022
Spatial-Temporal Frequency Forgery Clue for Video Forgery Detection in VIS and NIR Scenario Yukai Wang Chunlei Peng Decheng Liu N. Wang Xinbo Gao 47 14 0 05 Jul 2022
Do You Really Mean That? Content Driven Audio-Visual Deepfake Dataset and Multimodal Method for Temporal Forgery Localization Zhixi Cai Kalin Stefanov Abhinav Dhall Munawar Hayat 20 3 0 13 Apr 2022
Audio-Visual Person-of-Interest DeepFake Detection D. Cozzolino Alessandro Pianese Matthias Nießner L. Verdoliva 36 60 0 06 Apr 2022
Automated Parkinson's Disease Detection and Affective Analysis from Emotional EEG Signals R. Parameshwara S. Narayana Murugappan Murugappan Subramanian Ramanathan Ibrahim Radwan Roland Göcke 27 3 0 21 Feb 2022