Quantitative Metrics for Evaluating Explanations of Video DeepFake Detectors

7 October 2022

Federico Baldassarre

Quentin Debard

Gonzalo Fiz Pontiveros

Tri Kurniawan Wijaya

ArXiv (abs)PDF HTML

Papers citing "Quantitative Metrics for Evaluating Explanations of Video DeepFake Detectors"

45 / 45 papers shown

Title
Combining EfficientNet and Vision Transformers for Video Deepfake Detection D. Coccomini Nicola Messina Claudio Gennaro Fabrizio Falchi ViT 86 174 0 06 Jul 2021
FReTAL: Generalizing Deepfake Detection using Knowledge Distillation and Representation Learning Minhan Kim Shahroz Tariq Simon S. Woo 89 88 0 28 May 2021
Are Convolutional Neural Networks or Transformers more like human vision? Shikhar Tuli Ishita Dasgupta Erin Grant Thomas Griffiths ViT FaML 59 185 0 15 May 2021
What's wrong with this video? Comparing Explainers for Deepfake Detection Samuele Pino Mark J. Carman Paolo Bestagini AAML 40 7 0 12 May 2021
Multiscale Vision Transformers Haoqi Fan Bo Xiong K. Mangalam Yanghao Li Zhicheng Yan Jitendra Malik Christoph Feichtenhofer ViT 135 1,265 0 22 Apr 2021
ViViT: A Video Vision Transformer Anurag Arnab Mostafa Dehghani G. Heigold Chen Sun Mario Lucic Cordelia Schmid ViT 225 2,167 0 29 Mar 2021
Deepfake Videos in the Wild: Analysis and Detection Jiameng Pu Neal Mangaokar Lauren Kelly P. Bhattacharya Kavya Sundaram M. Javed Bolun Wang Bimal Viswanath 56 45 0 07 Mar 2021
Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forward Momina Masood M. Nawaz K. Malik A. Javed Aun Irtaza AAML 174 312 0 25 Feb 2021
WildDeepfake: A Challenging Real-World Dataset for Deepfake Detection Bojia Zi Minghao Chang Jingjing Chen Xingjun Ma Yu-Gang Jiang CVBM 134 391 0 05 Jan 2021
HateXplain: A Benchmark Dataset for Explainable Hate Speech Detection Binny Mathew Punyajoy Saha Seid Muhie Yimam Chris Biemann Pawan Goyal Animesh Mukherjee 122 578 0 18 Dec 2020
Training Strategies and Data Augmentations in CNN-based DeepFake Video Detection Luca Bondi E. D. Cannas Paolo Bestagini Stefano Tubaro 37 53 0 16 Nov 2020
Explanation-based Weakly-supervised Learning of Visual Relations with Graph Networks Federico Baldassarre Kevin Smith Josephine Sullivan Hossein Azizpour 75 25 0 16 Jun 2020
Quantifying Attention Flow in Transformers Samira Abnar Willem H. Zuidema 169 802 0 02 May 2020
Video Face Manipulation Detection Through Ensemble of CNNs Nicolo Bonettini E. D. Cannas S. Mandelli Luca Bondi Paolo Bestagini Stefano Tubaro PICV CVBM AAML 64 222 0 16 Apr 2020
DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detection Ruben Tolosana R. Vera-Rodríguez Julian Fierrez Aythami Morales J. Ortega-Garcia 3DPC CVBM 100 794 0 01 Jan 2020
GANprintR: Improved Fakes and Evaluation of the State of the Art in Face Manipulation Detection João C. Neves Ruben Tolosana R. Vera-Rodríguez Vasco Lopes Hugo Proencca Julian Fierrez AAML PICV 99 130 0 13 Nov 2019
Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI Alejandro Barredo Arrieta Natalia Díaz Rodríguez Javier Del Ser Adrien Bennetot Siham Tabik ... S. Gil-Lopez Daniel Molina Richard Benjamins Raja Chatila Francisco Herrera XAI 127 6,293 0 22 Oct 2019
On the Detection of Digital Face Manipulation H. Dang Anand Balakrishnan J. Stehouwer Connor Christopherson David Wingate CVBM AAML 109 552 0 03 Oct 2019
Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensics Yuezun Li Xin Yang Pu Sun H. Qi Siwei Lyu 216 1,083 0 27 Sep 2019
FSGAN: Subject Agnostic Face Swapping and Reenactment Y. Nirkin Y. Keller Tal Hassner CVBM PICV 148 578 0 16 Aug 2019
Multi-task Learning For Detecting and Segmenting Manipulated Facial Images and Videos H. Nguyen Fuming Fang Junichi Yamagishi Isao Echizen AAML CVBM 53 438 0 17 Jun 2019
XRAI: Better Attributions Through Regions A. Kapishnikov Tolga Bolukbasi Fernanda Viégas Michael Terry FAtt XAI 62 212 0 06 Jun 2019
Attention is not Explanation Sarthak Jain Byron C. Wallace FAtt 148 1,328 0 26 Feb 2019
FaceForensics++: Learning to Detect Manipulated Facial Images Andreas Rossler D. Cozzolino L. Verdoliva Christian Riess Justus Thies Matthias Nießner CVBM 113 2,095 0 25 Jan 2019
A Style-Based Generator Architecture for Generative Adversarial Networks Tero Karras S. Laine Timo Aila 606 10,590 0 12 Dec 2018
Exposing Deep Fakes Using Inconsistent Head Poses Xin Yang Yuezun Li Siwei Lyu CVBM 70 883 0 01 Nov 2018
Exposing DeepFake Videos By Detecting Face Warping Artifacts Yuezun Li Siwei Lyu AAML CVBM 62 915 0 01 Nov 2018
Talking Face Generation by Adversarially Disentangled Audio-Visual Representation Hang Zhou Yu Liu Ziwei Liu Ping Luo Xiaogang Wang CVBM 92 443 0 20 Jul 2018
Towards Robust Interpretability with Self-Explaining Neural Networks David Alvarez-Melis Tommi Jaakkola MILM XAI 128 947 0 20 Jun 2018
RISE: Randomized Input Sampling for Explanation of Black-box Models Vitali Petsiuk Abir Das Kate Saenko FAtt 181 1,176 0 19 Jun 2018
Rethinking Spatiotemporal Feature Learning: Speed-Accuracy Trade-offs in Video Classification Saining Xie Chen Sun Jonathan Huang Zhuowen Tu Kevin Patrick Murphy 3DH 155 1,333 0 13 Dec 2017
Improved Regularization of Convolutional Neural Networks with Cutout Terrance Devries Graham W. Taylor 129 3,774 0 15 Aug 2017
Methods for Interpreting and Understanding Deep Neural Networks G. Montavon Wojciech Samek K. Müller FaML 293 2,267 0 24 Jun 2017
Explanation in Artificial Intelligence: Insights from the Social Sciences Tim Miller XAI 250 4,273 0 22 Jun 2017
Interpretable Explanations of Black Boxes by Meaningful Perturbation Ruth C. Fong Andrea Vedaldi FAtt AAML 76 1,525 0 11 Apr 2017
Axiomatic Attribution for Deep Networks Mukund Sundararajan Ankur Taly Qiqi Yan OOD FAtt 193 6,018 0 04 Mar 2017
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization Ramprasaath R. Selvaraju Michael Cogswell Abhishek Das Ramakrishna Vedantam Devi Parikh Dhruv Batra FAtt 324 20,086 0 07 Oct 2016
Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networks Kaipeng Zhang Zhanpeng Zhang Zhifeng Li Yu Qiao CVBM 178 4,974 0 11 Apr 2016
Seed, Expand and Constrain: Three Principles for Weakly-Supervised Image Segmentation Alexander Kolesnikov Christoph H. Lampert SSeg 55 749 0 19 Mar 2016
"Why Should I Trust You?": Explaining the Predictions of Any Classifier Marco Tulio Ribeiro Sameer Singh Carlos Guestrin FAtt FaML 1.2K 17,033 0 16 Feb 2016
Learning Deep Features for Discriminative Localization Bolei Zhou A. Khosla Àgata Lapedriza A. Oliva Antonio Torralba SSL SSeg FAtt 253 9,338 0 14 Dec 2015
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention Ke Xu Jimmy Ba Ryan Kiros Kyunghyun Cho Aaron Courville Ruslan Salakhutdinov R. Zemel Yoshua Bengio DiffM 348 10,079 0 10 Feb 2015
Striving for Simplicity: The All Convolutional Net Jost Tobias Springenberg Alexey Dosovitskiy Thomas Brox Martin Riedmiller FAtt 251 4,681 0 21 Dec 2014
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps Karen Simonyan Andrea Vedaldi Andrew Zisserman FAtt 314 7,316 0 20 Dec 2013
Visualizing and Understanding Convolutional Networks Matthew D. Zeiler Rob Fergus FAtt SSL 595 15,902 0 12 Nov 2013