SoK: Leveraging Transformers for Malware Analysis

27 May 2024

Papers citing "SoK: Leveraging Transformers for Malware Analysis"

48 / 48 papers shown

Title
WorldSimBench: Towards Video Generation Models as World Simulators Yiran Qin Zhelun Shi Jiwen Yu Xijun Wang Enshen Zhou ... Lu Sheng Jing Shao Junlin Wu Wanli Ouyang Ruimao Zhang EGVM VGen 176 440 0 23 Oct 2024
Nebula: Self-Attention for Dynamic Malware Analysis Dmitrijs Trizna Christian Scano Battista Biggio Fabio Roli 42 13 0 19 Sep 2023
GPT-4 Technical Report OpenAI OpenAI OpenAI Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad ... Shengjia Zhao Tianhao Zheng Juntang Zhuang William Zhuk Barret Zoph LLMAG MLLM 1.2K 14,179 0 15 Mar 2023
Character-level White-Box Adversarial Attacks against Transformers via Attachable Subwords Substitution Aiwei Liu Honghai Yu Xuming Hu Shuang Li Li Lin Fukun Ma Yawen Yang Lijie Wen 77 35 0 31 Oct 2022
Avast-CTU Public CAPE Dataset B. Bosanský Dominik Kouba Ondrej Manhal Thorsten Sick Viliam Lisý J. Kroustek P. Somol 82 5 0 06 Sep 2022
Self-Supervised Vision Transformers for Malware Detection Sachith Seneviratne Ridwan Shariffdeen Sanka Rasnayaka Nuran Kasthuriarachchi MedIm 44 34 0 15 Aug 2022
Hierarchical Text-Conditional Image Generation with CLIP Latents Aditya A. Ramesh Prafulla Dhariwal Alex Nichol Casey Chu Mark Chen VLM DiffM 350 6,830 0 13 Apr 2022
Efficient Classification of Long Documents Using Transformers Hyunji Hayley Park Yogarshi Vyas Kashif Shah 44 52 0 21 Mar 2022
A Comparison of Static, Dynamic, and Hybrid Analysis for Malware Detection Anusha Damodaran Fabio Di Troia C. A. Visaggio Thomas H. Austin Mark Stamp 40 380 0 13 Mar 2022
TransDreamer: Reinforcement Learning with Transformer World Models Changgu Chen Yi-Fu Wu Jaesik Yoon Sungjin Ahn OffRL 76 94 0 19 Feb 2022
An Ensemble of Pre-trained Transformer Models For Imbalanced Multiclass Malware Classification Ferhat Demirkiran Aykut Çayır U. Ünal Hasan Dag 52 44 0 25 Dec 2021
Single-Shot Black-Box Adversarial Attacks Against Malware Detectors: A Causal Language Model Approach Junjie Hu Mohammadreza Ebrahimi Hsinchun Chen AAML 30 11 0 03 Dec 2021
A Survey on Adversarial Attacks for Malware Analysis Kshitiz Aryal Maanak Gupta Mahmoud Abdelsalam AAML 71 53 0 16 Nov 2021
Towards Transferable Adversarial Attacks on Vision Transformers Zhipeng Wei Jingjing Chen Micah Goldblum Zuxuan Wu Tom Goldstein Yu-Gang Jiang ViT AAML 76 119 0 09 Sep 2021
Attention Bottlenecks for Multimodal Fusion Arsha Nagrani Shan Yang Anurag Arnab A. Jansen Cordelia Schmid Chen Sun 94 560 0 30 Jun 2021
A Survey of Transformers Tianyang Lin Yuxin Wang Xiangyang Liu Xipeng Qiu ViT 117 1,115 0 08 Jun 2021
Decision Transformer: Reinforcement Learning via Sequence Modeling Lili Chen Kevin Lu Aravind Rajeswaran Kimin Lee Aditya Grover Michael Laskin Pieter Abbeel A. Srinivas Igor Mordatch OffRL 107 1,635 0 02 Jun 2021
Analyzing Machine Learning Approaches for Online Malware Detection in Cloud Jeffrey Kimmell Mahmoud Abdelsalam Maanak Gupta 15 35 0 19 May 2021
Gradient-based Adversarial Attacks against Text Transformers Chuan Guo Alexandre Sablayrolles Hervé Jégou Douwe Kiela SILM 134 242 0 15 Apr 2021
CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation J. Clark Dan Garrette Iulia Turc John Wieting 85 218 0 11 Mar 2021
MalNet: A Large-Scale Image Database of Malicious Software Scott Freitas Rahul Duggal Duen Horng Chau 42 29 0 31 Jan 2021
Transformers in Vision: A Survey Salman Khan Muzammal Naseer Munawar Hayat Syed Waqas Zamir Fahad Shahbaz Khan M. Shah ViT 274 2,492 0 04 Jan 2021
A Survey on Visual Transformer Kai Han Yunhe Wang Hanting Chen Xinghao Chen Jianyuan Guo ... Chunjing Xu Yixing Xu Zhaohui Yang Yiman Zhang Dacheng Tao ViT 173 2,202 0 23 Dec 2020
SOREL-20M: A Large Scale Benchmark Dataset for Malicious PE Detection Richard E. Harang Ethan M. Rudd 56 101 0 14 Dec 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 543 40,739 0 22 Oct 2020
End-to-End Object Detection with Transformers Nicolas Carion Francisco Massa Gabriel Synnaeve Nicolas Usunier Alexander Kirillov Sergey Zagoruyko ViT 3DV PINN 359 13,002 0 26 May 2020
Devising Malware Characterstics using Transformers Simra Shahid Tanmay Singh Yash Sharma Kapil Sharma 19 2 0 23 May 2020
BAE: BERT-based Adversarial Examples for Text Classification Siddhant Garg Goutham Ramakrishnan AAML SILM 180 556 0 04 Apr 2020
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter Victor Sanh Lysandre Debut Julien Chaumond Thomas Wolf 208 7,481 0 02 Oct 2019
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Zhenzhong Lan Mingda Chen Sebastian Goodman Kevin Gimpel Piyush Sharma Radu Soricut SSL AIMat 334 6,441 0 26 Sep 2019
I-MAD: Interpretable Malware Detector Using Galaxy Transformer Miles Q. Li Benjamin C. M. Fung P. Charland Steven H. H. Ding 93 33 0 15 Sep 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 531 24,351 0 26 Jul 2019
A Benchmark API Call Dataset for Windows PE Malware Classification Ferhat Ozgur Catak A. Yazi 30 53 0 06 May 2019
Star-Transformer Qipeng Guo Xipeng Qiu Pengfei Liu Yunfan Shao Xiangyang Xue Zheng Zhang 69 264 0 25 Feb 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.6K 94,511 0 11 Oct 2018
EMBER: An Open Dataset for Training Static PE Malware Machine Learning Models Hyrum S. Anderson P. Roth 36 474 0 12 Apr 2018
Deep Learning using Rectified Linear Units (ReLU) Abien Fred Agarap 58 3,212 0 22 Mar 2018
Microsoft Malware Classification Challenge Royi Ronen Marian Radu Corina Feuerstein E. Yom-Tov Mansour Ahmadi 51 379 0 22 Feb 2018
Malware Detection by Eating a Whole EXE Edward Raff Jon Barker Jared Sylvester Robert Brandon Bryan Catanzaro Charles K. Nicholas 60 543 0 25 Oct 2017
Process Monitoring on Sequences of System Call Count Vectors M. Dymshits Benjamin Myara David Tolpin 25 19 0 12 Jul 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 644 130,942 0 12 Jun 2017
Layer Normalization Jimmy Lei Ba J. Kiros Geoffrey E. Hinton 354 10,467 0 21 Jul 2016
Gaussian Error Linear Units (GELUs) Dan Hendrycks Kevin Gimpel 167 4,994 0 27 Jun 2016
Sequence to Sequence Learning with Neural Networks Ilya Sutskever Oriol Vinyals Quoc V. Le AIMat 387 20,528 0 10 Sep 2014
Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio AIMat 515 27,263 0 01 Sep 2014
DeepWalk: Online Learning of Social Representations Bryan Perozzi Rami Al-Rfou Steven Skiena HAI 252 9,769 0 26 Mar 2014
DroidAnalytics: A Signature Based Analytic System to Collect, Extract, Analyze and Associate Android Malware Min Zheng Mingshen Sun John C. S. Lui 45 247 0 28 Feb 2013
Efficient Estimation of Word Representations in Vector Space Tomas Mikolov Kai Chen G. Corrado J. Dean 3DV 635 31,469 0 16 Jan 2013