Evaluation of ChatGPT Model for Vulnerability Detection

12 April 2023

Papers citing "Evaluation of ChatGPT Model for Vulnerability Detection"

37 / 37 papers shown

Title
Secure Coding with AI, From Creation to Inspection Vladislav Belozerov Peter J. Barclay Ashkan Sami 21 0 0 29 Apr 2025
Block Toeplitz Sparse Precision Matrix Estimation for Large-Scale Interval-Valued Time Series Forecasting Wan Tian Zhongfeng Qin AI4TS 33 0 0 04 Apr 2025
ELTEX: A Framework for Domain-Driven Synthetic Data Generation Arina Razmyslovich Kseniia Murasheva Sofia Sedlova Julien Capitaine Eugene Dmitriev SyDa 74 0 0 19 Mar 2025
Do LLMs Consider Security? An Empirical Study on Responses to Programming Questions Amirali Sajadi Binh Le A. Nguyen Kostadin Damevski Preetha Chatterjee 63 2 0 20 Feb 2025
Large Language Models for In-File Vulnerability Localization Can Be "Lost in the End" Francesco Sovrano Adam Bauer Alberto Bacchelli 51 0 0 09 Feb 2025
ProveRAG: Provenance-Driven Vulnerability Analysis with Automated Retrieval-Augmented LLMs Reza Fayyazi Stella Hoyos Trueba Michael Zuzak S. Yang 31 0 0 22 Oct 2024
Large Language Models for Secure Code Assessment: A Multi-Language Empirical Study Kohei Dozono Tiago Gasiba Andrea Stocco ELM 23 2 0 12 Aug 2024
From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Future Haolin Jin Linghan Huang Haipeng Cai Jun Yan Bo Li Huaming Chen 78 24 0 05 Aug 2024
Beyond Functional Correctness: Investigating Coding Style Inconsistencies in Large Language Models Yanlin Wang Tianyue Jiang Mingwei Liu Jiachi Chen Zibin Zheng 29 7 0 29 Jun 2024
Assessing the Effectiveness of LLMs in Android Application Vulnerability Analysis Vasileios Kouliaridis Georgios Karopoulos G. Kambourakis AAML 44 2 0 27 Jun 2024
Defining and Detecting Vulnerability in Human Evaluation Guidelines: A Preliminary Study Towards Reliable NLG Evaluation Jie Ruan Wenqing Wang Xiaojun Wan AAML ELM 36 3 0 12 Jun 2024
Generalization-Enhanced Code Vulnerability Detection via Multi-Task Instruction Fine-Tuning Xiaohu Du Ming Wen Jiahao Zhu Zifan Xie Bin Ji Huijun Liu Xuanhua Shi Hai Jin 37 14 0 06 Jun 2024
GenKubeSec: LLM-Based Kubernetes Misconfiguration Detection, Localization, Reasoning, and Remediation Ehud Malul Yair Meidan D. Mimran Yuval Elovici A. Shabtai 35 4 0 30 May 2024
Harnessing Large Language Models for Software Vulnerability Detection: A Comprehensive Benchmarking Study Karl Tamberg Hayretdin Bahsi 50 12 0 24 May 2024
When LLMs Meet Cybersecurity: A Systematic Literature Review Jie Zhang Haoyu Bu Hui Wen Yu Chen Lun Li Hongsong Zhu 42 36 0 06 May 2024
DLAP: A Deep Learning Augmented Large Language Model Prompting Framework for Software Vulnerability Detection Yanjing Yang Xin Zhou Runfeng Mao Jinwei Xu Lanxin Yang Yu Zhangm Haifeng Shen He Zhang 24 13 0 02 May 2024
Software Vulnerability Prediction in Low-Resource Languages: An Empirical Study of CodeBERT and ChatGPT T. H. Le Muhammad Ali Babar Tung Hoang Thai 27 7 0 26 Apr 2024
Leveraging Large Language Models to Detect npm Malicious Packages Nusrat Zahan Philipp Burckhardt Mikola Lysenko Feross Aboukhadijeh Laurie A. Williams 35 2 0 18 Mar 2024
Unveiling Hidden Links Between Unseen Security Entities Daniel Alfasi T. Shapira Anat Bremler Barr 29 2 0 04 Mar 2024
A New Era in LLM Security: Exploring Security Concerns in Real-World LLM-based Systems Fangzhou Wu Ning Zhang Somesh Jha P. McDaniel Chaowei Xiao 34 69 0 28 Feb 2024
Finetuning Large Language Models for Vulnerability Detection Alexey Shestov Rodion Levichev Ravil Mussabayev Evgeny Maslov Anton Cheshkov Pavel Zadorozhny 13 26 0 30 Jan 2024
Evaluation of LLM Chatbots for OSINT-based Cyber Threat Awareness Samaneh Shafee A. Bessani Pedro M. Ferreira 26 19 0 26 Jan 2024
LLbezpeky: Leveraging Large Language Models for Vulnerability Detection N. Mathews Yelizaveta Brus Yousra Aafer Mei Nagappan Shane McIntosh 10 17 0 02 Jan 2024
Exploring the Limits of ChatGPT in Software Security Applications Fangzhou Wu Qingzhao Zhang Ati Priya Bajaj Tiffany Bao Ning Zhang Ruoyu Wang Chaowei Xiao ALM SILM ELM 20 8 0 08 Dec 2023
DeceptPrompt: Exploiting LLM-driven Code Generation via Adversarial Natural Language Instructions Fangzhou Wu Xiaogeng Liu Chaowei Xiao AAML SILM 21 26 0 07 Dec 2023
A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Ugly Yifan Yao Jinhao Duan Kaidi Xu Yuanfang Cai Eric Sun Yue Zhang PILM ELM 36 475 0 04 Dec 2023
How Far Have We Gone in Vulnerability Detection Using Large Language Models Zeyu Gao Hao Wang Yuchen Zhou Wenyu Zhu Chao Zhang 24 17 0 21 Nov 2023
ChatGPT for Vulnerability Detection, Classification, and Repair: How Far Are We? Michael Fu C. Tantithamthavorn Van Nguyen Trung Le SILM ELM 36 59 0 15 Oct 2023
DefectHunter: A Novel LLM-Driven Boosted-Conformer-based Code Vulnerability Detection Mechanism Jin Wang Zishan Huang Hengli Liu Nianyi Yang Yinhao Xiao 38 17 0 27 Sep 2023
Using ChatGPT as a Static Application Security Testing Tool Atieh Bakhshandeh Abdalsamad Keramatfar Amir Norouzi Mohammad Mahdi Chekidehkhoun 27 13 0 28 Aug 2023
Can Large Language Models Find And Fix Vulnerable Software? David A. Noever ELM 47 21 0 20 Aug 2023
GPTScan: Detecting Logic Vulnerabilities in Smart Contracts by Combining GPT with Program Analysis Yuqiang Sun Daoyuan Wu Yue Xue Hangbo Liu Haijun Wang Zhengzi Xu Xiaofei Xie Yang Liu 25 79 0 07 Aug 2023
Evaluating GPT's Programming Capability through CodeWars' Katas Zizhuo Zhang Lian Wen Shaoyang Zhang David Chen Yanfei Jiang ELM 20 3 0 31 May 2023
A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasets Md Tahmid Rahman Laskar M Saiful Bari Mizanur Rahman Md Amran Hossen Bhuiyan Shafiq R. Joty J. Huang LM&MA ELM ALM 41 179 0 29 May 2023
A Preliminary Analysis on the Code Generation Capabilities of GPT-3.5 and Bard AI Models for Java Functions Giuseppe Destefanis Silvia Bartolucci Marco Ortu ELM 41 22 0 16 May 2023
Sparks of Artificial General Intelligence: Early experiments with GPT-4 Sébastien Bubeck Varun Chandrasekaran Ronen Eldan J. Gehrke Eric Horvitz ... Scott M. Lundberg Harsha Nori Hamid Palangi Marco Tulio Ribeiro Yi Zhang ELM AI4MH AI4CE ALM 289 2,232 0 22 Mar 2023
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 358 8,495 0 28 Jan 2022