Large Language Models of Code Fail at Completing Code with Potential Bugs

6 June 2023

Tuan Dinh

Jinman Zhao

Samson Tan

Renato M. P. Negrinho

Leonard Lausen

Sheng Zha

George Karypis

LRM

ArXiv PDF HTML

Papers citing "Large Language Models of Code Fail at Completing Code with Potential Bugs"

20 / 20 papers shown

Title
Program Semantic Inequivalence Game with Large Language Models Antonio Valerio Miceli-Barone Vaishak Belle Ali Payani LRM 30 0 0 02 May 2025
CrashFixer: A crash resolution agent for the Linux kernel Alex Mathai Chenxi Huang Suwei Ma Jihwan Kim Hailie Mitchell Aleksandr Nogikh Petros Maniatis Franjo Ivančić Junfeng Yang Baishakhi Ray 65 0 0 29 Apr 2025
SOK: Exploring Hallucinations and Security Risks in AI-Assisted Software Development with Insights for LLM Deployment Ariful Haque Sunzida Siddique M. Rahman Ahmed Rafi Hasan Laxmi Rani Das Marufa Kamal Tasnim Masura Kishor Datta Gupta 53 1 0 31 Jan 2025
Deploying Foundation Model Powered Agent Services: A Survey Wenchao Xu Jinyu Chen Peirong Zheng Xiaoquan Yi Tianyi Tian ... Quan Wan Yining Qi Yunfeng Fan Qinliang Su Xuemin Shen AI4CE 119 1 0 18 Dec 2024
FVEval: Understanding Language Model Capabilities in Formal Verification of Digital Hardware Minwoo Kang Mingjie Liu Ghaith Bany Hamad Syed Suhaib Haoxing Ren LRM 31 2 0 15 Oct 2024
CodeMirage: Hallucinations in Code Generated by Large Language Models Vibhor Agarwal Yulong Pei Salwa Alamir Xiaomo Liu 42 4 0 14 Aug 2024
No Size Fits All: The Perils and Pitfalls of Leveraging LLMs Vary with Company Size Ashok Urlana Charaka Vinayak Kumar B. Garlapati Ajeet Kumar Singh Rahul Mishra 37 1 0 21 Jul 2024
The RealHumanEval: Evaluating Large Language Models' Abilities to Support Programmers Hussein Mozannar Valerie Chen Mohammed Alsobay Subhro Das Sebastian Zhao Dennis L. Wei Manish Nagireddy P. Sattigeri Ameet Talwalkar David Sontag ELM 46 18 0 03 Apr 2024
Envisioning the Next-Generation AI Coding Assistants: Insights & Proposals Khanh N. Nghiem Anh Minh Nguyen Nghi D. Q. Bui 37 1 0 21 Mar 2024
IRCoder: Intermediate Representations Make Language Models Robust Multilingual Code Generators Indraneil Paul Goran Glavas Iryna Gurevych 42 13 0 06 Mar 2024
LLMs with Industrial Lens: Deciphering the Challenges and Prospects -- A Survey Ashok Urlana Charaka Vinayak Kumar Ajeet Kumar Singh B. Garlapati S. Chalamala Rahul Mishra 35 5 0 22 Feb 2024
SWE-bench: Can Language Models Resolve Real-World GitHub Issues? Carlos E. Jimenez John Yang Alexander Wettig Shunyu Yao Kexin Pei Ofir Press Karthik Narasimhan ELM 34 469 0 10 Oct 2023
Large Language Models for Software Engineering: A Systematic Literature Review Xinying Hou Yanjie Zhao Yue Liu Zhou Yang Kailong Wang Li Li Xiapu Luo David Lo John C. Grundy Haoyu Wang 39 324 0 21 Aug 2023
Can we learn from developer mistakes? Learning to localize and repair real bugs from real bug fixes Cedric Richter Heike Wehrheim 27 8 0 01 Jul 2022
Productivity Assessment of Neural Code Completion Albert Ziegler Eirini Kalliamvakou Shawn Simister Ganesh Sittampalam Alice Li Andrew Rice Devon Rifkin E. Aftandilian 102 177 0 13 May 2022
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation Yue Wang Weishi Wang Chenyu You Guosheng Lin 246 1,492 0 02 Sep 2021
Measuring Coding Challenge Competence With APPS Dan Hendrycks Steven Basart Saurav Kadavath Mantas Mazeika Akul Arora ... Collin Burns Samir Puranik Horace He D. Song Jacob Steinhardt ELM AIMat ALM 208 627 0 20 May 2021
CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation Shuai Lu Daya Guo Shuo Ren Junjie Huang Alexey Svyatkovskiy ... Nan Duan Neel Sundaresan Shao Kun Deng Shengyu Fu Shujie Liu ELM 201 1,109 0 09 Feb 2021
Deep Learning for Source Code Modeling and Generation: Models, Applications and Challenges T. H. Le Hao Chen Muhammad Ali Babar VLM 64 152 0 13 Feb 2020
Semantic Robustness of Models of Source Code Goutham Ramakrishnan Jordan Henkel Zi Wang Aws Albarghouthi S. Jha Thomas W. Reps SILM AAML 41 97 0 07 Feb 2020