CodeBLEU: a Method for Automatic Evaluation of Code Synthesis

22 September 2020

Papers citing "CodeBLEU: a Method for Automatic Evaluation of Code Synthesis"

50 / 245 papers shown

Title
CodeBC: A More Secure Large Language Model for Smart Contract Code Generation in Blockchain LingXiang Wang Hainan Zhang Qinnan Zhang Ziwei Wang Hongwei Zheng Jin Dong Zhiming Zheng 61 0 0 28 Apr 2025
Prompting LLMs for Code Editing: Struggles and Remedies Daye Nam Ahmed Omran Ambar Murillo Saksham Thakur Abner Araujo Marcel Blistein Alexander Frömmgen Vincent J. Hellendoorn Satish Chandra KELM 73 0 0 28 Apr 2025
Large Language Models are Qualified Benchmark Builders: Rebuilding Pre-Training Datasets for Advancing Code Intelligence Tasks Kang Yang Xinjun Mao Shangwen Wang Yalin Wang Tanghaoran Zhang Bo Lin Yihao Qin Zhang Zhang Yao Lu Kamal Al-Sabahi ALM 152 1 0 28 Apr 2025
Evaluate-and-Purify: Fortifying Code Language Models Against Adversarial Attacks Using LLM-as-a-Judge Wenhan Mu Ling Xu Shuren Pei Le Mi Huichi Zhou AAML ELM 53 0 0 28 Apr 2025
Evaluating Grounded Reasoning by Code-Assisted Large Language Models for Mathematics Zena Al-Khalili Nick Howell Dietrich Klakow LRM 29 0 0 24 Apr 2025
Give LLMs a Security Course: Securing Retrieval-Augmented Code Generation via Knowledge Injection Bo Lin Shangwen Wang Yihao Qin Liqian Chen Xiaoguang Mao SILM 36 0 0 23 Apr 2025
LLM-Assisted Translation of Legacy FORTRAN Codes to C++: A Cross-Platform Study Nishath Rajiv Ranasinghe Shawn M. Jones Michal Kucer Ayan Biswas Daniel O'Malley Alexander Buschmann Most Selma Liliane Wanna Ajay Sreekumar 32 0 0 21 Apr 2025
Empowering AI to Generate Better AI Code: Guided Generation of Deep Learning Projects with LLMs Chen Xie Mingsheng Jiao Xiaodong Gu Beijun Shen 22 0 0 21 Apr 2025
CodeVisionary: An Agent-based Framework for Evaluating Large Language Models in Code Generation Xinchen Wang Pengfei Gao Chao Peng Ruida Hu Cuiyun Gao ELM 36 0 0 18 Apr 2025
MigGPT: Harnessing Large Language Models for Automated Migration of Out-of-Tree Linux Kernel Patches Across Versions Pucheng Dang Di Huang Dong Li Kang Chen Yuanbo Wen Qi Guo Xing Hu Ninghui Sun 39 0 0 13 Apr 2025
Towards an Understanding of Context Utilization in Code Intelligence Yanlin Wang Kefeng Duan Dewu Zheng Ensheng Shi F. Zhang ... Xilin Liu Yuchi Ma Hongyu Zhang Qianxiang Wang Zibin Zheng 31 0 0 11 Apr 2025
DeCoMa: Detecting and Purifying Code Dataset Watermarks through Dual Channel Code Abstraction Yuan Xiao Yuchen Chen Shiqing Ma Haocheng Huang Chunrong Fang Y. Chen Dongrui Liu Yunfeng Zhu Xinming Zhang Zhenyu Chen 31 0 0 09 Apr 2025
DDPT: Diffusion-Driven Prompt Tuning for Large Language Model Code Generation Jinyang Li Sangwon Hyun Muhammad Ali Babar 23 0 0 06 Apr 2025
Rubric Is All You Need: Enhancing LLM-based Code Evaluation With Question-Specific Rubrics Aditya Pathak Rachit Gandhi Vaibhav Uttam Devansh Yashwanth Nakka ... Aditya Mittal Aashna Ased Chirag Khatri Jagat Sesh Challa Dhruv Kumar 45 0 0 31 Mar 2025
SciReplicate-Bench: Benchmarking LLMs in Agent-driven Algorithmic Reproduction from Research Papers Yanzheng Xiang Hanqi Yan Shuyin Ouyang Lin Gui Yulan He 51 2 0 31 Mar 2025
CCCI: Code Completion with Contextual Information for Complex Data Transfer Tasks Using Large Language Models Hangzhan Jin Mohammad Hamdaqa 55 0 0 29 Mar 2025
StarFlow: Generating Structured Workflow Outputs From Sketch Images Patrice Bechard Chao Wang Amirhossein Abaskohi Juan A. Rodriguez Christopher Pal David Vazquez Spandana Gella Sai Rajeswar Perouz Taslakian 33 0 0 27 Mar 2025
On Explaining (Large) Language Models For Code Using Global Code-Based Explanations David Nader-Palacio Dipin Khati Daniel Rodríguez-Cárdenas Alejandro Velasco Denys Poshyvanyk LRM 47 0 0 21 Mar 2025
Enhancing Code LLM Training with Programmer Attention Y. Zhang Chen Huang Z. Karas Dung T. Nguyen Kevin Leach Yu Huang 75 0 0 19 Mar 2025
A Comprehensive Study of LLM Secure Code Generation Shih-Chieh Dai Jun Xu Guanhong Tao ELM 51 0 0 18 Mar 2025
XOXO: Stealthy Cross-Origin Context Poisoning Attacks against AI Coding Assistants Adam Storek Mukur Gupta Noopur Bhatt Aditya Gupta Janie Kim Prashast Srivastava Suman Jana AAML 74 0 0 18 Mar 2025
Unified Modeling Language Code Generation from Diagram Images Using Multimodal Large Language Models Averi Bates Ryan Vavricka Shane Carleton Ruosi Shao Chongle Pan 61 0 0 15 Mar 2025
Ensemble Learning for Large Language Models in Text and Code Generation: A Survey Mari Ashiga Wei Jie Fan Wu Vardan K. Voskanyan Fateme Dinmohammadi P. Brookes Jingzhi Gong Zheng Wang 44 0 0 13 Mar 2025
ResBench: Benchmarking LLM-Generated FPGA Designs with Resource Awareness Ce Guo Tong Zhao 61 1 0 11 Mar 2025
Fully Autonomous Programming using Iterative Multi-Agent Debugging with Large Language Models Anastasiia Grishina Vadim Liventsev Aki Härmä Leon Moonen ELM 87 0 0 10 Mar 2025
ProjectEval: A Benchmark for Programming Agents Automated Evaluation on Project-Level Code Generation Kaiyuan Liu Youcheng Pan J. Li Daojing He Yang Xiang Yexing Du Tianrun Gao LLMAG ELM 61 1 0 10 Mar 2025
GenAI for Simulation Model in Model-Based Systems Engineering Lin Zhang Y. Zhang Dusit Niyato Lei Ren Pengfei Gu Zhen Chen Y. Laili Wentong Cai Agostino Bruzzone AI4CE 38 0 0 09 Mar 2025
Large Language Models for Code Generation: A Comprehensive Survey of Challenges, Techniques, Evaluation, and Applications Nam Huynh Beiyu Lin LM&MA 80 16 0 03 Mar 2025
How Diversely Can Language Models Solve Problems? Exploring the Algorithmic Diversity of Model-Generated Code Seonghyeon Lee Heejae Chon Joonwon Jang Dongha Lee Hwanjo Yu ALM 39 0 0 02 Mar 2025
A Survey of Uncertainty Estimation Methods on Large Language Models Zhiqiu Xia Jinxuan Xu Yuqian Zhang Hang Liu 38 1 0 28 Feb 2025
Learning Code-Edit Embedding to Model Student Debugging Behavior Hasnain Heickal Andrew Lan 56 0 0 26 Feb 2025
Automated Knowledge Component Generation and Knowledge Tracing for Coding Problems Zhangqi Duan Nigel Fernandez Sri Kanakadandi Bita Akram Andrew S. Lan 67 0 0 25 Feb 2025
StatLLM: A Dataset for Evaluating the Performance of Large Language Models in Statistical Analysis Xinyi Song Lina Lee Kexin Xie Xueying Liu Xinwei Deng Yili Hong ALM ELM 157 0 0 24 Feb 2025
Investigating the Adaptive Robustness with Knowledge Conflicts in LLM-based Multi-Agent Systems Tianjie Ju Binghui Wang Hao Fei M. Lee W. Hsu ... Qianren Wang Pengzhou Cheng Zongru Wu Zhuosheng Zhang Gongshen Liu AAML 36 0 0 24 Feb 2025
AutoParLLM: GNN-guided Context Generation for Zero-Shot Code Parallelization using LLMs Quazi Ishtiaque Mahmud Ali TehraniJamsaz Hung Phan Le Chen Mihai Capota Theodore L. Willke Nesreen Ahmed Ali Jannesari 57 5 0 20 Feb 2025
Show Me Your Code! Kill Code Poisoning: A Lightweight Method Based on Code Naturalness Dongrui Liu Yuchen Chen Mengzhe Yuan Chunrong Fang Zhenpeng Chen Chong Wang Yang Liu Baowen Xu Zhenyu Chen AAML 36 1 0 20 Feb 2025
UniGenCoder: Merging Seq2Seq and Seq2Tree Paradigms for Unified Code Generation Liangying Shao Yanfu Yan Denys Poshyvanyk Jinsong Su 41 1 0 18 Feb 2025
Bridging LLM-Generated Code and Requirements: Reverse Generation technique and SBC Metric for Developer Insights Ahilan Ayyachamy Nadar Ponnusamy 66 0 0 11 Feb 2025
Process-Supervised Reinforcement Learning for Code Generation Yufan Ye Ting Zhang Wenbin Jiang Hua Huang OffRL LRM SyDa 63 1 0 03 Feb 2025
SoK: Towards Effective Automated Vulnerability Repair Ying Li Faysal hossain shezan Bomin wei Gang Wang Yuan Tian 120 1 0 31 Jan 2025
Towards Making Flowchart Images Machine Interpretable Shivalika Singh Prajwal Gatti Yogesh Kumar Vikash Yadav Anand Mishra 53 5 0 29 Jan 2025
Skeleton-Guided-Translation: A Benchmarking Framework for Code Repository Translation with Fine-Grained Quality Evaluation Xing Zhang Jiaheng Wen Fangkai Yang Pu Zhao Yu Kang ... Qingwei Lin Yingnong Dang Saravan Rajmohan Dongmei Zhang Qi Zhang 56 2 0 28 Jan 2025
GREEN-CODE: Learning to Optimize Energy Efficiency in LLM-based Code Generation Shashikant Ilager Lukas Florian Briem Ivona Brandić 34 0 0 19 Jan 2025
aiXcoder-7B: A Lightweight and Effective Large Language Model for Code Processing Siyuan Jiang Jia Li He Zong Huanyu Liu Hao Zhu ... Wei Ning G. Wang Yihong Dong Kechi Zhang Ge Li ALM 72 2 0 17 Jan 2025
RAPGen: An Approach for Fixing Code Inefficiencies in Zero-Shot Spandan Garg Roshanak Zilouchian Moghaddam Neel Sundaresan 61 9 0 10 Jan 2025
Enhancing Code LLMs with Reinforcement Learning in Code Generation: A Survey Junqiao Wang Zeng Zhang Yangfan He Yuyang Song Tianyu Shi ... Hengyuan Xu Kunyu Wu Guangwu Qian Qiuwu Chen Lewei He 38 11 0 03 Jan 2025
CodeIP: A Grammar-Guided Multi-Bit Watermark for Large Language Models of Code Batu Guan Yao Wan Zhangqian Bi Zheng Wang Hongyu Zhang Yulei Sui Pan Zhou 37 8 0 31 Dec 2024
Transducer Tuning: Efficient Model Adaptation for Software Tasks Using Code Property Graphs Imam Nur Bani Yusuf Lingxiao Jiang 88 0 0 18 Dec 2024
Safe to Serve: Aligning Instruction-Tuned Models for Safety and Helpfulness Avinash Amballa Durga Sandeep Saluru Gayathri Akkinapalli Abhishek Sureddy Akshay Kumar Sureddy ALM 90 0 0 26 Nov 2024
Instruct or Interact? Exploring and Eliciting LLMs' Capability in Code Snippet Adaptation Through Prompt Engineering Tanghaoran Zhang Yue Yu Xinjun Mao Shangwen Wang Kang Yang Yao Lu Zhang Zhang Yuxin Zhao 73 1 0 23 Nov 2024