CodeBLEU: a Method for Automatic Evaluation of Code Synthesis

22 September 2020

Papers citing "CodeBLEU: a Method for Automatic Evaluation of Code Synthesis"

50 / 245 papers shown

Title
Automated Bug Generation in the era of Large Language Models Ali Reza Ibrahimzada Yang Chen Ryan Rong Reyhaneh Jabbarvand 35 3 0 03 Oct 2023
Dynamic LLM-Agent Network: An LLM-agent Collaboration Framework with Agent Team Optimization Zijun Liu Yanzhe Zhang Peng Li Yang Liu Diyi Yang LLMAG 36 102 0 03 Oct 2023
CAT-LM: Training Language Models on Aligned Code And Tests Nikitha Rao Kush Jain Uri Alon Claire Le Goues Vincent J. Hellendoorn ALM 42 42 0 02 Oct 2023
Program Repair with Minimal Edits Using CodeT5 Atsushi Shirafuji Md. Mostafizer Rahman Md. Faizul Ibne Amin Yutaka Watanobe 27 9 0 26 Sep 2023
Efficient Avoidance of Vulnerabilities in Auto-completed Smart Contract Code Using Vulnerability-constrained Decoding André Storhaug Jingyue Li Tianyuan Hu AAML 34 14 0 18 Sep 2023
Bias Testing and Mitigation in LLM-based Code Generation Dong Huang Qingwen Bu Jie M. Zhang Xiaofei Xie Junjie Chen Heming Cui 48 20 0 03 Sep 2023
Towards Code Watermarking with Dual-Channel Transformations Borui Yang Wei Li Liyao Xiang Bo-wen Li 31 8 0 02 Sep 2023
Exploring Parameter-Efficient Fine-Tuning Techniques for Code Generation with Large Language Models Martin Weyssow Xin Zhou Kisub Kim David Lo H. Sahraoui 38 27 0 21 Aug 2023
Evaluating and Explaining Large Language Models for Code Using Syntactic Structures David Nader-Palacio Alejandro Velasco Daniel Rodríguez-Cárdenas Kevin Moran Denys Poshyvanyk 34 8 0 07 Aug 2023
CodeBPE: Investigating Subtokenization Options for Large Language Model Pretraining on Source Code Nadezhda Chirkova Sergey Troshin 21 8 0 01 Aug 2023
Multilingual Code Co-Evolution Using Large Language Models Jiyang Zhang Pengyu Nie Junyi Jessy Li Miloš Gligorić 32 20 0 27 Jul 2023
Look Before You Leap: An Exploratory Study of Uncertainty Measurement for Large Language Models Yuheng Huang Jiayang Song Zhijie Wang Shengming Zhao Huaming Chen Felix Juefei-Xu Lei Ma 28 4 0 16 Jul 2023
Creating a Dataset for High-Performance Computing Code Translation using LLMs: A Bridge Between OpenMP Fortran and C++ Bin Lei Caiwen Ding Le Chen Pei-Hung Lin Chunhua Liao 17 8 0 15 Jul 2023
RLTF: Reinforcement Learning from Unit Test Feedback Jiate Liu Yiqin Zhu Kaiwen Xiao Qiang Fu Xiao Han Wei Yang Deheng Ye OffRL 49 56 0 10 Jul 2023
LM4HPC: Towards Effective Language Model Application in High-Performance Computing Le Chen Pei-Hung Lin T. Vanderbruggen C. Liao M. Emani B. D. Supinski 33 25 0 26 Jun 2023
Exploring the Robustness of Large Language Models for Solving Programming Problems Atsushi Shirafuji Yutaka Watanobe Takumi Ito Makoto Morishita Yuki Nakamura Yusuke Oda Jun Suzuki ELM 41 18 0 26 Jun 2023
FlakyFix: Using Large Language Models for Predicting Flaky Test Fix Categories and Test Code Repair Sakina Fatima Hadi Hemmati Lionel C. Briand 34 4 0 21 Jun 2023
HAUSER: Towards Holistic and Automatic Evaluation of Simile Generation Qi He Yikai Zhang Jiaqing Liang Yuncheng Huang Yanghua Xiao Yunwen Chen 49 4 0 13 Jun 2023
CoTran: An LLM-based Code Translator using Reinforcement Learning with Feedback from Compiler and Symbolic Execution Prithwish Jana Piyush Jha Haoyang Ju Gautham Kishore Aryan Mahajan Vijay Ganesh 24 12 0 11 Jun 2023
A Comprehensive Review of State-of-The-Art Methods for Java Code Generation from Natural Language Text Jessica Nayeli López Espejel Mahaman Sanoussi Yahaya Alassan El Mehdi Chouham Walid Dahhane E. Ettifouri 21 13 0 10 Jun 2023
Large Language Models of Code Fail at Completing Code with Potential Bugs Tuan Dinh Jinman Zhao Samson Tan Renato M. P. Negrinho Leonard Lausen Sheng Zha George Karypis LRM 34 25 0 06 Jun 2023
Do Large Language Models Pay Similar Attention Like Human Programmers When Generating Code? Bonan Kou Shengmai Chen Zhijie Wang Lei Ma Tianyi Zhang ALM 11 13 0 02 Jun 2023
CodeTF: One-stop Transformer Library for State-of-the-art Code LLM Nghi D. Q. Bui Hung Le Yue Wang Junnan Li Akhilesh Deepak Gotmare Steven C. H. Hoi 21 26 0 31 May 2023
Learning UI-to-Code Reverse Generator Using Visual Critic Without Rendering Davit Soselia Khalid Saifullah Dinesh Manocha 19 0 0 24 May 2023
Neural Machine Translation for Code Generation K. Dharma Clayton T. Morrison 32 4 0 22 May 2023
Towards Code Generation from BDD Test Case Specifications: A Vision Leon Chemnitz David Reichenbach Hani Aldebes Mariam Naveed Krishna Narasimhan Mira Mezini 16 3 0 19 May 2023
On the Usage of Continual Learning for Out-of-Distribution Generalization in Pre-trained Language Models of Code Martin Weyssow Xin Zhou Kisub Kim David Lo H. Sahraoui CLL KELM 29 10 0 06 May 2023
ICE-Score: Instructing Large Language Models to Evaluate Code Terry Yue Zhuo ELM ALM 41 37 0 27 Apr 2023
Fully Autonomous Programming with Large Language Models Vadim Liventsev Anastasiia Grishina Aki Härmä Leon Moonen ELM 34 37 0 20 Apr 2023
Enhancing Automated Program Repair through Fine-tuning and Prompt Engineering Rishov Paul Md. Mohib Hossain Mohammed Latif Siddiq Masum Hasan Anindya Iqbal Joanna C. S. Santos KELM 34 11 0 16 Apr 2023
Stochastic Code Generation Swapnil Sharma Nikita Anand V. KranthiKiranG. SyDa 30 0 0 14 Apr 2023
Towards Generating Functionally Correct Code Edits from Natural Language Issue Descriptions Sarah Fakhoury Saikat Chakraborty Madan Musuvathi Shuvendu K. Lahiri 38 21 0 07 Apr 2023
RunBugRun -- An Executable Dataset for Automated Program Repair Julian Aron Prenner Romain Robbes 38 11 0 03 Apr 2023
Better Language Models of Code through Self-Improvement H. To Nghi D. Q. Bui Jingnan Guo T. Nguyen SyDa 42 15 0 02 Apr 2023
CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-X Qinkai Zheng Xiao Xia Xu Zou Yuxiao Dong Shanshan Wang ... Andi Wang Yang Li Teng Su Zhilin Yang Jie Tang ELM ALM SyDa 57 317 0 30 Mar 2023
JaCoText: A Pretrained Model for Java Code-Text Generation Jessica Nayeli López Espejel Mahaman Sanoussi Yahaya Alassan Walid Dahhane E. Ettifouri 34 3 0 22 Mar 2023
Exploring Distributional Shifts in Large Language Models for Code Analysis Shushan Arakelyan Rocktim Jyoti Das Yi Mao Xiang Ren ALM 29 19 0 16 Mar 2023
ADELT: Transpilation Between Deep Learning Frameworks Linyuan Gong Jiayi Wang Alvin Cheung 32 3 0 07 Mar 2023
xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval Mohammad Abdullah Matin Khan M Saiful Bari Xuan Long Do Weishi Wang Md. Rizwan Parvez Chenyu You ALM ELM 34 14 0 06 Mar 2023
Learning Deep Semantics for Test Completion Pengyu Nie Rahul Banerjee Junyi Jessy Li Raymond J. Mooney Miloš Gligorić 33 54 0 20 Feb 2023
Tree-Based Representation and Generation of Natural and Mathematical Language Alexander Scarlatos Andrew S. Lan 8 18 0 15 Feb 2023
CodeBERTScore: Evaluating Code Generation with Pretrained Models of Code Shuyan Zhou Uri Alon Sumit Agarwal Graham Neubig ELM ALM 40 98 0 10 Feb 2023
Exploring Data Augmentation for Code Generation Tasks Pinzhen Chen Gerasimos Lampouras 31 9 0 05 Feb 2023
Execution-based Code Generation using Deep Reinforcement Learning Parshin Shojaee Aneesh Jain Sindhu Tipirneni Chandan K. Reddy 25 52 0 31 Jan 2023
SantaCoder: don't reach for the stars! Loubna Ben Allal Raymond Li Denis Kocetkov Chenghao Mou Christopher Akiki ... Sean M. Hughes Daniel Fried Arjun Guha H. D. Vries Leandro von Werra 45 189 0 09 Jan 2023
Improving Automated Program Repair with Domain Adaptation Armin Zirak Hadi Hemmati 16 9 0 21 Dec 2022
Execution-Based Evaluation for Open-Domain Code Generation Zhiruo Wang Shuyan Zhou Daniel Fried Graham Neubig ELM 37 80 0 20 Dec 2022
A Survey on Pretrained Language Models for Neural Code Intelligence Yichen Xu Yanqiao Zhu 9 17 0 20 Dec 2022
Python Code Generation by Asking Clarification Questions Haau-Sing Li Mohsen Mesgar André F. T. Martins Iryna Gurevych 29 11 0 19 Dec 2022
Large Language Models Meet NL2Code: A Survey Daoguang Zan B. Chen Fengji Zhang Di Lu Bingchao Wu Bei Guan Yongji Wang Jian-Guang Lou ELM ALM 31 170 0 19 Dec 2022