On the Evaluation of Neural Code Summarization

15 July 2021

Papers citing "On the Evaluation of Neural Code Summarization"

37 / 37 papers shown

Title
Knowledge Distillation of Domain-adapted LLMs for Question-Answering in Telecom Rishika Sen Sujoy Roychowdhury Sumit Soman H. G. Ranjani Srikhetra Mohanty 66 0 0 28 Apr 2025
Towards an Understanding of Context Utilization in Code Intelligence Yanlin Wang Kefeng Duan Dewu Zheng Ensheng Shi F. Zhang ... Xilin Liu Yuchi Ma Hongyu Zhang Qianxiang Wang Zibin Zheng 29 0 0 11 Apr 2025
Enhancing Code LLM Training with Programmer Attention Y. Zhang Chen Huang Z. Karas Dung T. Nguyen Kevin Leach Yu Huang 75 0 0 19 Mar 2025
Commenting Higher-level Code Unit: Full Code, Reduced Code, or Hierarchical Code Summarization Weisong Sun Y. Zhang J. Zhu Z. Wang Chunrong Fang ... Yebo Feng Jiangping Huang X. Wang Zhi Jin Yang Liu 63 1 0 13 Mar 2025
Transducer Tuning: Efficient Model Adaptation for Software Tasks Using Code Property Graphs Imam Nur Bani Yusuf Lingxiao Jiang 82 0 0 18 Dec 2024
Source Code Summarization in the Era of Large Language Models Weisong Sun Yun Miao Yuekang Li Hongyu Zhang Chunrong Fang Yi Liu Gelei Deng Yang Liu Zhenyu Chen ELM 49 14 0 09 Jul 2024
ESALE: Enhancing Code-Summary Alignment Learning for Source Code Summarization Chunrong Fang Weisong Sun Yuchen Chen Xiao Chen Zhao Wei Quanjun Zhang Yudu You Bin Luo Yang Liu Zhenyu Chen AI4TS 42 12 0 01 Jul 2024
Enhancing Trust in LLM-Generated Code Summaries with Calibrated Confidence Scores Yuvraj Virk Prem Devanbu Toufique Ahmed 62 10 0 30 Apr 2024
Analyzing the Performance of Large Language Models on Code Summarization Rajarshi Haldar J. Hockenmaier 40 17 0 10 Apr 2024
MESIA: Understanding and Leveraging Supplementary Nature of Method-level Comments for Automatic Comment Generation Xinglu Pan Chenxiao Liu Yanzhen Zou Tao Xie Bing Xie 22 2 0 26 Mar 2024
Studying LLM Performance on Closed- and Open-source Data Toufique Ahmed Christian Bird Prem Devanbu Saikat Chakraborty 64 9 0 23 Feb 2024
EyeTrans: Merging Human and Machine Attention for Neural Code Summarization Yifan Zhang Jiliang Li Z. Karas Aakash Bansal Toby Jia-Jun Li Collin McMillan Kevin Leach Yu Huang 30 7 0 21 Feb 2024
A Prompt Learning Framework for Source Code Summarization Weisong Sun Chunrong Fang Yudu You Yuchen Chen Yi Liu ... Quanjun Zhang Hanwei Qian Wei-Ye Zhao Yang Liu Zhenyu Chen LLMAG 43 13 0 26 Dec 2023
Binary Code Summarization: Benchmarking ChatGPT/GPT-4 and Other Large Language Models Xin Jin Jonathan Larson Weiwei Yang Zhiqiang Lin ELM 17 20 0 15 Dec 2023
Abstract Syntax Tree for Programming Language Understanding and Representation: How Far Are We? Weisong Sun Chunrong Fang Yun Miao Yudu You Mengzhe Yuan ... Quanjun Zhang An Guo Xiang Chen Yang Liu Zhenyu Chen 33 5 0 01 Dec 2023
CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generation Weixiang Yan Haitian Liu Yunkun Wang Yunzhe Li Qian Chen ... Tingyu Lin Weishan Zhao Li Zhu Hari Sundaram Shuiguang Deng ELM LRM 26 35 0 14 Nov 2023
An Extensive Study on Adversarial Attack against Pre-trained Models of Code Xiaohu Du Ming Wen Zichao Wei Shangwen Wang Hai Jin AAML 33 15 0 13 Nov 2023
Pitfalls in Language Models for Code Intelligence: A Taxonomy and Survey Xinyu She Yue Liu Yanjie Zhao Yiling He Li Li C. Tantithamthavorn Zhan Qin Haoyu Wang ELM 30 13 0 27 Oct 2023
Understanding Code Semantics: An Evaluation of Transformer Models in Summarization Debanjan Mondal Abhilasha Lodha Ankita Sahoo Beena Kumari 35 0 0 25 Oct 2023
LUNA: A Model-Based Universal Analysis Framework for Large Language Models Da Song Xuan Xie Jiayang Song Derui Zhu Yuheng Huang Felix Juefei Xu Lei Ma ALM 27 3 0 22 Oct 2023
MedChatZH: a Better Medical Adviser Learns from Better Instructions Yang Tan Mingchen Li Zijie Huang Huiqun Yu Guisheng Fan LM&MA MedIm AI4MH 13 8 0 03 Sep 2023
SoTaNa: The Open-Source Software Development Assistant Ensheng Shi Fengji Zhang Yanlin Wang B. Chen Lun Du Hongyu Zhang Shi Han Dongmei Zhang Hongbin Sun 23 12 0 25 Aug 2023
OctoPack: Instruction Tuning Code Large Language Models Niklas Muennighoff Qian Liu A. Zebaze Qinkai Zheng Binyuan Hui Terry Yue Zhuo Swayam Singh Xiangru Tang Leandro von Werra Shayne Longpre VLM ALM 65 117 0 14 Aug 2023
Automatic Code Summarization via ChatGPT: How Far Are We? Weisong Sun Chunrong Fang Yudu You Yun Miao Yi Liu ... Yuchen Chen Quanjun Zhang Hanwei Qian Yang Liu Zhenyu Chen ELM 24 73 0 22 May 2023
Is ChatGPT the Ultimate Programming Assistant -- How far is it? Haoye Tian Weiqi Lu T. Li Xunzhu Tang S. Cheung Jacques Klein Tegawende F. Bissyande 19 184 0 24 Apr 2023
Automatic Semantic Augmentation of Language Model Prompts (for Code Summarization) Toufique Ahmed Kunal Suresh Pai Prem Devanbu Earl T. Barr LRM 39 100 0 13 Apr 2023
Towards Efficient Fine-tuning of Pre-trained Code Models: An Experimental Study and Beyond Ensheng Shi Yanlin Wang Hongyu Zhang Lun Du Shi Han Dongmei Zhang Hongbin Sun 33 42 0 11 Apr 2023
APIContext2Com: Code Comment Generation by Incorporating Pre-Defined API Documentation Ramin Shahbazi Fatemeh H. Fard 28 2 0 03 Mar 2023
Recommending Root-Cause and Mitigation Steps for Cloud Incidents using Large Language Models Toufique Ahmed Supriyo Ghosh Chetan Bansal Thomas Zimmermann Xuchao Zhang Saravan Rajmohan AI4CE 38 52 0 10 Jan 2023
Extending Source Code Pre-Trained Language Models to Summarise Decompiled Binaries Ali Al-Kaswan Toufique Ahmed M. Izadi A. Sawant Prem Devanbu A. van Deursen SyDa 98 32 0 04 Jan 2023
Pre-Training Representations of Binary Code Using Contrastive Learning Yifan Zhang Chen Huang Yueke Zhang Kevin Cao Scott Thomas Andersen Huajie Shao Kevin Leach Yu Huang 45 3 0 11 Oct 2022
NeuDep: Neural Binary Memory Dependence Analysis Kexin Pei Dongdong She Michael Wang Scott Geng Zhou Xuan Yaniv David Junfeng Yang Suman Jana Baishakhi Ray 30 5 0 04 Oct 2022
Few-shot training LLMs for project-specific code-summarization Toufique Ahmed Prem Devanbu 179 213 0 09 Jul 2022
An Extractive-and-Abstractive Framework for Source Code Summarization Weisong Sun Chunrong Fang Yuchen Chen Quanjun Zhang Guanhong Tao Tingxu Han Yifei Ge Yudu You Bin Luo 26 29 0 15 Jun 2022
Learning code summarization from a small and local dataset Toufique Ahmed Prem Devanbu 37 9 0 02 Jun 2022
CoCoSoDa: Effective Contrastive Learning for Code Search Ensheng Shi Yanlin Wang Wenchao Gu Lun Du Hongyu Zhang Shi Han Dongmei Zhang Hongbin Sun 38 33 0 07 Apr 2022
RACE: Retrieval-Augmented Commit Message Generation Ensheng Shi Yanlin Wang Wei Tao Lun Du Hongyu Zhang Shi Han Dongmei Zhang Hongbin Sun VLM 24 41 0 05 Mar 2022