CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation

2 September 2021

Papers citing "CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation"

50 / 611 papers shown

Title
A Novel Approach for Automatic Program Repair using Round-Trip Translation with Large Language Models Fernando Vallecillos Ruiz Anastasiia Grishina Max Hort Leon Moonen LRM 44 4 0 15 Jan 2024
Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trends Yunshi Lan Xinyuan Li Hanyue Du Xuesong Lu Ming Gao Weining Qian Aoying Zhou 40 2 0 15 Jan 2024
Your Instructions Are Not Always Helpful: Assessing the Efficacy of Instruction Fine-tuning for Software Vulnerability Detection Imam Nur Bani Yusuf Lingxiao Jiang AAML 48 3 0 15 Jan 2024
Code Security Vulnerability Repair Using Reinforcement Learning with Large Language Models Nafis Tanveer Islam Mohammad Bahrami Karkevandi Peyman Najafirad 28 6 0 13 Jan 2024
Between Lines of Code: Unraveling the Distinct Patterns of Machine and Human Programmers Yuling Shi Hongyu Zhang Chengcheng Wan Xiaodong Gu DeLMO 27 3 0 12 Jan 2024
Rewriting the Code: A Simple Method for Large Language Model Augmented Code Search Haochen Li Xin Zhou Zhiqi Shen 34 10 0 09 Jan 2024
Chain of LoRA: Efficient Fine-tuning of Language Models via Residual Learning Wenhan Xia Chengwei Qin Elad Hazan 57 52 0 08 Jan 2024
Enhanced Automated Code Vulnerability Repair using Large Language Models David de-Fitero-Dominguez Eva García-López Antonio Garcia-Cabot J. Martínez-Herráiz 19 11 0 08 Jan 2024
LLM-Powered Code Vulnerability Repair with Reinforcement Learning and Semantic Reward Nafis Tanveer Islam Joseph Khoury Andrew Seong Mohammad Bahrami Karkevandi G. Parra E. Bou-Harb Peyman Najafirad AAML 57 14 0 07 Jan 2024
AST-T5: Structure-Aware Pretraining for Code Generation and Understanding Linyuan Gong Mostafa Elhoushi Alvin Cheung 29 11 0 05 Jan 2024
Astraios: Parameter-Efficient Instruction Tuning Code Large Language Models Terry Yue Zhuo A. Zebaze Nitchakarn Suppattarachai Leandro von Werra H. D. Vries Qian Liu Niklas Muennighoff ALM 41 15 0 01 Jan 2024
Deep Learning for Code Intelligence: Survey, Benchmark and Toolkit Yao Wan Yang He Zhangqian Bi Jianguo Zhang Hongyu Zhang Yulei Sui Guandong Xu Hai Jin Philip S. Yu 35 20 0 30 Dec 2023
A Prompt Learning Framework for Source Code Summarization Dongrui Liu Chunrong Fang Yudu You Yuchen Chen Yi Liu ... Quanjun Zhang Hanwei Qian Wei-Ye Zhao Yang Liu Zhenyu Chen LLMAG 43 13 0 26 Dec 2023
Towards Probing Contact Center Large Language Models Varun Nathan Ayush Kumar Digvijay Ingle Jithendra Vepa 27 0 0 26 Dec 2023
MoTCoder: Elevating Large Language Models with Modular of Thought for Challenging Programming Tasks Jingyao Li Pengguang Chen Jiaya Jia Hong Xu Jiaya Jia LRM 30 12 0 26 Dec 2023
Instruction Fusion: Advancing Prompt Evolution through Hybridization Weidong Guo Jiuding Yang Kaitong Yang Xiangyang Li Zhuwei Rao Yu-Syuan Xu Di Niu 13 5 0 25 Dec 2023
A Comprehensive Evaluation of Parameter-Efficient Fine-Tuning on Software Engineering Tasks Wentao Zou Qi Li Jidong Ge Chuanyi Li Xiaoyu Shen LiGuo Huang Bin Luo 29 5 0 25 Dec 2023
AgentCoder: Multi-Agent-based Code Generation with Iterative Testing and Optimisation Dong Huang Jie M.Zhang Michael Luck Qi Bu Yuhao Qing Heming Cui LLMAG 25 0 0 20 Dec 2023
WaveCoder: Widespread And Versatile Enhancement For Code Large Language Models By Instruction Tuning Zhaojian Yu Xin Zhang Ning Shang Yangyu Huang Can Xu Yishujie Zhao Wenxiang Hu Qiufeng Yin SyDa 25 22 0 20 Dec 2023
Xpert: Empowering Incident Management with Query Recommendations via Large Language Models Yuxuan Jiang Chaoyun Zhang Shilin He Zhihao Yang Ming-Jie Ma ... Yu Kang Yingnong Dang Saravan Rajmohan Qingwei Lin Dongmei Zhang 45 17 0 19 Dec 2023
Predicting Line-Level Defects by Capturing Code Contexts with Hierarchical Transformers Parvez Mahbub Mohammad Masudur Rahman 13 3 0 19 Dec 2023
Traces of Memorisation in Large Language Models for Code Ali Al-Kaswan M. Izadi A. van Deursen ELM 36 14 0 18 Dec 2023
kNN-ICL: Compositional Task-Oriented Parsing Generalization with Nearest Neighbor In-Context Learning Wenting Zhao Ye Liu Yao Wan Yibo Wang Qingyang Wu Zhongfen Deng Jiangshu Du Shuaiqi Liu Yunlong Xu Philip S. Yu 46 7 0 17 Dec 2023
Binary Code Summarization: Benchmarking ChatGPT/GPT-4 and Other Large Language Models Xin Jin Jonathan Larson Weiwei Yang Zhiqiang Lin ELM 23 20 0 15 Dec 2023
Dynamic Retrieval-Augmented Generation Anton Shapkin Denis Litvinov Yaroslav Zharov Egor Bogomolov Timur Galimzyanov T. Bryksin SyDa RALM 28 1 0 14 Dec 2023
INSPECT: Intrinsic and Systematic Probing Evaluation for Code Transformers Anjan Karmakar Romain Robbes 27 4 0 08 Dec 2023
Out of Context: How important is Local Context in Neural Program Repair? Julian Aron Prenner Romain Robbes 19 9 0 08 Dec 2023
Graph Convolutions Enrich the Self-Attention in Transformers! Jeongwhan Choi Hyowon Wi Jayoung Kim Yehjin Shin Kookjin Lee Nathaniel Trask Noseong Park 32 4 0 07 Dec 2023
Magicoder: Empowering Code Generation with OSS-Instruct Yuxiang Wei Zhe Wang Jiawei Liu Yifeng Ding Lingming Zhang SyDa 45 95 0 04 Dec 2023
A Machine Learning Approach Towards SKILL Code Autocompletion Enrique Dehaerne Bappaditya Dey Wannes Meert 24 0 0 04 Dec 2023
Nova: Generative Language Models for Assembly Code with Hierarchical Attention and Contrastive Learning Nan Jiang Chengxiao Wang Kevin Liu Xiangzhe Xu Lin Tan Xiangyu Zhang OffRL 25 8 0 22 Nov 2023
Naturalness of Attention: Revisiting Attention in Code Language Models M. Saad Tushar Sharma 30 2 0 22 Nov 2023
Interpreting User Requests in the Context of Natural Language Standing Instructions Nikita Moghe Patrick Xia Jacob Andreas J. Eisner Benjamin Van Durme Harsh Jhamtani 29 3 0 16 Nov 2023
GenCodeSearchNet: A Benchmark Test Suite for Evaluating Generalization in Programming Language Understanding Andor Diera Abdelhalim Hafedh Dahou Lukas Galke Fabian Karl Florian Sihler A. Scherp ELM 37 4 0 16 Nov 2023
Language Models are Better Bug Detector Through Code-Pair Classification Kamel Alrashedy Ahmed Binjahlan 12 6 0 14 Nov 2023
An Extensive Study on Adversarial Attack against Pre-trained Models of Code Xiaohu Du Ming Wen Zichao Wei Shangwen Wang Hai Jin AAML 35 15 0 13 Nov 2023
DocGen: Generating Detailed Parameter Docstrings in Python Vatsal Venkatkrishna Durga Shree Nagabushanam Emmanuel Iko-Ojo Simon M. Vidoni 21 0 0 11 Nov 2023
Learning Defect Prediction from Unrealistic Data Kamel Alrashedy Vincent J. Hellendoorn Alessandro Orso 16 5 0 02 Nov 2023
Will Code Remain a Relevant User Interface for End-User Programming with Generative AI Models? Advait Sarkar 26 16 0 01 Nov 2023
Data Augmentation for Code Translation with Comparable Corpora and Multiple References Yiqing Xie Atharva Naik Daniel Fried Carolyn Rose 51 6 0 01 Nov 2023
Pitfalls in Language Models for Code Intelligence: A Taxonomy and Survey Xinyu She Yue Liu Yanjie Zhao Yiling He Li Li C. Tantithamthavorn Zhan Qin Haoyu Wang ELM 35 13 0 27 Oct 2023
CodeFusion: A Pre-trained Diffusion Model for Code Generation Mukul Singh J. Cambronero Sumit Gulwani Vu Le Carina Negreanu Gust Verbruggen 32 28 0 26 Oct 2023
FormaT5: Abstention and Examples for Conditional Table Formatting with Natural Language Mukul Singh J. Cambronero Sumit Gulwani Vu Le Carina Negreanu Elnaz Nouri Mohammad Raza Gust Verbruggen LMTD 10 9 0 26 Oct 2023
$TST$^\mathrm{R}$: Target Similarity Tuning Meets the Real World$ TST $^\mathrm{R}$ : Target Similarity Tuning Meets the Real World Anirudh Khatry Sumit Gulwani Priyanshu Gupta Vu Le Ananya Singha Mukul Singh Gust Verbruggen 20 1 0 26 Oct 2023
Learning Transfers over Several Programming Languages Razan Baltaji Saurabh Pujar Louis Mandel Martin Hirzel Luca Buratti L. Varshney 10 3 0 25 Oct 2023
Language Agnostic Code Embeddings Saiteja Utpala Alex Gu Pin-Yu Chen 36 1 0 25 Oct 2023
Understanding Code Semantics: An Evaluation of Transformer Models in Summarization Debanjan Mondal Abhilasha Lodha Ankita Sahoo Beena Kumari 37 0 0 25 Oct 2023
Enhancing Large Language Models for Secure Code Generation: A Dataset-driven Study on Vulnerability Mitigation Jiexin Wang Liuwen Cao Xitong Luo Zhiping Zhou Jiayuan Xie Adam Jatowt Yi Cai 44 10 0 25 Oct 2023
White-box Compiler Fuzzing Empowered by Large Language Models Chenyuan Yang Yinlin Deng Runyu Lu Jiayi Yao Jiawei Liu Reyhaneh Jabbarvand Lingming Zhang 45 28 0 24 Oct 2023
CP-BCS: Binary Code Summarization Guided by Control Flow Graph and Pseudo Code Tong Ye Lingfei Wu Tengfei Ma Xuhong Zhang Yangkai Du Peiyu Liu Shouling Ji Wenhai Wang 31 12 0 24 Oct 2023