CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation

2 September 2021

ArXiv (abs)PDF HTML Github (2999★)

Papers citing "CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation"

50 / 638 papers shown

Title
DeepCode AI Fix: Fixing Security Vulnerabilities with Large Language Models Berkay Berabi Alexey Gronskiy Veselin Raychev Gishor Sivanrupan Victor Chibotaru Martin Vechev KELM 62 13 0 19 Feb 2024
CovRL: Fuzzing JavaScript Engines with Coverage-Guided Reinforcement Learning for LLM-based Mutation Jueon Eom Seyeon Jeong Taekyoung Kwon 70 7 0 19 Feb 2024
CodeArt: Better Code Models by Attention Regularization When Symbols Are Lacking Zian Su Xiangzhe Xu Ziyang Huang Zhuo Zhang Yapeng Ye Jianjun Huang Xiangyu Zhang OffRL 96 10 0 19 Feb 2024
When Dataflow Analysis Meets Large Language Models Chengpeng Wang Wuqi Zhang Zian Su Xiangzhe Xu Xiaoheng Xie Xiangyu Zhang 30 8 0 16 Feb 2024
DolphCoder: Echo-Locating Code Large Language Models with Diverse and Multi-Objective Instruction Tuning Yejie Wang Keqing He Guanting Dong Pei Wang Weihao Zeng ... Yutao Mou Mengdi Zhang Jingang Wang Xunliang Cai Weiran Xu ALM 84 11 0 14 Feb 2024
Resilient Watermarking for LLM-Generated Codes Boquan Li Mengdi Zhang Peixin Zhang Jun Sun Xingmei Wang Zijian Liu Tianzi Zhang WaLM 96 2 0 12 Feb 2024
On the Effectiveness of Machine Learning-based Call Graph Pruning: An Empirical Study A. Mir Mehdi Keshani Sebastian Proksch 45 1 0 11 Feb 2024
Text-to-Code Generation with Modality-relative Pre-training Fenia Christopoulou Guchun Zhang Gerasimos Lampouras AI4TS 111 1 0 08 Feb 2024
Studying Vulnerable Code Entities in R ZiXiao Zhao Millon Madhur Das Fatemeh H. Fard AAML 89 0 0 06 Feb 2024
Lens: A Foundation Model for Network Traffic in Cybersecurity Qineng Wang Chen Qian Xiaochang Li Ziyu Yao Huajie Shao 19 14 0 06 Feb 2024
Make Every Move Count: LLM-based High-Quality RTL Code Generation Using MCTS Matthew DeLorenzo A. B. Chowdhury Vasudev Gohil Shailja Thakur Ramesh Karri Siddharth Garg Jeyavijayan Rajendran 67 38 0 05 Feb 2024
UniTSyn: A Large-Scale Dataset Capable of Enhancing the Prowess of Large Language Models for Program Testing Yifeng He Jiabo Huang Yuyang Rong Yiwen Guo Ethan Wang Hao Chen 46 5 0 04 Feb 2024
CompeteSMoE -- Effective Training of Sparse Mixture of Experts via Competition Quang Pham Giang Do Huy Nguyen TrungTin Nguyen Chenghao Liu ... Binh T. Nguyen Savitha Ramasamy Xiaoli Li Steven C. H. Hoi Nhat Ho 68 20 0 04 Feb 2024
Code Representation Learning At Scale Dejiao Zhang W. Ahmad Ming Tan Hantian Ding Ramesh Nallapati Dan Roth Xiaofei Ma Bing Xiang OffRL 66 12 0 02 Feb 2024
COMET: Generating Commit Messages using Delta Graph Context Representation Abhinav Reddy Mandli Saurabhsingh Rajput Tushar Sharma 46 1 0 02 Feb 2024
Getting the most out of your tokenizer for pre-training and domain adaptation Gautier Dagan Gabriele Synnaeve Baptiste Rozière 136 30 0 01 Feb 2024
SymbolicAI: A framework for logic-based approaches combining generative models and solvers Marius-Constantin Dinu Claudiu Leoveanu-Condrei Markus Holzleitner Werner Zellinger Sepp Hochreiter 82 11 0 01 Feb 2024
Security and Privacy Challenges of Large Language Models: A Survey B. Das M. H. Amini Yanzhao Wu PILM ELM 130 145 0 30 Jan 2024
PPM: Automated Generation of Diverse Programming Problems for Benchmarking Code Generation Models Simin Chen Xiaoning Feng Xiao Han Cong Liu Wei Yang 86 4 0 28 Jan 2024
A Systematic Literature Review on Explainability for Machine/Deep Learning-based Software Engineering Research Sicong Cao Xiaobing Sun Ratnadira Widyasari David Lo Xiaoxue Wu ... Jiale Zhang Bin Li Wei Liu Di Wu Yixin Chen 143 8 0 26 Jan 2024
ZS4C: Zero-Shot Synthesis of Compilable Code for Incomplete Code Snippets using ChatGPT Azmain Kabir Shaowei Wang Yuan Tian Tse-Hsun Chen Chen Muhammad Asaduzzaman Wenbin Zhang 25 0 0 25 Jan 2024
DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence Daya Guo Qihao Zhu Dejian Yang Zhenda Xie Kai Dong ... Yu-Huan Wu Yiming Li Fuli Luo Yingfei Xiong W. Liang ELM 134 811 0 25 Jan 2024
Transformer-Based Models Are Not Yet Perfect At Learning to Emulate Structural Recursion Dylan Zhang Curt Tigges Zory Zhang Stella Biderman Maxim Raginsky Talia Ringer 115 12 0 23 Jan 2024
Distilling Mathematical Reasoning Capabilities into Small Language Models Xunyu Zhu Jian Li Yong Liu Can Ma Weiping Wang LRM 68 12 0 22 Jan 2024
Structured Code Representations Enable Data-Efficient Adaptation of Code Language Models Mayank Agarwal Songlin Yang Bailin Wang Yoon Kim Jie Chen 76 6 0 19 Jan 2024
When Neural Code Completion Models Size up the Situation: Attaining Cheaper and Faster Completion through Dynamic Model Inference Zhensu Sun Xiaoning Du Fu Song Shangwen Wang Li Li 62 9 0 18 Jan 2024
KADEL: Knowledge-Aware Denoising Learning for Commit Message Generation Wei Tao Yucheng Zhou Yanlin Wang Hongyu Zhang Haofen Wang Wenqiang Zhang 58 13 0 16 Jan 2024
A Novel Approach for Automatic Program Repair using Round-Trip Translation with Large Language Models Fernando Vallecillos Ruiz Anastasiia Grishina Max Hort Leon Moonen LRM 88 4 0 15 Jan 2024
Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trends Yunshi Lan Xinyuan Li Hanyue Du Xuesong Lu Ming Gao Weining Qian Aoying Zhou 95 4 0 15 Jan 2024
Your Instructions Are Not Always Helpful: Assessing the Efficacy of Instruction Fine-tuning for Software Vulnerability Detection Imam Nur Bani Yusuf Lingxiao Jiang AAML 82 3 0 15 Jan 2024
Code Security Vulnerability Repair Using Reinforcement Learning with Large Language Models Nafis Tanveer Islam Mohammad Bahrami Karkevandi Peyman Najafirad 105 8 0 13 Jan 2024
Between Lines of Code: Unraveling the Distinct Patterns of Machine and Human Programmers Yuling Shi Hongyu Zhang Chengcheng Wan Xiaodong Gu DeLMO 116 6 0 12 Jan 2024
Rewriting the Code: A Simple Method for Large Language Model Augmented Code Search Haochen Li Xin Zhou Zhiqi Shen 69 13 0 09 Jan 2024
Chain of LoRA: Efficient Fine-tuning of Language Models via Residual Learning Wenhan Xia Chengwei Qin Elad Hazan 123 61 0 08 Jan 2024
Enhanced Automated Code Vulnerability Repair using Large Language Models David de-Fitero-Dominguez Eva García-López Antonio Garcia-Cabot J. Martínez-Herráiz 57 16 0 08 Jan 2024
LLM-Powered Code Vulnerability Repair with Reinforcement Learning and Semantic Reward Nafis Tanveer Islam Joseph Khoury Andrew Seong Mohammad Bahrami Karkevandi G. Parra E. Bou-Harb Peyman Najafirad AAML 106 21 0 07 Jan 2024
AST-T5: Structure-Aware Pretraining for Code Generation and Understanding Linyuan Gong Mostafa Elhoushi Alvin Cheung 120 18 0 05 Jan 2024
Astraios: Parameter-Efficient Instruction Tuning Code Large Language Models Terry Yue Zhuo A. Zebaze Nitchakarn Suppattarachai Leandro von Werra H. D. Vries Qian Liu Niklas Muennighoff ALM 90 18 0 01 Jan 2024
Deep Learning for Code Intelligence: Survey, Benchmark and Toolkit Yao Wan Yang He Zhangqian Bi Jianguo Zhang Hongyu Zhang Yulei Sui Guandong Xu Hai Jin Philip S. Yu 97 25 0 30 Dec 2023
A Prompt Learning Framework for Source Code Summarization Weisong Sun Chunrong Fang Yudu You Yuchen Chen Yi Liu ... Quanjun Zhang Hanwei Qian Wei Zhao Yang Liu Zhenyu Chen LLMAG 81 14 0 26 Dec 2023
Towards Probing Contact Center Large Language Models Varun Nathan Ayush Kumar Digvijay Ingle Jithendra Vepa 43 0 0 26 Dec 2023
MoTCoder: Elevating Large Language Models with Modular of Thought for Challenging Programming Tasks Jingyao Li Pengguang Chen Jiaya Jia Hong Xu Jiaya Jia LRM 51 14 0 26 Dec 2023
Instruction Fusion: Advancing Prompt Evolution through Hybridization Weidong Guo Jiuding Yang Kaitong Yang Xiangyang Li Zhuwei Rao Yu-Syuan Xu Di Niu 81 6 0 25 Dec 2023
A Comprehensive Evaluation of Parameter-Efficient Fine-Tuning on Software Engineering Tasks Wentao Zou Qi Li Jidong Ge Chuanyi Li Xiaoyu Shen LiGuo Huang Bin Luo 88 6 0 25 Dec 2023
AgentCoder: Multi-Agent-based Code Generation with Iterative Testing and Optimisation Dong Huang Jie M.Zhang Michael Luck Qi Bu Yuhao Qing Heming Cui LLMAG 67 0 0 20 Dec 2023
WaveCoder: Widespread And Versatile Enhancement For Code Large Language Models By Instruction Tuning Zhaojian Yu Xin Zhang Ning Shang Yangyu Huang Can Xu Yishujie Zhao Wenxiang Hu Qiufeng Yin SyDa 122 28 0 20 Dec 2023
Xpert: Empowering Incident Management with Query Recommendations via Large Language Models Yuxuan Jiang Chaoyun Zhang Shilin He Zhihao Yang Ming-Jie Ma ... Yu Kang Yingnong Dang Saravan Rajmohan Qingwei Lin Dongmei Zhang 95 21 0 19 Dec 2023
Predicting Line-Level Defects by Capturing Code Contexts with Hierarchical Transformers Parvez Mahbub Mohammad Masudur Rahman 23 4 0 19 Dec 2023
Traces of Memorisation in Large Language Models for Code Ali Al-Kaswan Maliheh Izadi Arie van Deursen ELM 62 17 0 18 Dec 2023
kNN-ICL: Compositional Task-Oriented Parsing Generalization with Nearest Neighbor In-Context Learning Wenting Zhao Ye Liu Yao Wan Yibo Wang Qingyang Wu Zhongfen Deng Jiangshu Du Shuaiqi Liu Yunlong Xu Philip S. Yu 69 8 0 17 Dec 2023