CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation

2 September 2021

Papers citing "CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation"

50 / 610 papers shown

Title
CoditT5: Pretraining for Source Code and Natural Language Editing Jiyang Zhang Sheena Panthaplackel Pengyu Nie Junyi Jessy Li Miloš Gligorić KELM 17 88 0 10 Aug 2022
Multi-View Pre-Trained Model for Code Vulnerability Identification Xuxia Jiang Yinhao Xiao Jun Wang Wei Zhang 35 1 0 10 Aug 2022
CSSAM:Code Search via Attention Matching of Code Semantics and Structures Y. Hu Bowen Cai Yaoxiang Yu 15 3 0 08 Aug 2022
No More Fine-Tuning? An Experimental Evaluation of Prompt Tuning in Code Intelligence Chaozheng Wang Yuanhang Yang Cuiyun Gao Yun Peng Hongyu Zhang Michael R. Lyu AAML 59 134 0 24 Jul 2022
PanGu-Coder: Program Synthesis with Function-Level Language Modeling Fenia Christopoulou Gerasimos Lampouras Milan Gritta Guchun Zhang Yinpeng Guo ... Guangtai Liang Jia Wei Xin Jiang Qianxiang Wang Qun Liu ELM SyDa ALM 32 74 0 22 Jul 2022
Probing Semantic Grounding in Language Models of Code with Representational Similarity Analysis Shounak Naik Rajaswa Patil Swati Agarwal V. Baths 17 3 0 15 Jul 2022
DocPrompting: Generating Code by Retrieving the Docs Shuyan Zhou Uri Alon Frank F. Xu Zhiruo Wang Zhengbao Jiang Graham Neubig LLMAG 22 129 0 13 Jul 2022
Few-shot training LLMs for project-specific code-summarization Toufique Ahmed Prem Devanbu 179 213 0 09 Jul 2022
CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning Hung Le Yue Wang Akhilesh Deepak Gotmare Silvio Savarese S. Hoi SyDa ALM 126 237 0 05 Jul 2022
Repository-Level Prompt Generation for Large Language Models of Code Disha Shrivastava Hugo Larochelle Daniel Tarlow 15 137 0 26 Jun 2022
AST-Probe: Recovering abstract syntax trees from hidden representations of pre-trained language models José Antonio Hernández López M. Weyssow Jesús Sánchez Cuadrado H. Sahraoui 25 22 0 23 Jun 2022
BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic Parsing Subhro Roy Sam Thomson Tongfei Chen Richard Shin Adam Pauls Jason Eisner Benjamin Van Durme ALM 28 12 0 21 Jun 2022
XLCoST: A Benchmark Dataset for Cross-lingual Code Intelligence Ming Zhu Aneesh Jain Karthik Suresh Roshan Ravindran Sindhu Tipirneni Chandan K. Reddy 27 69 0 16 Jun 2022
FixEval: Execution-based Evaluation of Program Fixes for Programming Problems Md. Mahim Anjum Haque W. Ahmad Ismini Lourentzou Chris Brown 21 15 0 15 Jun 2022
NatGen: Generative pre-training by "Naturalizing" source code Saikat Chakraborty Toufique Ahmed Yangruibo Ding Prem Devanbu Baishakhi Ray AI4CE 48 116 0 15 Jun 2022
An Extractive-and-Abstractive Framework for Source Code Summarization Weisong Sun Chunrong Fang Yuchen Chen Quanjun Zhang Guanhong Tao Tingxu Han Yifei Ge Yudu You Bin Luo 21 29 0 15 Jun 2022
CERT: Continual Pre-Training on Sketches for Library-Oriented Code Generation Daoguang Zan Bei Chen Dejian Yang Zeqi Lin Minsu Kim Bei Guan Yongji Wang Weizhu Chen Jian-Guang Lou 14 120 0 14 Jun 2022
StructCoder: Structure-Aware Transformer for Code Generation Sindhu Tipirneni Ming Zhu Chandan K. Reddy 28 55 0 10 Jun 2022
Assessing Project-Level Fine-Tuning of ML4SE Models Egor Bogomolov Sergey Zhuravlev Egor Spirin T. Bryksin 27 5 0 07 Jun 2022
Fault-Aware Neural Code Rankers J. Inala Chenglong Wang Mei Yang Andrés Codas Mark Encarnación Shuvendu K. Lahiri Madan Musuvathi Jianfeng Gao ALM 19 41 0 04 Jun 2022
Learning code summarization from a small and local dataset Toufique Ahmed Prem Devanbu 35 9 0 02 Jun 2022
CodeAttack: Code-Based Adversarial Attacks for Pre-trained Programming Language Models Akshita Jha Chandan K. Reddy SILM ELM AAML 25 58 0 31 May 2022
HierarchyNet: Learning to Summarize Source Code with Heterogeneous Representations Minh Huynh Nguyen Nghi D. Q. Bui Truong Son-Hy Long Tran-Thanh Tien N. Nguyen 32 4 0 31 May 2022
Understanding Long Programming Languages with Structure-Aware Sparse Attention Tingting Liu Chengyu Wang Cen Chen Ming Gao Aoying Zhou 25 3 0 27 May 2022
Deep Learning Meets Software Engineering: A Survey on Pre-Trained Models of Source Code Changan Niu Chuanyi Li Bin Luo Vincent Ng SyDa VLM 47 48 0 24 May 2022
Workflow Discovery from Dialogues in the Low Data Regime Amine El Hattami Stefania Raimondo I. Laradji David Vazquez Pau Rodríguez López C. Pal 47 10 0 24 May 2022
Summarize and Generate to Back-translate: Unsupervised Translation of Programming Languages Wasi Uddin Ahmad Saikat Chakraborty Baishakhi Ray Kai-Wei Chang 36 27 0 23 May 2022
AdaptivePaste: Code Adaptation through Learning Semantics-aware Variable Usage Representations Xiaoyu Liu Jinu Jang Neel Sundaresan Miltiadis Allamanis Alexey Svyatkovskiy 8 2 0 23 May 2022
CODE-MVP: Learning to Represent Source Code from Multiple Views with Contrastive Pre-Training Xin Wang Yasheng Wang Yao Wan Jiawei Wang Pingyi Zhou Li Li Hao Wu Jin Liu 19 33 0 04 May 2022
A Survey of Deep Learning Models for Structural Code Understanding Ruoting Wu Yu-xin Zhang Qibiao Peng Liang Chen Zibin Zheng 14 6 0 03 May 2022
Self-Programming Artificial Intelligence Using Code-Generating Language Models Alex Sheng Shankar Padmanabhan SyDa 9 2 0 30 Apr 2022
GypSum: Learning Hybrid Representations for Code Summarization Yu Wang Yu Dong Xuesong Lu Aoying Zhou 14 22 0 26 Apr 2022
Addressing Leakage in Self-Supervised Contextualized Code Retrieval Johannes Villmow Viola Campos A. Ulges Ulrich Schwanecke 19 3 0 17 Apr 2022
InCoder: A Generative Model for Code Infilling and Synthesis Daniel Fried Armen Aghajanyan Jessy Lin Sida I. Wang Eric Wallace Freda Shi Ruiqi Zhong Wen-tau Yih Luke Zettlemoyer M. Lewis SyDa 22 625 0 12 Apr 2022
CoCoSoDa: Effective Contrastive Learning for Code Search Ensheng Shi Yanlin Wang Wenchao Gu Lun Du Hongyu Zhang Shi Han Dongmei Zhang Hongbin Sun 28 33 0 07 Apr 2022
On the Transferability of Pre-trained Language Models for Low-Resource Programming Languages Fuxiang Chen F. Fard David Lo T. Bryksin 26 44 0 05 Apr 2022
MQDD: Pre-training of Multimodal Question Duplicity Detection for Software Engineering Domain Jan Pasek Jakub Sido Miloslav Konopík O. Pražák 11 1 0 26 Mar 2022
CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis Erik Nijkamp Bo Pang Hiroaki Hayashi Lifu Tu Haiquan Wang Yingbo Zhou Silvio Savarese Caiming Xiong ELM 54 968 0 25 Mar 2022
Automating Code Review Activities by Large-Scale Pre-training Zhiyu Li Shuai Lu Daya Guo Nan Duan Shailesh Jannu ... Deep Majumder Jared Green Alexey Svyatkovskiy Shengyu Fu Neel Sundaresan VLM 18 139 0 17 Mar 2022
Less is More: Summary of Long Instructions is Better for Program Synthesis Kirby Kuznia Swaroop Mishra Mihir Parmar Chitta Baral AIMat 25 22 0 16 Mar 2022
MCoNaLa: A Benchmark for Code Generation from Multiple Natural Languages Zhiruo Wang Grace Cuenca Shuyan Zhou Frank F. Xu Graham Neubig 19 49 0 16 Mar 2022
ReACC: A Retrieval-Augmented Code Completion Framework Shuai Lu Nan Duan Hojae Han Daya Guo Seung-won Hwang Alexey Svyatkovskiy 22 139 0 15 Mar 2022
Compilable Neural Code Generation with Compiler Feedback Xin Wang Yasheng Wang Yao Wan Fei Mi Yitong Li Pingyi Zhou Jin Liu Hao Wu Xin Jiang Qun Liu 23 65 0 10 Mar 2022
UniXcoder: Unified Cross-Modal Pre-training for Code Representation Daya Guo Shuai Lu Nan Duan Yanlin Wang Ming Zhou Jian Yin 12 559 0 08 Mar 2022
RACE: Retrieval-Augmented Commit Message Generation Ensheng Shi Yanlin Wang Wei Tao Lun Du Hongyu Zhang Shi Han Dongmei Zhang Hongbin Sun VLM 11 41 0 05 Mar 2022
A Systematic Evaluation of Large Language Models of Code Frank F. Xu Uri Alon Graham Neubig Vincent J. Hellendoorn ELM ALM 202 631 0 26 Feb 2022
Probing Pretrained Models of Source Code Sergey Troshin Nadezhda Chirkova ELM 25 38 0 16 Feb 2022
Investigating Explainability of Generative AI for Code through Scenario-based Design Jiao Sun Q. V. Liao Michael J. Muller Mayank Agarwal Stephanie Houde Kartik Talamadupula Justin D. Weisz 31 157 0 10 Feb 2022
A Survey on Artificial Intelligence for Source Code: A Dialogue Systems Perspective Erfan Al-Hossami Samira Shaikh 24 6 0 10 Feb 2022
CodeRetriever: Unimodal and Bimodal Contrastive Learning for Code Search Xiaonan Li Yeyun Gong Yelong Shen Xipeng Qiu Hang Zhang Bolun Yao Weizhen Qi Daxin Jiang Weizhu Chen Nan Duan OffRL 24 27 0 26 Jan 2022