CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation

2 September 2021

ArXiv (abs)PDF HTML Github (2999★)

Papers citing "CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation"

38 / 638 papers shown

Title
CodeAttack: Code-Based Adversarial Attacks for Pre-trained Programming Language Models Akshita Jha Chandan K. Reddy SILM ELM AAML 114 68 0 31 May 2022
HierarchyNet: Learning to Summarize Source Code with Heterogeneous Representations Minh Huynh Nguyen Nghi D. Q. Bui Truong-Son Hy Long Tran-Thanh Tien N. Nguyen 60 6 0 31 May 2022
Understanding Long Programming Languages with Structure-Aware Sparse Attention Tingting Liu Chengyu Wang Cen Chen Ming Gao Aoying Zhou 60 3 0 27 May 2022
Deep Learning Meets Software Engineering: A Survey on Pre-Trained Models of Source Code Changan Niu Chuanyi Li Bin Luo Vincent Ng SyDa VLM 102 50 0 24 May 2022
Workflow Discovery from Dialogues in the Low Data Regime Amine El Hattami Stefania Raimondo I. Laradji David Vazquez Pau Rodríguez López C. Pal 86 11 0 24 May 2022
Summarize and Generate to Back-translate: Unsupervised Translation of Programming Languages Wasi Uddin Ahmad Saikat Chakraborty Baishakhi Ray Kai-Wei Chang 90 27 0 23 May 2022
AdaptivePaste: Code Adaptation through Learning Semantics-aware Variable Usage Representations Xiaoyu Liu Jinu Jang Neel Sundaresan Miltiadis Allamanis Alexey Svyatkovskiy 66 2 0 23 May 2022
CODE-MVP: Learning to Represent Source Code from Multiple Views with Contrastive Pre-Training Xin Wang Yasheng Wang Yao Wan Jiawei Wang Pingyi Zhou Li Li Hao Wu Jin Liu 67 36 0 04 May 2022
A Survey of Deep Learning Models for Structural Code Understanding Ruoting Wu Yuxin Zhang Qibiao Peng Liang Chen Zibin Zheng 78 7 0 03 May 2022
Self-Programming Artificial Intelligence Using Code-Generating Language Models Alex Sheng Shankar Padmanabhan SyDa 27 2 0 30 Apr 2022
GypSum: Learning Hybrid Representations for Code Summarization Yu Wang Yu Dong Xuesong Lu Aoying Zhou 52 27 0 26 Apr 2022
Addressing Leakage in Self-Supervised Contextualized Code Retrieval Johannes Villmow Viola Campos A. Ulges Ulrich Schwanecke 45 3 0 17 Apr 2022
InCoder: A Generative Model for Code Infilling and Synthesis Daniel Fried Armen Aghajanyan Jessy Lin Sida I. Wang Eric Wallace Freda Shi Ruiqi Zhong Wen-tau Yih Luke Zettlemoyer M. Lewis SyDa 91 659 0 12 Apr 2022
CoCoSoDa: Effective Contrastive Learning for Code Search Ensheng Shi Yanlin Wang Wenchao Gu Lun Du Hongyu Zhang Shi Han Dongmei Zhang Hongbin Sun 102 37 0 07 Apr 2022
On the Transferability of Pre-trained Language Models for Low-Resource Programming Languages Fuxiang Chen F. Fard David Lo T. Bryksin 81 49 0 05 Apr 2022
MQDD: Pre-training of Multimodal Question Duplicity Detection for Software Engineering Domain Jan Pasek Jakub Sido Miloslav Konopík O. Pražák 42 1 0 26 Mar 2022
CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis Erik Nijkamp Bo Pang Hiroaki Hayashi Lifu Tu Haiquan Wang Yingbo Zhou Silvio Savarese Caiming Xiong ELM 173 1,054 0 25 Mar 2022
Automating Code Review Activities by Large-Scale Pre-training Zhiyu Li Shuai Lu Daya Guo Nan Duan Shailesh Jannu ... Deep Majumder Jared Green Alexey Svyatkovskiy Shengyu Fu Neel Sundaresan VLM 106 153 0 17 Mar 2022
Less is More: Summary of Long Instructions is Better for Program Synthesis Kirby Kuznia Swaroop Mishra Mihir Parmar Chitta Baral AIMat 90 25 0 16 Mar 2022
MCoNaLa: A Benchmark for Code Generation from Multiple Natural Languages Zhiruo Wang Grace Cuenca Shuyan Zhou Frank F. Xu Graham Neubig 80 51 0 16 Mar 2022
ReACC: A Retrieval-Augmented Code Completion Framework Shuai Lu Nan Duan Hojae Han Daya Guo Seung-won Hwang Alexey Svyatkovskiy 84 149 0 15 Mar 2022
Compilable Neural Code Generation with Compiler Feedback Xin Wang Yasheng Wang Yao Wan Fei Mi Yitong Li Pingyi Zhou Jin Liu Hao Wu Xin Jiang Qun Liu 78 69 0 10 Mar 2022
UniXcoder: Unified Cross-Modal Pre-training for Code Representation Daya Guo Shuai Lu Nan Duan Yanlin Wang Ming Zhou Jian Yin 96 609 0 08 Mar 2022
RACE: Retrieval-Augmented Commit Message Generation Ensheng Shi Yanlin Wang Wei Tao Lun Du Hongyu Zhang Shi Han Dongmei Zhang Hongbin Sun VLM 73 44 0 05 Mar 2022
A Systematic Evaluation of Large Language Models of Code Frank F. Xu Uri Alon Graham Neubig Vincent J. Hellendoorn ELM ALM 239 661 0 26 Feb 2022
Probing Pretrained Models of Source Code Sergey Troshin Nadezhda Chirkova ELM 105 39 0 16 Feb 2022
Investigating Explainability of Generative AI for Code through Scenario-based Design Jiao Sun Q. V. Liao Michael J. Muller Mayank Agarwal Stephanie Houde Kartik Talamadupula Justin D. Weisz 77 163 0 10 Feb 2022
A Survey on Artificial Intelligence for Source Code: A Dialogue Systems Perspective Erfan Al-Hossami Samira Shaikh 60 6 0 10 Feb 2022
CodeRetriever: Unimodal and Bimodal Contrastive Learning for Code Search Xiaonan Li Yeyun Gong Yelong Shen Xipeng Qiu Hang Zhang Bolun Yao Weizhen Qi Daxin Jiang Weizhu Chen Nan Duan OffRL 106 28 0 26 Jan 2022
GAP-Gen: Guided Automatic Python Code Generation Junchen Zhao Yurun Song Junlin Wang Ian G. Harris 60 6 0 19 Jan 2022
Unveiling Project-Specific Bias in Neural Code Models Zhiming Li Yanzhou Li Tianlin Li Mengnan Du Bozhi Wu Yushi Cao Yi Li Yang Liu 77 5 0 19 Jan 2022
GraphSearchNet: Enhancing GNNs via Capturing Global Dependencies for Semantic Code Search Shangqing Liu Xiaofei Xie J. Siow Lei Ma Guozhu Meng Yang Liu GNN 100 55 0 04 Nov 2021
Cascaded Fast and Slow Models for Efficient Semantic Code Search Akhilesh Deepak Gotmare Junnan Li Shafiq Joty Guosheng Lin 63 10 0 15 Oct 2021
Towards Learning (Dis)-Similarity of Source Code from Program Contrasts Yangruibo Ding Luca Buratti Saurabh Pujar Alessandro Morari Baishakhi Ray Saikat Chakraborty 82 36 0 08 Oct 2021
Compositional generalization in semantic parsing with pretrained transformers A. Orhan 76 6 0 30 Sep 2021
AVATAR: A Parallel Corpus for Java-Python Program Translation W. Ahmad Md Golam Rahman Tushar Saikat Chakraborty Kai-Wei Chang 84 81 0 26 Aug 2021
Impact of Evaluation Methodologies on Code Summarization Pengyu Nie Jiyang Zhang Junyi Jessy Li Raymond J. Mooney Miloš Gligorić 66 20 0 22 Aug 2021
deGraphCS: Embedding Variable-based Flow Graph for Neural Code Search Chen Zeng Yue Yu Shanshan Li Xin Xia Zhiming Wang Mingyang Geng Linxiao Bai Wei Dong Xiangke Liao GNN 64 38 0 24 Mar 2021