CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation

2 September 2021

Papers citing "CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation"

50 / 613 papers shown

Title
CodeMark: Imperceptible Watermarking for Code Datasets against Neural Code Completion Models Zhensu Sun Xiaoning Du Fu Song Li Li 30 30 0 28 Aug 2023
Large Language Models Should Ask Clarifying Questions to Increase Confidence in Generated Code Jiexi Wu 28 3 0 25 Aug 2023
On the Impact of Language Selection for Training and Evaluating Programming Language Models Jonathan Katzy Maliheh Izadi Arie van Deursen 53 6 0 25 Aug 2023
Code Llama: Open Foundation Models for Code Baptiste Rozière Jonas Gehring Fabian Gloeckle Sten Sootla Itai Gat ... Hugo Touvron Louis Martin Nicolas Usunier Thomas Scialom Gabriel Synnaeve ELM ALM 63 1,924 0 24 Aug 2023
SayCanPay: Heuristic Planning with Large Language Models using Learnable Domain Knowledge Rishi Hazra Pedro Zuidberg Dos Martires Luc de Raedt LM&Ro LLMAG 18 32 0 24 Aug 2023
Prompt2Model: Generating Deployable Models from Natural Language Instructions Vijay Viswanathan Chenyang Zhao Amanda Bertsch Tongshuang Wu Graham Neubig 33 36 0 23 Aug 2023
LLaMA-Reviewer: Advancing Code Review Automation with Large Language Models through Parameter-Efficient Fine-Tuning Jun Lu Lei Yu Xiaojia Li Li Yang Chun Zuo ALM 27 73 0 22 Aug 2023
DataVinci: Learning Syntactic and Semantic String Repairs Mukul Singh J. Cambronero Sumit Gulwani Vu Le Carina Negreanu Gust Verbruggen NAI 24 3 0 21 Aug 2023
Large Language Models for Software Engineering: A Systematic Literature Review Xinying Hou Yanjie Zhao Yue Liu Zhou Yang Kailong Wang Li Li Xiapu Luo David Lo John C. Grundy Haoyu Wang 39 332 0 21 Aug 2023
Exploring Parameter-Efficient Fine-Tuning Techniques for Code Generation with Large Language Models Martin Weyssow Xin Zhou Kisub Kim David Lo H. Sahraoui 40 27 0 21 Aug 2023
Towards Automatically Addressing Self-Admitted Technical Debt: How Far Are We? A. Mastropaolo M. D. Penta Gabriele Bavota 36 7 0 17 Aug 2023
Correct and Optimal: the Regular Expression Inference Challenge Mojtaba Valizadeh P. Gorinski Ignacio Iacobacci Martin Berger 8 0 0 15 Aug 2023
From Commit Message Generation to History-Aware Commit Message Completion Aleksandra V. Eliseeva Yaroslav Sokolov Egor Bogomolov Yaroslav Golubev Danny Dig T. Bryksin 33 20 0 15 Aug 2023
A Survey on Model Compression for Large Language Models Xunyu Zhu Jian Li Yong Liu Can Ma Weiping Wang 36 193 0 15 Aug 2023
Data Race Detection Using Large Language Models Le Chen Xianzhong Ding M. Emani T. Vanderbruggen Pei-Hung Lin Chunhua Liao 27 17 0 15 Aug 2023
Semantic Similarity Loss for Neural Source Code Summarization Chia-Yi Su Collin McMillan 35 4 0 14 Aug 2023
Fuzz4All: Universal Fuzzing with Large Language Models Chun Xia Matteo Paltenghi Jia Le Tian Michael Pradel Lingming Zhang ELM 18 104 0 09 Aug 2023
Evaluating and Explaining Large Language Models for Code Using Syntactic Structures David Nader-Palacio Alejandro Velasco Daniel Rodríguez-Cárdenas Kevin Moran Denys Poshyvanyk 34 8 0 07 Aug 2023
Exploiting Code Symmetries for Learning Program Semantics Kexin Pei Weichen Li Qirui Jin Shuyang Liu Scott Geng Lorenzo Cavallaro Junfeng Yang Suman Jana 41 4 0 07 Aug 2023
LARCH: Large Language Model-based Automatic Readme Creation with Heuristics Yuta Koreeda Terufumi Morishita Osamu Imaichi Yasuhiro Sogawa VLM 37 2 0 06 Aug 2023
An Empirical Study of AI-based Smart Contract Creation Rabimba Karanjai Edward Li Lei Xu W. Shi 22 10 0 05 Aug 2023
Evaluating Instruction-Tuned Large Language Models on Code Comprehension and Generation Zhiqiang Yuan Junwei Liu Qiancheng Zi Mingwei Liu Xin Peng Yiling Lou ALM ELM LRM 22 74 0 02 Aug 2023
CodeBPE: Investigating Subtokenization Options for Large Language Model Pretraining on Source Code Nadezhda Chirkova Sergey Troshin 23 8 0 01 Aug 2023
Multilingual Code Co-Evolution Using Large Language Models Jiyang Zhang Pengyu Nie Junyi Jessy Li Miloš Gligorić 39 20 0 27 Jul 2023
CodeLens: An Interactive Tool for Visualizing Code Representations Yuejun Guo Seifeddine Bettaieb Qiang Hu Yves Le Traon Qian Tang 27 0 0 27 Jul 2023
A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesis Izzeddin Gur Hiroki Furuta Austin Huang Mustafa Safdari Yutaka Matsuo Douglas Eck Aleksandra Faust LM&Ro LLMAG 39 201 0 24 Jul 2023
A Lightweight Framework for High-Quality Code Generation Mohammed Latif Siddiq B.K. Casey Joanna C. S. Santos 44 17 0 17 Jul 2023
Look Before You Leap: An Exploratory Study of Uncertainty Measurement for Large Language Models Yuheng Huang Jiayang Song Zhijie Wang Shengming Zhao Huaming Chen Felix Juefei-Xu Lei Ma 33 6 0 16 Jul 2023
A Comprehensive Overview of Large Language Models Humza Naveed Asad Ullah Khan Shi Qiu Muhammad Saqib Saeed Anwar Muhammad Usman Naveed Akhtar Nick Barnes Ajmal Mian OffRL 70 538 0 12 Jul 2023
Entity Identifier: A Natural Text Parsing-based Framework For Entity Relation Extraction El Mehdi Chouham Jessica Nayeli López Espejel Mahaman Sanoussi Yahaya Alassan Walid Dahhane E. Ettifouri 32 1 0 10 Jul 2023
RLTF: Reinforcement Learning from Unit Test Feedback Jiate Liu Yiqin Zhu Kaiwen Xiao Qiang Fu Xiao Han Wei Yang Deheng Ye OffRL 55 56 0 10 Jul 2023
A Survey on Evaluation of Large Language Models Yu-Chu Chang Xu Wang Jindong Wang Yuanyi Wu Linyi Yang ... Yue Zhang Yi-Ju Chang Philip S. Yu Qian Yang Xingxu Xie ELM LM&MA ALM 75 1,529 0 06 Jul 2023
Several categories of Large Language Models (LLMs): A Short Survey Saurabh Pahune Manoj Chandrasekharan AILaw 25 14 0 05 Jul 2023
An Exploratory Literature Study on Sharing and Energy Use of Language Models for Source Code Max Hort Anastasiia Grishina Leon Moonen 18 2 0 05 Jul 2023
Exploring Continual Learning for Code Generation Models Prateek Yadav Q. Sun Hantian Ding Xiaopeng Li Dejiao Zhang ... Parminder Bhatia Ramesh Nallapati M. K. Ramanathan Joey Tianyi Zhou Bing Xiang CLL 37 30 0 05 Jul 2023
Natural Language Generation and Understanding of Big Code for AI-Assisted Programming: A Review M. Wong Shangxin Guo Ching Nam Hang Siu-Wai Ho C. Tan 44 78 0 04 Jul 2023
Constructing Multilingual Code Search Dataset Using Neural Machine Translation Ryo Sekizawa Nan Duan Shuai Lu Hitomi Yanaka 21 2 0 27 Jun 2023
LM4HPC: Towards Effective Language Model Application in High-Performance Computing Le Chen Pei-Hung Lin T. Vanderbruggen C. Liao M. Emani B. D. Supinski 41 25 0 26 Jun 2023
InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedback John Yang Akshara Prabhakar Karthik Narasimhan Shunyu Yao 33 104 0 26 Jun 2023
Exploring the Robustness of Large Language Models for Solving Programming Problems Atsushi Shirafuji Yutaka Watanobe Takumi Ito Makoto Morishita Yuki Nakamura Yusuke Oda Jun Suzuki ELM 41 19 0 26 Jun 2023
RepoFusion: Training Code Models to Understand Your Repository Disha Shrivastava Denis Kocetkov H. D. Vries Dzmitry Bahdanau Torsten Scholak 89 28 0 19 Jun 2023
Guiding Language Models of Code with Global Context using Monitors Lakshya A Agrawal Aditya Kanade Navin Goyal Shuvendu K. Lahiri S. Rajamani 40 23 0 19 Jun 2023
WizardCoder: Empowering Code Large Language Models with Evol-Instruct Ziyang Luo Can Xu Pu Zhao Qingfeng Sun Xiubo Geng Wenxiang Hu Chongyang Tao Jing Ma Qingwei Lin Daxin Jiang SyDa ALM ELM 34 645 0 14 Jun 2023
Multi-target Backdoor Attacks for Code Pre-trained Models Yanzhou Li Shangqing Liu Kangjie Chen Xiaofei Xie Tianwei Zhang Yang Liu AAML SILM 25 23 0 14 Jun 2023
CoTran: An LLM-based Code Translator using Reinforcement Learning with Feedback from Compiler and Symbolic Execution Prithwish Jana Piyush Jha Haoyang Ju Gautham Kishore Aryan Mahajan Vijay Ganesh 32 13 0 11 Jun 2023
ARIST: An Effective API Argument Recommendation Approach Son Nguyen C. T. Manh T. Tran Tan M. Nguyen Thu-Trang Nguyen Kien-Tuan Ngo H. Vo 11 13 0 11 Jun 2023
A Comprehensive Review of State-of-The-Art Methods for Java Code Generation from Natural Language Text Jessica Nayeli López Espejel Mahaman Sanoussi Yahaya Alassan El Mehdi Chouham Walid Dahhane E. Ettifouri 28 13 0 10 Jun 2023
Large Language Models of Code Fail at Completing Code with Potential Bugs Tuan Dinh Jinman Zhao Samson Tan Renato M. P. Negrinho Leonard Lausen Sheng Zha George Karypis LRM 40 25 0 06 Jun 2023
A Static Evaluation of Code Completion by Large Language Models Hantian Ding Varun Kumar Yuchen Tian Zijian Wang Robert Kwiatkowski ... Baishakhi Ray Parminder Bhatia Sudipta Sengupta Dan Roth Bing Xiang ELM ALM 35 14 0 05 Jun 2023
SelfEvolve: A Code Evolution Framework via Large Language Models Shuyang Jiang Yuhao Wang Yu Wang 24 32 0 05 Jun 2023