CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation

2 September 2021

ArXiv (abs)PDF HTML Github (2999★)

Papers citing "CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation"

50 / 638 papers shown

Title
Enhancing Few-shot Text-to-SQL Capabilities of Large Language Models: A Study on Prompt Design Strategies Linyong Nan Yilun Zhao Weijin Zou Narutatsu Ri Jaesung Tae Ellen Zhang Arman Cohan Dragomir R. Radev LMTD 84 51 0 21 May 2023
LMs: Understanding Code Syntax and Semantics for Code Analysis Wei Ma Shangqing Liu Zhihao Lin Wenhan Wang Q. Hu Ye Liu Cen Zhang Liming Nie Li Li Yang Liu 124 16 0 20 May 2023
CCT-Code: Cross-Consistency Training for Multilingual Clone Detection and Code Search Nikita Sorokin Dmitry Abulkhanov Sergey I. Nikolenko Valentin Malykh 59 3 0 19 May 2023
Towards Code Generation from BDD Test Case Specifications: A Vision Leon Chemnitz David Reichenbach Hani Aldebes Mariam Naveed Krishna Narasimhan Mira Mezini 58 3 0 19 May 2023
ProgSG: Cross-Modality Representation Learning for Programs in Electronic Design Automation Yunsheng Bai Atefeh Sohrabizadeh Zongyue Qin Ziniu Hu Yizhou Sun Jason Cong 105 1 0 18 May 2023
Think Outside the Code: Brainstorming Boosts Large Language Models in Code Generation Xinyu Li Jiang-Tian Xue Zheng Xie Ming Li LRM 81 28 0 18 May 2023
Towards Generalist Robots: A Promising Paradigm via Generative Simulation Zhou Xian Théophile Gervet Zhenjia Xu Yi-Ling Qiao Tsun-Hsuan Wang Yian Wang LM&Ro 91 9 0 17 May 2023
CodeT5+: Open Code Large Language Models for Code Understanding and Generation Yue Wang Hung Le Akhilesh Deepak Gotmare Nghi D. Q. Bui Junnan Li Steven C. H. Hoi ALM 117 502 0 13 May 2023
A Black-Box Attack on Code Models via Representation Nearest Neighbor Search Jie M. Zhang Wei Ma Q. Hu Shangqing Liu Xiaofei Xie Yves Le Traon Yang Liu AAML 65 7 0 10 May 2023
CodeIE: Large Code Generation Models are Better Few-Shot Information Extractors Peng Li Tianxiang Sun Qiong Tang Hang Yan Yuanbin Wu Xuanjing Huang Technology SyDa 80 77 0 09 May 2023
The Vault: A Comprehensive Multilingual Dataset for Advancing Code Understanding and Generation Dũng Nguyễn Mạnh Nam Le Hai An Dau A. Nguyen Khanh N. Nghiem Jingnan Guo Nghi D. Q. Bui 94 18 0 09 May 2023
StarCoder: may the source be with you! Raymond Li Loubna Ben Allal Yangtian Zi Niklas Muennighoff Denis Kocetkov ... Sean M. Hughes Thomas Wolf Arjun Guha Leandro von Werra H. D. Vries 146 792 0 09 May 2023
ComputeGPT: A computational chat model for numerical problems Ryan H. Lewis Junfeng Jiao 27 2 0 08 May 2023
The EarlyBIRD Catches the Bug: On Exploiting Early Layers of Encoder Models for More Efficient Code Classification Anastasiia Grishina Max Hort Leon Moonen 50 6 0 08 May 2023
Code Execution with Pre-trained Language Models Chenxiao Liu Shuai Lu Weizhu Chen Daxin Jiang Alexey Svyatkovskiy Shengyu Fu Neel Sundaresan Nan Duan ELM 112 26 0 08 May 2023
On the Usage of Continual Learning for Out-of-Distribution Generalization in Pre-trained Language Models of Code Martin Weyssow Xin Zhou Kisub Kim David Lo H. Sahraoui CLL KELM 122 11 0 06 May 2023
TASTY: A Transformer based Approach to Space and Time complexity K. Moudgalya Ankit Ramakrishnan Vamsikrishna Chemudupati Xinghai Lu 54 3 0 06 May 2023
Automated Code generation for Information Technology Tasks in YAML through Large Language Models Saurabh Pujar Luca Buratti Xiaojie Guo Nicolas Dupuis B. Lewis ... Atin Sood Ganesh Nalawade Matt Jones Alessandro Morari Ruchi Puri 84 4 0 02 May 2023
Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Jiawei Liu Chun Xia Yuyao Wang Lingming Zhang ELM ALM 283 962 0 02 May 2023
Using Large Language Models to Generate JUnit Tests: An Empirical Study Mohammed Latif Siddiq Joanna C. S. Santos Ridwanul Hasan Tanvir Noshin Ulfat Fahmid Al Rifat Vinicius Carvalho Lopes ELM 114 63 0 30 Apr 2023
Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation Wenqing Zheng S. Sharan Ajay Jaiswal Kevin Wang Yihan Xi Dejia Xu Zhangyang Wang 135 27 0 28 Apr 2023
A Deep Learning Framework for Verilog Autocompletion Towards Design and Verification Automation Enrique Dehaerne Bappaditya Dey S. Halder S. de Gendt 115 10 0 26 Apr 2023
Neuro-symbolic Zero-Shot Code Cloning with Cross-Language Intermediate Representation Krishnam Hasija Shrishti Pradhan Manasi Patwardhan Raveendra Kumar Medicherla Lovekesh Vig Ravindra Naik 49 2 0 26 Apr 2023
Enriching Source Code with Contextual Data for Code Completion Models: An Empirical Study Tim van Dam Maliheh Izadi Arie van Deursen 44 15 0 24 Apr 2023
CodeKGC: Code Language Model for Generative Knowledge Graph Construction Zhen Bi Jing Chen Yinuo Jiang Feiyu Xiong Wei Guo Huajun Chen Ningyu Zhang 68 42 0 18 Apr 2023
Enhancing Automated Program Repair through Fine-tuning and Prompt Engineering Rishov Paul Md. Mohib Hossain Mohammed Latif Siddiq Masum Hasan Anindya Iqbal Joanna C. S. Santos KELM 77 12 0 16 Apr 2023
Automatic Semantic Augmentation of Language Model Prompts (for Code Summarization) Toufique Ahmed Kunal Suresh Pai Prem Devanbu Earl T. Barr LRM 88 121 0 13 Apr 2023
Towards Efficient Fine-tuning of Pre-trained Code Models: An Experimental Study and Beyond Ensheng Shi Yanlin Wang Hongyu Zhang Lun Du Shi Han Dongmei Zhang Hongbin Sun 89 43 0 11 Apr 2023
RunBugRun -- An Executable Dataset for Automated Program Repair Julian Aron Prenner Romain Robbes 57 11 0 03 Apr 2023
Better Language Models of Code through Self-Improvement H. To Nghi D. Q. Bui Jingnan Guo Tien N Nguyen SyDa 94 15 0 02 Apr 2023
DiverseVul: A New Vulnerable Source Code Dataset for Deep Learning Based Vulnerability Detection Yizheng Chen Zhoujie Ding Lamya Alowain Xinyun Chen David Wagner AAML 111 157 0 01 Apr 2023
Keep the Conversation Going: Fixing 162 out of 337 bugs for $0.42 each using ChatGPT$ Chun Xia Lingming Zhang KELM LRM 118 121 0 01 Apr 2023
AceCoder: Utilizing Existing Code to Enhance Code Generation Jia Li Yunfei Zhao Yongming Li Ge Li Zhi Jin 66 28 0 31 Mar 2023
CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-X Qinkai Zheng Xiao Xia Xu Zou Yuxiao Dong Shanshan Wang ... Andi Wang Yang Li Teng Su Zhilin Yang Jie Tang ELM ALM SyDa 150 346 0 30 Mar 2023
BloombergGPT: A Large Language Model for Finance Shijie Wu Ozan Irsoy Steven Lu Vadim Dabravolski Mark Dredze Sebastian Gehrmann P. Kambadur David S. Rosenberg Gideon Mann AIFin 246 853 0 30 Mar 2023
Synthesis of Mathematical programs from Natural Language Specifications G. Prasath Shirish S. Karande 77 9 0 30 Mar 2023
On Codex Prompt Engineering for OCL Generation: An Empirical Study Seif Abukhalaf Mohammad Hamdaqa Foutse Khomh 71 23 0 28 Mar 2023
Improving Code Generation by Training with Natural Language Feedback Angelica Chen Jérémy Scheurer Tomasz Korbak Jon Ander Campos Jun Shern Chan Samuel R. Bowman Kyunghyun Cho Ethan Perez SyDa ALM AI4CE 92 78 0 28 Mar 2023
One Adapter for All Programming Languages? Adapter Tuning for Code Search and Summarization Deze Wang Boxing Chen Shanshan Li Wei Luo Shaoliang Peng Wei Dong Xiang-ke Liao 53 41 0 28 Mar 2023
Errors are Useful Prompts: Instruction Guided Task Programming with Verifier-Assisted Iterative Prompting Marta Skreta Naruki Yoshikawa Sebastian Arellano-Rubach Zhi Ji L. B. Kristensen Kourosh Darvish Alán Aspuru-Guzik Florian Shkurti Animesh Garg 131 58 0 24 Mar 2023
Large Language Models and Simple, Stupid Bugs Kevin Jesse Toufique Ahmed Prem Devanbu Emily Morgan ELM 96 56 0 20 Mar 2023
Retrieving Multimodal Information for Augmented Generation: A Survey Ruochen Zhao Hailin Chen Weishi Wang Fangkai Jiao Do Xuan Long ... Bosheng Ding Xiaobao Guo Minzhi Li Xingxuan Li Shafiq Joty 121 88 0 20 Mar 2023
Revisiting the Plastic Surgery Hypothesis via Large Language Models Chun Xia Yifeng Ding Lingming Zhang 75 12 0 18 Mar 2023
TypeT5: Seq2seq Type Inference using Static Analysis Jiayi Wei Greg Durrett Işıl Dillig 78 20 0 16 Mar 2023
Exploring Distributional Shifts in Large Language Models for Code Analysis Shushan Arakelyan Rocktim Jyoti Das Yi Mao Xiang Ren ALM 105 21 0 16 Mar 2023
Knowledge Transfer for Pseudo-code Generation from Low Resource Programming Language Ankita Sontakke Kanika Kalra Manasi Patwardhan Lovekesh Vig Raveendra Kumar Medicherla Ravindra Naik Shrishti Pradhan 38 2 0 16 Mar 2023
NeuroQL: A Neuro-Symbolic Language and Dataset for Inter-Subjective Reasoning Nick Papoulias LRM NAI 68 1 0 13 Mar 2023
Transformer-based Planning for Symbolic Regression Parshin Shojaee Kazem Meidani A. Farimani Chandan K. Reddy 96 46 0 13 Mar 2023
Planning with Large Language Models for Code Generation Shun Zhang Zhenfang Chen Songlin Yang Mingyu Ding J. Tenenbaum Chuang Gan 103 163 0 09 Mar 2023
Greener yet Powerful: Taming Large Code Generation Models with Quantization Xiaokai Wei Sujan Kumar Gonugondla W. Ahmad Shiqi Wang Baishakhi Ray ... Ben Athiwaratkun Mingyue Shang M. K. Ramanathan Parminder Bhatia Bing Xiang MQ 57 6 0 09 Mar 2023