Unified Pre-training for Program Understanding and Generation

10 March 2021

Papers citing "Unified Pre-training for Program Understanding and Generation"

50 / 316 papers shown

Title
StructCoder: Structure-Aware Transformer for Code Generation Sindhu Tipirneni Ming Zhu Chandan K. Reddy 30 55 0 10 Jun 2022
Fault-Aware Neural Code Rankers J. Inala Chenglong Wang Mei Yang Andrés Codas Mark Encarnación Shuvendu K. Lahiri Madan Musuvathi Jianfeng Gao ALM 19 42 0 04 Jun 2022
Code Generation Tools (Almost) for Free? A Study of Few-Shot, Pre-Trained Language Models on Code Patrick Bareiss Beatriz Souza Marcelo d’Amorim Michael Pradel ELM 16 76 0 02 Jun 2022
Learning code summarization from a small and local dataset Toufique Ahmed Prem Devanbu 51 9 0 02 Jun 2022
CodeAttack: Code-Based Adversarial Attacks for Pre-trained Programming Language Models Akshita Jha Chandan K. Reddy SILM ELM AAML 30 59 0 31 May 2022
HierarchyNet: Learning to Summarize Source Code with Heterogeneous Representations Minh Huynh Nguyen Nghi D. Q. Bui Truong-Son Hy Long Tran-Thanh Tien N. Nguyen 37 4 0 31 May 2022
Understanding Long Programming Languages with Structure-Aware Sparse Attention Tingting Liu Chengyu Wang Cen Chen Ming Gao Aoying Zhou 32 3 0 27 May 2022
VulBERTa: Simplified Source Code Pre-Training for Vulnerability Detection Hazim Hanif S. Maffeis 66 95 0 25 May 2022
Deep Learning Meets Software Engineering: A Survey on Pre-Trained Models of Source Code Changan Niu Chuanyi Li Bin Luo Vincent Ng SyDa VLM 55 47 0 24 May 2022
Summarize and Generate to Back-translate: Unsupervised Translation of Programming Languages Wasi Uddin Ahmad Saikat Chakraborty Baishakhi Ray Kai-Wei Chang 47 27 0 23 May 2022
A Neural Network Architecture for Program Understanding Inspired by Human Behaviors Renyu Zhu Lei Yuan Xiang Li Ming Gao Wenyuan Cai 29 8 0 10 May 2022
CODE-MVP: Learning to Represent Source Code from Multiple Views with Contrastive Pre-Training Xin Wang Yasheng Wang Yao Wan Jiawei Wang Pingyi Zhou Li Li Hao Wu Jin Liu 26 33 0 04 May 2022
Addressing Leakage in Self-Supervised Contextualized Code Retrieval Johannes Villmow Viola Campos A. Ulges Ulrich Schwanecke 30 3 0 17 Apr 2022
Fix Bugs with Transformer through a Neural-Symbolic Edit Grammar Yaojie Hu Xingjian Shi Qiang Zhou Lee Pike KELM 16 13 0 13 Apr 2022
InCoder: A Generative Model for Code Infilling and Synthesis Daniel Fried Armen Aghajanyan Jessy Lin Sida I. Wang Eric Wallace Freda Shi Ruiqi Zhong Wen-tau Yih Luke Zettlemoyer M. Lewis SyDa 30 627 0 12 Apr 2022
CoCoSoDa: Effective Contrastive Learning for Code Search Ensheng Shi Yanlin Wang Wenchao Gu Lun Du Hongyu Zhang Shi Han Dongmei Zhang Hongbin Sun 41 33 0 07 Apr 2022
Transformer-Based Language Models for Software Vulnerability Detection Chandra Thapa Seung Ick Jang Muhammad Ejaz Ahmed S. Çamtepe J. Pieprzyk Surya Nepal 36 96 0 07 Apr 2022
On the Transferability of Pre-trained Language Models for Low-Resource Programming Languages Fuxiang Chen F. Fard David Lo T. Bryksin 28 44 0 05 Apr 2022
On the Effectiveness of Pretrained Models for API Learning M. Hadi Imam Nur Bani Yusuf Ferdian Thung K. Luong Jiang Lingxiao Fatemeh H. Fard David Lo 28 13 0 05 Apr 2022
Automating Code Review Activities by Large-Scale Pre-training Zhiyu Li Shuai Lu Daya Guo Nan Duan Shailesh Jannu ... Deep Majumder Jared Green Alexey Svyatkovskiy Shengyu Fu Neel Sundaresan VLM 23 138 0 17 Mar 2022
ReACC: A Retrieval-Augmented Code Completion Framework Shuai Lu Nan Duan Hojae Han Daya Guo Seung-won Hwang Alexey Svyatkovskiy 25 139 0 15 Mar 2022
LineVD: Statement-level Vulnerability Detection using Graph Neural Networks David Hin Andrey Kan Huaming Chen M. Babar 31 158 0 10 Mar 2022
Compilable Neural Code Generation with Compiler Feedback Xin Wang Yasheng Wang Yao Wan Fei Mi Yitong Li Pingyi Zhou Jin Liu Hao Wu Xin Jiang Qun Liu 28 66 0 10 Mar 2022
UniXcoder: Unified Cross-Modal Pre-training for Code Representation Daya Guo Shuai Lu Nan Duan Yanlin Wang Ming Zhou Jian Yin 23 559 0 08 Mar 2022
Recent Advances in Neural Text Generation: A Task-Agnostic Survey Chen Tang Frank Guerin Chenghua Lin AI4CE OOD 28 19 0 06 Mar 2022
A Systematic Evaluation of Large Language Models of Code Frank F. Xu Uri Alon Graham Neubig Vincent J. Hellendoorn ELM ALM 204 631 0 26 Feb 2022
Probing Pretrained Models of Source Code Sergey Troshin Nadezhda Chirkova ELM 27 38 0 16 Feb 2022
Better Together? An Evaluation of AI-Supported Code Translation Justin D. Weisz Michael J. Muller Steven I. Ross Fernando Martinez Stephanie Houde Mayank Agarwal Kartik Talamadupula John T. Richards 29 67 0 15 Feb 2022
Source Code Summarization with Structural Relative Position Guided Transformer Zi Gong Cuiyun Gao Yasheng Wang Wenchao Gu Yun Peng Zenglin Xu 21 34 0 14 Feb 2022
Investigating Explainability of Generative AI for Code through Scenario-based Design Jiao Sun Q. V. Liao Michael J. Muller Mayank Agarwal Stephanie Houde Kartik Talamadupula Justin D. Weisz 36 157 0 10 Feb 2022
A Survey on Artificial Intelligence for Source Code: A Dialogue Systems Perspective Erfan Al-Hossami Samira Shaikh 32 6 0 10 Feb 2022
CodeRetriever: Unimodal and Bimodal Contrastive Learning for Code Search Xiaonan Li Yeyun Gong Yelong Shen Xipeng Qiu Hang Zhang Bolun Yao Weizhen Qi Daxin Jiang Weizhu Chen Nan Duan OffRL 40 27 0 26 Jan 2022
Unveiling Project-Specific Bias in Neural Code Models Zhiming Li Yanzhou Li Tianlin Li Mengnan Du Bozhi Wu Yushi Cao Yi Li Yang Liu 31 5 0 19 Jan 2022
Assemble Foundation Models for Automatic Code Summarization Jian Gu P. Salza H. Gall 36 34 0 13 Jan 2022
VELVET: a noVel Ensemble Learning approach to automatically locate VulnErable sTatements Yangruibo Ding Sahil Suneja Yunhui Zheng Jim Laredo Alessandro Morari Gail E. Kaiser Baishakhi Ray AAML 14 48 0 20 Dec 2021
Programming Knowledge Tracing: A Comprehensive Dataset and A New Model Renyu Zhu Dongxiang Zhang Chengcheng Han Ming Gao Xuesong Lu Weining Qian Aoying Zhou 21 13 0 11 Dec 2021
Bridging Pre-trained Models and Downstream Tasks for Source Code Understanding Deze Wang Zhouyang Jia Shanshan Li Yue Yu Yun Xiong Wei Dong Xiangke Liao 38 80 0 04 Dec 2021
Multilingual training for Software Engineering Toufique Ahmed Prem Devanbu 70 73 0 03 Dec 2021
Many Heads but One Brain: Fusion Brain -- a Competition and a Single Multimodal Multitask Architecture Daria Bakshandaeva Denis Dimitrov V.Ya. Arkhipkin Alex Shonenkov M. Potanin ... Mikhail Martynov Anton Voronov Vera Davydova E. Tutubalina Aleksandr Petiushko 35 0 0 22 Nov 2021
Cascaded Fast and Slow Models for Efficient Semantic Code Search Akhilesh Deepak Gotmare Junnan Li Chenyu You Guosheng Lin 33 10 0 15 Oct 2021
Leveraging Automated Unit Tests for Unsupervised Code Translation Baptiste Roziere Jie M. Zhang François Charton Mark Harman Gabriel Synnaeve Guillaume Lample 25 112 0 13 Oct 2021
Using Document Similarity Methods to create Parallel Datasets for Code Translation Mayank Agarwal Kartik Talamadupula Fernando Martinez Stephanie Houde Michael J. Muller John T. Richards Steven I. Ross Justin D. Weisz SyDa 34 8 0 11 Oct 2021
Learning to Describe Solutions for Bug Reports Based on Developer Discussions Sheena Panthaplackel J. Li Miloš Gligorić Raymond J. Mooney LMTD 24 10 0 08 Oct 2021
Towards Learning (Dis)-Similarity of Source Code from Program Contrasts Yangruibo Ding Luca Buratti Saurabh Pujar Alessandro Morari Baishakhi Ray Saikat Chakraborty 21 36 0 08 Oct 2021
Generate & Rank: A Multi-task Framework for Math Word Problems Jianhao Shen Yichun Yin Lin Li Lifeng Shang Xin Jiang Ming Zhang Qun Liu AIMat 11 125 0 07 Sep 2021
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation Yue Wang Weishi Wang Chenyu You Guosheng Lin 246 1,492 0 02 Sep 2021
Retrieval Augmented Code Generation and Summarization Md. Rizwan Parvez W. Ahmad Saikat Chakraborty Baishakhi Ray Kai-Wei Chang 26 183 0 26 Aug 2021
AVATAR: A Parallel Corpus for Java-Python Program Translation W. Ahmad Md Golam Rahman Tushar Saikat Chakraborty Kai-Wei Chang 38 79 0 26 Aug 2021
What do pre-trained code models know about code? Anjan Karmakar Romain Robbes ELM 32 87 0 25 Aug 2021
Impact of Evaluation Methodologies on Code Summarization Pengyu Nie Jiyang Zhang Junyi Jessy Li Raymond J. Mooney Miloš Gligorić 24 19 0 22 Aug 2021