Unified Pre-training for Program Understanding and Generation

10 March 2021

Papers citing "Unified Pre-training for Program Understanding and Generation"

44 / 44 papers shown

Title
DocAgent: A Multi-Agent System for Automated Code Documentation Generation Dayu Yang Antoine Simoulin Xin Qian Xiaoyi Liu Yuwei Cao Zhaopu Teng Grey Yang LLMAG 75 0 0 11 Apr 2025
On Benchmarking Code LLMs for Android Malware Analysis Yiling He Hongyu She Xingzhi Qian Xinran Zheng Zhuo Chen Zhan Qin Lorenzo Cavallaro ELM 94 1 0 01 Apr 2025
UniGenCoder: Merging Seq2Seq and Seq2Tree Paradigms for Unified Code Generation Liangying Shao Yanfu Yan Denys Poshyvanyk Jinsong Su 61 2 0 18 Feb 2025
CODESIM: Multi-Agent Code Generation and Problem Solving through Simulation-Driven Planning and Debugging Md. Ashraful Islam Mohammed Eunus Ali Md. Rizwan Parvez LLMAG 109 2 0 08 Feb 2025
Towards Making Flowchart Images Machine Interpretable Shivalika Singh Prajwal Gatti Yogesh Kumar Vikash Yadav Anand Mishra 73 6 0 29 Jan 2025
L3Ms -- Lagrange Large Language Models Guneet S. Dhillon Xingjian Shi Yee Whye Teh Alex Smola 379 0 0 28 Oct 2024
Prompting Techniques for Secure Code Generation: A Systematic Investigation Catherine Tony Nicolás E. Díaz Ferreyra Markus Mutas Salem Dhiff Riccardo Scandariato SILM 109 10 0 09 Jul 2024
Large Language Models for Cyber Security: A Systematic Literature Review HanXiang Xu Shenao Wang Ningke Li Kaidi Wang Yanjie Zhao Kai Chen Ting Yu Yang Liu Haoyu Wang 81 33 0 08 May 2024
Bias Testing and Mitigation in LLM-based Code Generation Dong Huang Qingwen Bu Jie M. Zhang Xiaofei Xie Junjie Chen Heming Cui 72 23 0 03 Sep 2023
PyMT5: multi-mode translation of natural language and Python code with transformers Colin B. Clement Dawn Drain Jonathan Timcheck Alexey Svyatkovskiy Neel Sundaresan 46 154 0 07 Oct 2020
CodeBLEU: a Method for Automatic Evaluation of Code Synthesis Shuo Ren Daya Guo Shuai Lu Long Zhou Shujie Liu Duyu Tang Neel Sundaresan M. Zhou Ambrosio Blanco Shuai Ma ELM 92 517 0 22 Sep 2020
GraphCodeBERT: Pre-training Code Representations with Data Flow Daya Guo Shuo Ren Shuai Lu Zhangyin Feng Duyu Tang ... Dawn Drain Neel Sundaresan Jian Yin Daxin Jiang M. Zhou 132 1,111 0 17 Sep 2020
Unsupervised Translation of Programming Languages Marie-Anne Lachaux Baptiste Roziere L. Chanussot Guillaume Lample 73 410 0 05 Jun 2020
A Transformer-based Approach for Source Code Summarization Wasi Uddin Ahmad Saikat Chakraborty Baishakhi Ray Kai-Wei Chang ViT 77 378 0 01 May 2020
Detecting Code Clones with Graph Neural Networkand Flow-Augmented Abstract Syntax Tree Wenhan Wang Ge Li Bo Ma Xin Xia Zhi Jin GNN 36 253 0 20 Feb 2020
CodeBERT: A Pre-Trained Model for Programming and Natural Languages Zhangyin Feng Daya Guo Duyu Tang Nan Duan Xiaocheng Feng ... Linjun Shou Bing Qin Ting Liu Daxin Jiang Ming Zhou 134 2,588 0 19 Feb 2020
Multilingual Denoising Pre-training for Neural Machine Translation Yinhan Liu Jiatao Gu Naman Goyal Xian Li Sergey Edunov Marjan Ghazvininejad M. Lewis Luke Zettlemoyer AI4CE AIMat 111 1,786 0 22 Jan 2020
Unsupervised Cross-lingual Representation Learning at Scale Alexis Conneau Kartikay Khandelwal Naman Goyal Vishrav Chaudhary Guillaume Wenzek Francisco Guzmán Edouard Grave Myle Ott Luke Zettlemoyer Veselin Stoyanov 186 6,496 0 05 Nov 2019
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension M. Lewis Yinhan Liu Naman Goyal Marjan Ghazvininejad Abdel-rahman Mohamed Omer Levy Veselin Stoyanov Luke Zettlemoyer AIMat VLM 180 10,720 0 29 Oct 2019
CodeSearchNet Challenge: Evaluating the State of Semantic Code Search Hamel Husain Hongqiu Wu Tiferet Gazit Miltiadis Allamanis Marc Brockschmidt ELM 121 1,062 0 20 Sep 2019
Devign: Effective Vulnerability Identification by Learning Comprehensive Program Semantics via Graph Neural Networks Yaqin Zhou Shangqing Liu J. Siow Xiaoning Du Yang Liu GNN 42 755 0 08 Sep 2019
Release Strategies and the Social Impacts of Language Models Irene Solaiman Miles Brundage Jack Clark Amanda Askell Ariel Herbert-Voss ... Miles McCain Alex Newhouse Jason Blazakis Kris McGuffie Jasmine Wang 75 619 0 24 Aug 2019
VisualBERT: A Simple and Performant Baseline for Vision and Language Liunian Harold Li Mark Yatskar Da Yin Cho-Jui Hsieh Kai-Wei Chang VLM 120 1,939 0 09 Aug 2019
Tree-Transformer: A Transformer-Based Method for Correction of Tree-Structured Data Jacob A. Harer Christopher P. Reale Peter Chin 57 44 0 01 Aug 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 467 24,160 0 26 Jul 2019
Coupling Retrieval and Meta-Learning for Context-Dependent Semantic Parsing Daya Guo Duyu Tang Nan Duan M. Zhou Jian Yin RALM 40 49 0 17 Jun 2019
Learning Programmatic Idioms for Scalable Semantic Parsing Srini Iyer Alvin Cheung Luke Zettlemoyer 56 45 0 19 Apr 2019
VideoBERT: A Joint Model for Video and Language Representation Learning Chen Sun Austin Myers Carl Vondrick Kevin Patrick Murphy Cordelia Schmid VLM SSL 56 1,238 0 03 Apr 2019
fairseq: A Fast, Extensible Toolkit for Sequence Modeling Myle Ott Sergey Edunov Alexei Baevski Angela Fan Sam Gross Nathan Ng David Grangier Michael Auli VLM FaML 84 3,141 0 01 Apr 2019
Cross-lingual Language Model Pretraining Guillaume Lample Alexis Conneau 67 2,727 0 22 Jan 2019
SequenceR: Sequence-to-Sequence Learning for End-to-End Program Repair Zimin Chen Steve Kommrusch Michele Tufano L. Pouchet Denys Poshyvanyk Monperrus Martin KELM 57 433 0 24 Dec 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.2K 93,936 0 11 Oct 2018
Mapping Language to Code in Programmatic Context Srinivasan Iyer Ioannis Konstas Alvin Cheung Luke Zettlemoyer 59 232 0 29 Aug 2018
SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing Taku Kudo John Richardson 165 3,490 0 19 Aug 2018
code2seq: Generating Sequences from Structured Representations of Code Uri Alon Shaked Brody Omer Levy Eran Yahav 64 695 0 04 Aug 2018
Automated Vulnerability Detection in Source Code Using Deep Representation Learning Rebecca L. Russell Louis Y. Kim Lei H. Hamilton Tomo Lazovich Jacob A. Harer Onur Ozdemir Paul M. Ellingwood M. McConley 41 521 0 11 Jul 2018
Program Language Translation Using a Grammar-Driven Tree-to-Tree Model M. Drissi Olivia Watkins Aditya Khant Vivaswat Ojha Pedro Sandoval Segura Rakia Segev Eric Weiner Robert Keller 23 17 0 04 Jul 2018
Building Language Models for Text with Named Entities Md. Rizwan Parvez Saikat Chakraborty Baishakhi Ray Kai-Wei Chang 47 41 0 13 May 2018
code2vec: Learning Distributed Representations of Code Uri Alon Meital Zilberstein Omer Levy Eran Yahav 53 1,164 0 26 Mar 2018
Tree-to-tree Neural Networks for Program Translation Xinyun Chen Chang-rui Liu D. Song 63 275 0 11 Feb 2018
Code Completion with Neural Attention and Pointer Networks Jian Li Yue Wang Michael R. Lyu Irwin King 63 236 0 27 Nov 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 519 129,831 0 12 Jun 2017
A Convolutional Attention Network for Extreme Summarization of Source Code Miltiadis Allamanis Hao Peng Charles Sutton AI4TS 75 582 0 09 Feb 2016
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 335 7,951 0 17 Aug 2015