NatGen: Generative pre-training by "Naturalizing" source code

15 June 2022

Papers citing "NatGen: Generative pre-training by "Naturalizing" source code"

40 / 40 papers shown

Title
Do LLMs Consider Security? An Empirical Study on Responses to Programming Questions Amirali Sajadi Binh Le A. Nguyen Kostadin Damevski Preetha Chatterjee 84 3 0 20 Feb 2025
What can Large Language Models Capture about Code Functional Equivalence? Nickil Maveli Antonio Vergari Shay B. Cohen 66 4 0 20 Aug 2024
Selective Prompt Anchoring for Code Generation Yuan Tian Tianyi Zhang 153 3 0 17 Aug 2024
LLMs in the Heart of Differential Testing: A Case Study on a Medical Rule Engine Erblin Isaku Christoph Laaber Hassan Sartaj Shaukat Ali T. Schwitalla J. F. Nygård 105 2 0 16 Feb 2024
Towards Learning (Dis)-Similarity of Source Code from Program Contrasts Yangruibo Ding Luca Buratti Saurabh Pujar Alessandro Morari Baishakhi Ray Saikat Chakraborty 44 36 0 08 Oct 2021
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation Yue Wang Weishi Wang Shafiq Joty Guosheng Lin 280 1,552 0 02 Sep 2021
Retrieval Augmented Code Generation and Summarization Md. Rizwan Parvez W. Ahmad Saikat Chakraborty Baishakhi Ray Kai-Wei Chang 57 186 0 26 Aug 2021
AVATAR: A Parallel Corpus for Java-Python Program Translation W. Ahmad Md Golam Rahman Tushar Saikat Chakraborty Kai-Wei Chang 64 81 0 26 Aug 2021
On Multi-Modal Learning of Editing Source Code Saikat Chakraborty Baishakhi Ray KELM 44 59 0 15 Aug 2021
Evaluating Large Language Models Trained on Code Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Pondé ... Bob McGrew Dario Amodei Sam McCandlish Ilya Sutskever Wojciech Zaremba ELM ALM 205 5,454 0 07 Jul 2021
CoTexT: Multi-task Learning with Code-Text Transformer Long Phan H. Tran Daniel Le Hieu Duy Nguyen J. Anibal Alec Peltekian Yanfang Ye 56 134 0 18 May 2021
Unified Pre-training for Program Understanding and Generation Wasi Uddin Ahmad Saikat Chakraborty Baishakhi Ray Kai-Wei Chang 125 764 0 10 Mar 2021
DOBF: A Deobfuscation Pre-Training Objective for Programming Languages Baptiste Roziere Marie-Anne Lachaux Marc Szafraniec Guillaume Lample AI4CE 71 139 0 15 Feb 2021
Neural Software Analysis Michael Pradel S. Chandra NAI 53 33 0 16 Nov 2020
Code to Comment "Translation": Data, Metrics, Baselining & Evaluation David Gros Hariharan Sezhiyan Prem Devanbu Zhou Yu 63 70 0 03 Oct 2020
CodeBLEU: a Method for Automatic Evaluation of Code Synthesis Shuo Ren Daya Guo Shuai Lu Long Zhou Shujie Liu Duyu Tang Neel Sundaresan M. Zhou Ambrosio Blanco Shuai Ma ELM 99 525 0 22 Sep 2020
GraphCodeBERT: Pre-training Code Representations with Data Flow Daya Guo Shuo Ren Shuai Lu Zhangyin Feng Duyu Tang ... Dawn Drain Neel Sundaresan Jian Yin Daxin Jiang M. Zhou 132 1,122 0 17 Sep 2020
Retrieval-Augmented Generation for Code Summarization via Hybrid GNN Shangqing Liu Yu Chen Xiaofei Xie J. Siow Yang Liu 41 165 0 09 Jun 2020
Unsupervised Translation of Programming Languages Marie-Anne Lachaux Baptiste Roziere L. Chanussot Guillaume Lample 77 415 0 05 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 680 41,736 0 28 May 2020
A Transformer-based Approach for Source Code Summarization Wasi Uddin Ahmad Saikat Chakraborty Baishakhi Ray Kai-Wei Chang ViT 79 379 0 01 May 2020
Typilus: Neural Type Hints Miltiadis Allamanis Earl T. Barr Soline Ducousso Zheng Gao 111 132 0 06 Apr 2020
CodeBERT: A Pre-Trained Model for Programming and Natural Languages Zhangyin Feng Daya Guo Duyu Tang Nan Duan Xiaocheng Feng ... Linjun Shou Bing Qin Ting Liu Daxin Jiang Ming Zhou 151 2,613 0 19 Feb 2020
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension M. Lewis Yinhan Liu Naman Goyal Marjan Ghazvininejad Abdel-rahman Mohamed Omer Levy Veselin Stoyanov Luke Zettlemoyer AIMat VLM 219 10,792 0 29 Oct 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 377 20,053 0 23 Oct 2019
CodeSearchNet Challenge: Evaluating the State of Semantic Code Search Hamel Husain Hongqiu Wu Tiferet Gazit Miltiadis Allamanis Marc Brockschmidt ELM 123 1,068 0 20 Sep 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 529 24,351 0 26 Jul 2019
Coupling Retrieval and Meta-Learning for Context-Dependent Semantic Parsing Daya Guo Duyu Tang Nan Duan M. Zhou Jian Yin RALM 40 49 0 17 Jun 2019
Generalizing from a Few Examples: A Survey on Few-Shot Learning Yaqing Wang Quanming Yao James T. Kwok L. Ni 83 1,809 0 10 Apr 2019
On Learning Meaningful Code Changes via Neural Machine Translation Michele Tufano Jevgenija Pantiuchina Cody Watson Gabriele Bavota Denys Poshyvanyk 60 205 0 25 Jan 2019
The Adverse Effects of Code Duplication in Machine Learning Models of Code Miltiadis Allamanis 61 319 0 16 Dec 2018
Meta-Transfer Learning for Few-Shot Learning Qianru Sun Yaoyao Liu Tat-Seng Chua Bernt Schiele 199 1,070 0 06 Dec 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.6K 94,511 0 11 Oct 2018
Mapping Language to Code in Programmatic Context Srinivasan Iyer Ioannis Konstas Alvin Cheung Luke Zettlemoyer 67 235 0 29 Aug 2018
Learning to Represent Programs with Graphs Miltiadis Allamanis Marc Brockschmidt Mahmoud Khademi GNN NAI 117 799 0 01 Nov 2017
A Survey of Machine Learning for Big Code and Naturalness Miltiadis Allamanis Earl T. Barr Premkumar T. Devanbu Charles Sutton 108 854 0 18 Sep 2017
Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Ugly Yongqin Xian Christoph H. Lampert Bernt Schiele Zeynep Akata VLM 139 1,565 0 03 Jul 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 642 130,942 0 12 Jun 2017
Neural Attribute Machines for Program Generation Matthew Amodio Swarat Chaudhuri Thomas W. Reps 41 35 0 25 May 2017
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 325 7,478 0 02 Dec 2016