On the Transferability of Pre-trained Language Models for Low-Resource Programming Languages

5 April 2022

Papers citing "On the Transferability of Pre-trained Language Models for Low-Resource Programming Languages"

31 / 31 papers shown

Title
Automatically Generating UI Code from Screenshot: A Divide-and-Conquer-Based Approach Yuxuan Wan Chaozheng Wang Yi Dong Wenxuan Wang Shuqing Li Yintong Huo Michael R. Lyu 3DV 115 12 0 24 Jun 2024
EditSum: A Retrieve-and-Edit Framework for Source Code Summarization Jia Li Yongming Li Ge Li Xing Hu Xin Xia Zhi Jin 82 66 0 26 Aug 2023
Multilingual training for Software Engineering Toufique Ahmed Prem Devanbu 84 74 0 03 Dec 2021
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation Yue Wang Weishi Wang Shafiq Joty Guosheng Lin 289 1,580 0 02 Sep 2021
Program Synthesis with Large Language Models Jacob Austin Augustus Odena Maxwell Nye Maarten Bosma Henryk Michalewski ... Ellen Jiang Carrie J. Cai Michael Terry Quoc V. Le Charles Sutton ELM AIMat ReCod ALM 195 1,986 0 16 Aug 2021
SynCoBERT: Syntax-Guided Multi-Modal Contrastive Pre-Training for Code Representation Xin Wang Yasheng Wang Fei Mi Pingyi Zhou Yao Wan Xiao Liu Li Li Hao Wu Jin Liu Xin Jiang 102 114 0 10 Aug 2021
Code to Comment Translation: A Comparative Study on Model Effectiveness & Errors Junayed Mahmud Fahim Faisal Raihan Islam Arnob Antonios Anastasopoulos Kevin Moran 116 20 0 15 Jun 2021
TreeBERT: A Tree-Based Pre-Trained Model for Programming Language Xue Jiang Zhuoran Zheng Chen Lyu Liang Li Lei Lyu 51 91 0 26 May 2021
Unified Pre-training for Program Understanding and Generation Wasi Uddin Ahmad Saikat Chakraborty Baishakhi Ray Kai-Wei Chang 132 766 0 10 Mar 2021
PyMT5: multi-mode translation of natural language and Python code with transformers Colin B. Clement Dawn Drain Jonathan Timcheck Alexey Svyatkovskiy Neel Sundaresan 62 154 0 07 Oct 2020
Code to Comment "Translation": Data, Metrics, Baselining & Evaluation David Gros Hariharan Sezhiyan Prem Devanbu Zhou Yu 73 70 0 03 Oct 2020
GraphCodeBERT: Pre-training Code Representations with Data Flow Daya Guo Shuo Ren Shuai Lu Zhangyin Feng Duyu Tang ... Dawn Drain Neel Sundaresan Jian Yin Daxin Jiang M. Zhou 142 1,134 0 17 Sep 2020
Self-Supervised Contrastive Learning for Code Retrieval and Summarization via Semantic-Preserving Transformations Nghi D. Q. Bui Yijun Yu Lingxiao Jiang SSL 56 117 0 06 Sep 2020
Retrieval-Augmented Generation for Code Summarization via Hybrid GNN Shangqing Liu Yu Chen Xiaofei Xie J. Siow Yang Liu 63 166 0 09 Jun 2020
Unsupervised Translation of Programming Languages Marie-Anne Lachaux Baptiste Roziere L. Chanussot Guillaume Lample 103 418 0 05 Jun 2020
SCELMo: Source Code Embeddings from Language Models Rafael-Michael Karampatsis Charles Sutton 59 52 0 28 Apr 2020
Incorporating External Knowledge through Pre-training for Natural Language to Code Generation Frank F. Xu Zhengbao Jiang Pengcheng Yin Bogdan Vasilescu Graham Neubig 35 84 0 20 Apr 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 359 1,487 0 18 Mar 2020
CodeBERT: A Pre-Trained Model for Programming and Natural Languages Zhangyin Feng Daya Guo Duyu Tang Nan Duan Xiaocheng Feng ... Linjun Shou Bing Qin Ting Liu Daxin Jiang Ming Zhou 162 2,637 0 19 Feb 2020
Learning and Evaluating Contextual Embedding of Source Code Aditya Kanade Petros Maniatis Gogul Balakrishnan Kensen Shi ELM 78 77 0 21 Dec 2019
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension M. Lewis Yinhan Liu Naman Goyal Marjan Ghazvininejad Abdel-rahman Mohamed Omer Levy Veselin Stoyanov Luke Zettlemoyer AIMat VLM 249 10,829 0 29 Oct 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 442 20,181 0 23 Oct 2019
TinyBERT: Distilling BERT for Natural Language Understanding Xiaoqi Jiao Yichun Yin Lifeng Shang Xin Jiang Xiao Chen Linlin Li F. Wang Qun Liu VLM 105 1,860 0 23 Sep 2019
CodeSearchNet Challenge: Evaluating the State of Semantic Code Search Hamel Husain Hongqiu Wu Tiferet Gazit Miltiadis Allamanis Marc Brockschmidt ELM 130 1,079 0 20 Sep 2019
Text Summarization with Pretrained Encoders Yang Liu Mirella Lapata MILM 452 1,451 0 22 Aug 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 662 24,464 0 26 Jul 2019
XLNet: Generalized Autoregressive Pretraining for Language Understanding Zhilin Yang Zihang Dai Yiming Yang J. Carbonell Ruslan Salakhutdinov Quoc V. Le AI4CE 232 8,433 0 19 Jun 2019
Better Word Embeddings by Disentangling Contextual n-Gram Information Prakhar Gupta Matteo Pagliardini Martin Jaggi 22 39 0 10 Apr 2019
Improving Automatic Source Code Summarization via Deep Reinforcement Learning Yao Wan Zhou Zhao Min Yang Guandong Xu Haochao Ying Jian Wu Philip S. Yu 53 392 0 17 Nov 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 94,891 0 11 Oct 2018
Newsroom: A Dataset of 1.3 Million Summaries with Diverse Extractive Strategies Max Grusky Mor Naaman Yoav Artzi 88 556 0 30 Apr 2018