Unified Pre-training for Program Understanding and Generation

10 March 2021

Papers citing "Unified Pre-training for Program Understanding and Generation"

50 / 316 papers shown

Title
Enhancing Trust in LLM-Generated Code Summaries with Calibrated Confidence Scores Yuvraj Virk Prem Devanbu Toufique Ahmed 62 10 0 30 Apr 2024
On the Limitations of Embedding Based Methods for Measuring Functional Correctness for Code Generation Atharva Naik 46 2 0 26 Apr 2024
Is Next Token Prediction Sufficient for GPT? Exploration on Code Logic Comprehension Mengnan Qi Yufan Huang Yongqiang Yao Maoquan Wang Bin Gu Neel Sundaresan 43 3 0 13 Apr 2024
Structure-aware Fine-tuning for Code Pre-trained Models Jiayi Wu Renyu Zhu Nuo Chen Qiushi Sun Xiang Li Ming Gao 43 2 0 11 Apr 2024
Analyzing the Performance of Large Language Models on Code Summarization Rajarshi Haldar J. Hockenmaier 46 18 0 10 Apr 2024
An Empirical Study of Automated Vulnerability Localization with Large Language Models Jian Zhang Chong Wang Anran Li Weisong Sun Cen Zhang Wei Ma Yang Liu 39 17 0 30 Mar 2024
A Survey of using Large Language Models for Generating Infrastructure as Code Kalahasti Ganesh Srivatsa Sabyasachi Mukhopadhyay Ganesh Katrapati Manish Shrivastava 33 1 0 30 Mar 2024
Vulnerability Detection with Code Language Models: How Far Are We? Yangruibo Ding Yanjun Fu Omniyyah Ibrahim Chawin Sitawarin Xinyun Chen Basel Alomair David Wagner Baishakhi Ray Yizheng Chen AAML 49 45 0 27 Mar 2024
ProCQA: A Large-scale Community-based Programming Question Answering Dataset for Code Search Zehan Li Jianfei Zhang Chuantao Yin Y. Ouyang Wenge Rong 34 3 0 25 Mar 2024
ChatGPT Incorrectness Detection in Software Reviews M. Tanzil Junaed Younus Khan Gias Uddin 19 4 0 25 Mar 2024
Genetic Auto-prompt Learning for Pre-trained Code Intelligence Language Models Chengzhe Feng Yanan Sun Ke Li Pan Zhou Jiancheng Lv Aojun Lu 51 1 0 20 Mar 2024
depyf: Open the Opaque Box of PyTorch Compiler for Machine Learning Researchers Kaichao You Runsheng Bai Meng Cao Jianmin Wang Ion Stoica Mingsheng Long VLM 33 0 0 14 Mar 2024
Teaching Machines to Code: Smart Contract Translation with LLMs Rabimba Karanjai Lei Xu Weidong Shi 38 6 0 13 Mar 2024
Bifurcated Attention: Accelerating Massively Parallel Decoding with Shared Prefixes in LLMs Ben Athiwaratkun Sujan Kumar Gonugondla Sanjay Krishna Gouda Haifeng Qian Hantian Ding ... Liangfu Chen Parminder Bhatia Ramesh Nallapati Sudipta Sengupta Bing Xiang 59 4 0 13 Mar 2024
Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks Linyuan Gong Sida Wang Mostafa Elhoushi Alvin Cheung 32 15 0 07 Mar 2024
CatCode: A Comprehensive Evaluation Framework for LLMs On the Mixture of Code and Text Zhenru Lin Yiqun Yao Yang Yuan ELM 28 0 0 04 Mar 2024
Semi-Instruct: Bridging Natural-Instruct and Self-Instruct for Code Large Language Models Xianzhen Luo Qingfu Zhu Zhiming Zhang Xu Wang Qing Yang Dongliang Xu Wanxiang Che ALM 32 2 0 01 Mar 2024
Retrieval-Augmented Generation for AI-Generated Content: A Survey Penghao Zhao Hailin Zhang Qinhan Yu Zhengren Wang Yunteng Geng Fangcheng Fu Ling Yang Wentao Zhang Jie Jiang Bin Cui 3DV 126 232 0 29 Feb 2024
Beyond Self-learned Attention: Mitigating Attention Bias in Transformer-based Models Using Attention Guidance Jiri Gesi Iftekhar Ahmed 57 0 0 26 Feb 2024
CovRL: Fuzzing JavaScript Engines with Coverage-Guided Reinforcement Learning for LLM-based Mutation Jueon Eom Seyeon Jeong Taekyoung Kwon 32 7 0 19 Feb 2024
CodeArt: Better Code Models by Attention Regularization When Symbols Are Lacking Zian Su Xiangzhe Xu Ziyang Huang Zhuo Zhang Yapeng Ye Jianjun Huang Xiangyu Zhang OffRL 40 8 0 19 Feb 2024
Rocks Coding, Not Development--A Human-Centric, Experimental Evaluation of LLM-Supported SE Tasks Wei Wang Huilong Ning Gaowei Zhang Libo Liu Yi Wang 31 11 0 08 Feb 2024
Solution-oriented Agent-based Models Generation with Verifier-assisted Iterative In-context Learning Tong Niu Weihao Zhang Rong Zhao LLMAG 35 2 0 04 Feb 2024
EffiBench: Benchmarking the Efficiency of Automatically Generated Code Dong Huang Yuhao Qing Weiyi Shang Heming Cui Jie M. Zhang 85 31 0 03 Feb 2024
Getting the most out of your tokenizer for pre-training and domain adaptation Gautier Dagan Gabriele Synnaeve Baptiste Rozière 34 20 0 01 Feb 2024
Transformer-Based Models Are Not Yet Perfect At Learning to Emulate Structural Recursion Dylan Zhang Curt Tigges Zory Zhang Stella Biderman Maxim Raginsky Talia Ringer 24 11 0 23 Jan 2024
Structured Code Representations Enable Data-Efficient Adaptation of Code Language Models Mayank Agarwal Songlin Yang Bailin Wang Yoon Kim Jie Chen 47 5 0 19 Jan 2024
A Novel Approach for Automatic Program Repair using Round-Trip Translation with Large Language Models Fernando Vallecillos Ruiz Anastasiia Grishina Max Hort Leon Moonen LRM 50 4 0 15 Jan 2024
Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trends Yunshi Lan Xinyuan Li Hanyue Du Xuesong Lu Ming Gao Weining Qian Aoying Zhou 40 2 0 15 Jan 2024
Between Lines of Code: Unraveling the Distinct Patterns of Machine and Human Programmers Yuling Shi Hongyu Zhang Chengcheng Wan Xiaodong Gu DeLMO 27 3 0 12 Jan 2024
Enhanced Automated Code Vulnerability Repair using Large Language Models David de-Fitero-Dominguez Eva García-López Antonio Garcia-Cabot J. Martínez-Herráiz 24 11 0 08 Jan 2024
AST-T5: Structure-Aware Pretraining for Code Generation and Understanding Linyuan Gong Mostafa Elhoushi Alvin Cheung 29 11 0 05 Jan 2024
Deep Learning for Code Intelligence: Survey, Benchmark and Toolkit Yao Wan Yang He Zhangqian Bi Jianguo Zhang Hongyu Zhang Yulei Sui Guandong Xu Hai Jin Philip S. Yu 35 20 0 30 Dec 2023
A Prompt Learning Framework for Source Code Summarization Weisong Sun Chunrong Fang Yudu You Yuchen Chen Yi Liu ... Quanjun Zhang Hanwei Qian Wei-Ye Zhao Yang Liu Zhenyu Chen LLMAG 45 13 0 26 Dec 2023
A Comprehensive Evaluation of Parameter-Efficient Fine-Tuning on Software Engineering Tasks Wentao Zou Qi Li Jidong Ge Chuanyi Li Xiaoyu Shen LiGuo Huang Bin Luo 32 5 0 25 Dec 2023
AgentCoder: Multi-Agent-based Code Generation with Iterative Testing and Optimisation Dong Huang Jie M.Zhang Michael Luck Qi Bu Yuhao Qing Heming Cui LLMAG 25 0 0 20 Dec 2023
A Case Study on Test Case Construction with Large Language Models: Unveiling Practical Insights and Challenges Roberto Francisco de Lima Junior Luiz Fernando Paes de Barros Presta Lucca Santos Borborema Vanderson Nogueira da Silva Marcio Dahia Anderson Carlos Sousa e Santos 13 2 0 19 Dec 2023
LLMs Cannot Reliably Identify and Reason About Security Vulnerabilities (Yet?): A Comprehensive Evaluation, Framework, and Benchmarks Saad Ullah Mingji Han Saurabh Pujar Hammond Pearce Ayse K. Coskun Gianluca Stringhini ELM LRM 21 61 0 19 Dec 2023
KEN: Kernel Extensions using Natural Language Yusheng Zheng Yiwei Yang Maolin Chen Andrew Quinn 29 0 0 09 Dec 2023
INSPECT: Intrinsic and Systematic Probing Evaluation for Code Transformers Anjan Karmakar Romain Robbes 30 4 0 08 Dec 2023
Converting Epics/Stories into Pseudocode using Transformers Gaurav Kolhatkar Akshit Madan Nidhi Kowtal Satyajit Roy S. Sonawane 13 2 0 08 Dec 2023
Graph Convolutions Enrich the Self-Attention in Transformers! Jeongwhan Choi Hyowon Wi Jayoung Kim Yehjin Shin Kookjin Lee Nathaniel Trask Noseong Park 32 4 0 07 Dec 2023
Bootstrapping Interactive Image-Text Alignment for Remote Sensing Image Captioning Cong Yang Zuchao Li Lefei Zhang 34 24 0 02 Dec 2023
Untargeted Code Authorship Evasion with Seq2Seq Transformation Soohyeon Choi Rhongho Jang Daehun Nyang David A. Mohaisen 16 0 0 26 Nov 2023
Language Models are Better Bug Detector Through Code-Pair Classification Kamel Alrashedy Ahmed Binjahlan 14 6 0 14 Nov 2023
Explain-then-Translate: An Analysis on Improving Program Translation with Self-generated Explanations Zilu Tang Mayank Agarwal Alex Shypula Bailin Wang Derry Wijaya Jie Chen Yoon Kim LRM 37 15 0 13 Nov 2023
TransformCode: A Contrastive Learning Framework for Code Embedding via Subtree Transformation Zixiang Xian Rubing Huang Dave Towey Chunrong Fang Zhenyu Chen 25 5 0 10 Nov 2023
Learning Defect Prediction from Unrealistic Data Kamel Alrashedy Vincent J. Hellendoorn Alessandro Orso 19 5 0 02 Nov 2023
Data Augmentation for Code Translation with Comparable Corpora and Multiple References Yiqing Xie Atharva Naik Daniel Fried Carolyn Rose 54 6 0 01 Nov 2023
Automating the Correctness Assessment of AI-generated Code for Security Contexts Domenico Cotroneo Alessio Foggia Cristina Improta Pietro Liguori R. Natella 28 8 0 28 Oct 2023