Benchmarking and Explaining Large Language Model-based Code Generation: A Causality-Centric Approach

10 October 2023

Papers citing "Benchmarking and Explaining Large Language Model-based Code Generation: A Causality-Centric Approach"

27 / 27 papers shown

Title
Towards Robust NLG Bias Evaluation with Syntactically-diverse Prompts Arshiya Aggarwal Jiao Sun Nanyun Peng 58 6 0 03 Dec 2022
Applications of statistical causal inference in software engineering Julien Siebert CML 84 33 0 21 Nov 2022
Uncertainty Quantification with Pre-trained Language Models: A Large-Scale Empirical Analysis Yuxin Xiao Paul Pu Liang Umang Bhatt Willie Neiswanger Ruslan Salakhutdinov Louis-Philippe Morency 215 96 0 10 Oct 2022
Membership Inference Attacks and Generalization: A Causal Perspective Teodora Baluta Shiqi Shen S. Hitarth Shruti Tople Prateek Saxena OOD MIACV 71 19 0 18 Sep 2022
Adaptive Fairness Improvement Based on Causality Analysis Mengdi Zhang Jun Sun 50 33 0 15 Sep 2022
No More Fine-Tuning? An Experimental Evaluation of Prompt Tuning in Code Intelligence Chaozheng Wang Yuanhang Yang Cuiyun Gao Yun Peng Hongyu Zhang Michael R. Lyu AAML 98 137 0 24 Jul 2022
Emergent Abilities of Large Language Models Jason W. Wei Yi Tay Rishi Bommasani Colin Raffel Barret Zoph ... Tatsunori Hashimoto Oriol Vinyals Percy Liang J. Dean W. Fedus ELM ReLM LRM 279 2,480 0 15 Jun 2022
Causality-based Neural Network Repair Bing-Jie Sun Jun Sun Hong Long Pham Jie Shi 60 81 0 20 Apr 2022
Competition-Level Code Generation with AlphaCode Yujia Li David Choi Junyoung Chung Nate Kushman Julian Schrittwieser ... Esme Sutherland Robson Pushmeet Kohli Nando de Koray Kavukcuoglu Oriol Vinyals 141 1,403 0 08 Feb 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 817 9,576 0 28 Jan 2022
Multitask Prompted Training Enables Zero-Shot Task Generalization Victor Sanh Albert Webson Colin Raffel Stephen H. Bach Lintang Sutawika ... T. Bers Stella Biderman Leo Gao Thomas Wolf Alexander M. Rush LRM 344 1,702 0 15 Oct 2021
Pushing on Text Readability Assessment: A Transformer Meets Handcrafted Linguistic Features Bruce W. Lee Yoonna Jang J. Lee VLM 83 81 0 25 Sep 2021
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation Yue Wang Weishi Wang Shafiq Joty Guosheng Lin 289 1,560 0 02 Sep 2021
Program Synthesis with Large Language Models Jacob Austin Augustus Odena Maxwell Nye Maarten Bosma Henryk Michalewski ... Ellen Jiang Carrie J. Cai Michael Terry Quoc V. Le Charles Sutton ELM AIMat ReCod ALM 198 1,986 0 16 Aug 2021
Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing Pengfei Liu Weizhe Yuan Jinlan Fu Zhengbao Jiang Hiroaki Hayashi Graham Neubig VLM SyDa 216 3,977 0 28 Jul 2021
Evaluating Large Language Models Trained on Code Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Pondé ... Bob McGrew Dario Amodei Sam McCandlish Ilya Sutskever Wojciech Zaremba ELM ALM 231 5,539 0 07 Jul 2021
DiBS: Differentiable Bayesian Structure Learning Lars Lorch Jonas Rothfuss Bernhard Schölkopf Andreas Krause 52 87 0 25 May 2021
Measuring Coding Challenge Competence With APPS Dan Hendrycks Steven Basart Saurav Kadavath Mantas Mazeika Akul Arora ... Collin Burns Samir Puranik Horace He Basel Alomair Jacob Steinhardt ELM AIMat ALM 254 681 0 20 May 2021
CodeBLEU: a Method for Automatic Evaluation of Code Synthesis Shuo Ren Daya Guo Shuai Lu Long Zhou Shujie Liu Duyu Tang Neel Sundaresan M. Zhou Ambrosio Blanco Shuai Ma ELM 112 534 0 22 Sep 2020
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 442 20,181 0 23 Oct 2019
Fine-Tuning Language Models from Human Preferences Daniel M. Ziegler Nisan Stiennon Jeff Wu Tom B. Brown Alec Radford Dario Amodei Paul Christiano G. Irving ALM 466 1,734 0 18 Sep 2019
Text Readability Assessment for Second Language Learners Menglin Xia E. Kochmar Ted Briscoe 43 163 0 18 Jun 2019
DAG-GNN: DAG Structure Learning with Graph Neural Networks Yue Yu Jie Chen Tian Gao Mo Yu BDL CML GNN 78 487 0 22 Apr 2019
A Grammar-Based Structural CNN Decoder for Code Generation Zeyu Sun Qihao Zhu Lili Mou Yingfei Xiong Ge Li Lu Zhang 40 127 0 14 Nov 2018
A Call for Clarity in Reporting BLEU Scores Matt Post 162 2,994 0 23 Apr 2018
Learning Bayesian Networks: The Combination of Knowledge and Statistical Data David Heckerman D. Geiger D. M. Chickering TPM 117 3,982 0 27 Feb 2013
Learning Equivalence Classes of Bayesian Networks Structures D. M. Chickering 101 832 0 13 Feb 2013