How Efficient is LLM-Generated Code? A Rigorous & High-Standard Benchmark

How Efficient is LLM-Generated Code? A Rigorous & High-Standard Benchmark

20 February 2025

Weiliang Will Zeng

Christopher Lott

Papers citing "How Efficient is LLM-Generated Code? A Rigorous & High-Standard Benchmark"

18 / 18 papers shown

Title
Afterburner: Reinforcement Learning Facilitates Self-Improving Code Efficiency Optimization Mingzhe Du Luu Tuan Tuan Yue Liu Yuhao Qing Dong Huang Xinyi He Qian Liu Zejun Ma See-Kiong Ng 5 0 0 29 May 2025
Breaking Silos: Adaptive Model Fusion Unlocks Better Time Series Forecasting Zhining Liu Ze Yang Xiao Lin Ruizhong Qiu Tianxin Wei Yada Zhu Hendrik Hamann Jingrui He Hanghang Tong AI4TS 9 0 0 24 May 2025
LLM4EFFI: Leveraging Large Language Models to Enhance Code Efficiency and Correctness Tong Ye Weigang Huang Xinsong Zhang Tengfei Ma Peiyu Liu Yuxiang Cai Wenhai Wang LLMAG 76 3 0 17 Feb 2025
LLM Program Optimization via Retrieval Augmented Search Sagnik Anupam Alexander Shypula Osbert Bastani 154 1 0 31 Jan 2025
How Should We Build A Benchmark? Revisiting 274 Code-Related Benchmarks For LLMs Jialun Cao Yuk-Kit Chan Zixuan Ling Wenxuan Wang Shuqing Li ... Pinjia He Shuai Wang Zibin Zheng Michael R. Lyu Shing-Chi Cheung ALM 103 2 0 18 Jan 2025
CKGFuzzer: LLM-Based Fuzz Driver Generation Enhanced By Code Knowledge Graph HanXiang Xu Wei Ma Ting Zhou Yanjie Zhao Kai Chen Q. Hu Yang Liu Haoyu Wang 84 0 0 18 Nov 2024
Gradient Compressed Sensing: A Query-Efficient Gradient Estimator for High-Dimensional Zeroth-Order Optimization Ruizhong Qiu Hanghang Tong 57 5 0 27 May 2024
Towards Unified Multi-Modal Personalization: Large Vision-Language Models for Generative Recommendation and Beyond Tianxin Wei Bowen Jin Ruirui Li Hansi Zeng Zhengyang Wang ... Qingyu Yin Hanqing Lu Suhang Wang Jingrui He Xianfeng Tang 62 20 0 15 Mar 2024
EffiBench: Benchmarking the Efficiency of Automatically Generated Code Dong Huang Yuhao Qing Weiyi Shang Heming Cui Jie M. Zhang 94 35 0 03 Feb 2024
Mixtral of Experts Albert Q. Jiang Alexandre Sablayrolles Antoine Roux A. Mensch Blanche Savary ... Théophile Gervet Thibaut Lavril Thomas Wang Timothée Lacroix William El Sayed MoE LLMAG 48 1,049 0 08 Jan 2024
Ensuring User-side Fairness in Dynamic Recommender Systems Hyunsik Yoo Zhichen Zeng Jian Kang Ruizhong Qiu David Zhou Zhining Liu Fei Wang Charlie Xu Eunice Chan Hanghang Tong 35 15 0 29 Aug 2023
Networked Time Series Imputation via Position-aware Graph Enhanced Variational Autoencoders Dingsu Wang Yuchen Yan Ruizhong Qiu Yada Zhu Kaiyu Guan A. Margenot Hanghang Tong AI4TS 58 29 0 29 May 2023
GPT-4 Technical Report OpenAI OpenAI OpenAI Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad ... Shengjia Zhao Tianhao Zheng Juntang Zhuang William Zhuk Barret Zoph LLMAG MLLM 75 13,788 0 15 Mar 2023
Competition-Level Code Generation with AlphaCode Yujia Li David Choi Junyoung Chung Nate Kushman Julian Schrittwieser ... Esme Sutherland Robson Pushmeet Kohli Nando de Koray Kavukcuoglu Oriol Vinyals 33 1,337 0 08 Feb 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 484 9,009 0 28 Jan 2022
Program Synthesis with Large Language Models Jacob Austin Augustus Odena Maxwell Nye Maarten Bosma Henryk Michalewski ... Ellen Jiang Carrie J. Cai Michael Terry Quoc V. Le Charles Sutton ELM AIMat ReCod ALM 60 1,846 0 16 Aug 2021
Measuring Coding Challenge Competence With APPS Dan Hendrycks Steven Basart Saurav Kadavath Mantas Mazeika Akul Arora ... Collin Burns Samir Puranik Horace He D. Song Jacob Steinhardt ELM AIMat ALM 214 657 0 20 May 2021
Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Task Tao Yu Rui Zhang Kai-Chou Yang Michihiro Yasunaga Dongxu Wang ... Irene Li Qingning Yao Shanelle Roman Zilin Zhang Dragomir R. Radev RALM 42 1,203 0 24 Sep 2018

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.