Synthesizing High-Quality Programming Tasks with LLM-based Expert and Student Agents

10 April 2025

Manh Hung Nguyen

Victor-Alexandru Pădurean

Alkis Gotovos

Sebastian Tschiatschek

Adish Singla

ArXiv PDF HTML

Papers citing "Synthesizing High-Quality Programming Tasks with LLM-based Expert and Student Agents"

29 / 29 papers shown

Title
Simulating Classroom Education with LLM-Empowered Agents Zheyuan Zhang Daniel Zhang-Li Jifan Yu Linlu Gong Jinchang Zhou Zhiyuan Liu Lei Hou Juanzi Li LLMAG 66 64 0 27 Jun 2024
Evaluating Contextually Personalized Programming Exercises Created with Generative AI E. Logacheva Arto Hellas James Prather Sami Sarsa Juho Leinonen 66 11 0 11 Jun 2024
Generative Students: Using LLM-Simulated Student Profiles to Support Question Item Evaluation Xinyi Lu Xu Wang AI4Ed 50 24 0 19 May 2024
Task Synthesis for Elementary Visual Programming in XLogoOnline Environment Chao Wen Ahana Ghosh Jacqueline Staub Adish Singla 55 3 0 03 May 2024
MathVC: An LLM-Simulated Multi-Character Virtual Classroom for Mathematics Education Murong Yue Wijdane Mifdal Yixuan Zhang Jennifer Suh Yixuan Zhang Ziyu Yao LLMAG 114 20 0 10 Apr 2024
Knowledge Graphs as Context Sources for LLM-Based Explanations of Learning Recommendations Hasan Abu-Rasheed Christian Weber M. Fathi AI4Ed 50 32 0 05 Mar 2024
Generative AI for Education (GAIED): Advances, Opportunities, and Challenges Paul Denny Sumit Gulwani Neil T. Heffernan Tanja Käser Steven Moore Anna N. Rafferty Adish Singla 50 19 0 02 Feb 2024
The Behavior of Large Language Models When Prompted to Generate Code Explanations Priti Oli Rabin Banjade Jeevan Chapagain Vasile Rus LRM 59 4 0 02 Nov 2023
How to Teach Programming in the AI Era? Using LLMs as a Teachable Agent for Debugging Qianou Ma Hua Shen Kenneth R. Koedinger Tongshuang Wu LLMAG ELM 55 29 0 08 Oct 2023
Automating Human Tutor-Style Programming Feedback: Leveraging GPT-4 Tutor Model for Hint Generation and GPT-3.5 Student Model for Hint Validation Tung Phung Victor-Alexandru Pădurean Anjali Singh Christopher A. Brooks J. Cambronero Sumit Gulwani Adish Singla Gustavo Soares 48 43 0 05 Oct 2023
Large Language Models Cannot Self-Correct Reasoning Yet Jie Huang Xinyun Chen Swaroop Mishra Huaixiu Steven Zheng Adams Wei Yu Xinying Song Denny Zhou ReLM LRM 71 460 0 03 Oct 2023
The Robots are Here: Navigating the Generative AI Revolution in Computing Education James Prather Paul Denny Juho Leinonen Brett A. Becker Ibrahim Albluwi ... Stephen MacNeil Andrew Petersen Raymond Pettit Brent N. Reeves Jaromír Šavelka 54 205 0 01 Oct 2023
Ruffle&Riley: Towards the Automated Induction of Conversational Tutoring Systems Robin Schmucker Meng Xia A. Azaria Tom Michael Mitchell 40 15 0 26 Sep 2023
Teach AI How to Code: Using Large Language Models as Teachable Agents for Programming Education Hyoungwook Jin Seonghee Lee Hyun Joon Shin Juho Kim LLMAG 36 55 0 25 Sep 2023
Harnessing LLMs in Curricular Design: Using GPT-4 to Support Authoring of Learning Objectives Pragnya Sridhar Aidan Doyle Arav Agarwal Chris Bogart Jaromír Šavelka M. Sakr 63 45 0 30 Jun 2023
Generative AI for Programming Education: Benchmarking ChatGPT, GPT-4, and Human Tutors Tung Phung Victor-Alexandru Pădurean J. Cambronero Sumit Gulwani Tobias Kohn R. Majumdar Adish Singla Gustavo Soares ALM ELM 42 76 0 29 Jun 2023
Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena Lianmin Zheng Wei-Lin Chiang Ying Sheng Siyuan Zhuang Zhanghao Wu ... Dacheng Li Eric Xing Haotong Zhang Joseph E. Gonzalez Ion Stoica ALM OSLM ELM 312 4,253 0 09 Jun 2023
Neural Task Synthesis for Visual Programming Victor-Alexandru Pădurean Georgios Tzannetos Adish Singla 66 17 0 26 May 2023
Improving Factuality and Reasoning in Language Models through Multiagent Debate Yilun Du Shuang Li Antonio Torralba J. Tenenbaum Igor Mordatch LLMAG LRM 135 702 0 23 May 2023
Teaching Large Language Models to Self-Debug Xinyun Chen Maxwell Lin Nathanael Scharli Denny Zhou LRM 88 688 0 11 Apr 2023
Self-Refine: Iterative Refinement with Self-Feedback Aman Madaan Niket Tandon Prakhar Gupta Skyler Hallinan Luyu Gao ... Bodhisattwa Prasad Majumder Katherine Hermann Sean Welleck Amir Yazdanbakhsh Peter Clark ReLM LRM DiffM 129 1,618 0 30 Mar 2023
Generating High-Precision Feedback for Programming Syntax Errors using Large Language Models Tung Phung J. Cambronero Sumit Gulwani Tobias Kohn R. Majumdar Adish Singla Gustavo Soares 82 46 0 24 Jan 2023
Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programming Hussein Mozannar Gagan Bansal Adam Fourney Eric Horvitz 78 113 0 25 Oct 2022
Using Large Language Models to Enhance Programming Error Messages Juho Leinonen Arto Hellas Sami Sarsa B. Reeves Paul Denny James Prather Brett A. Becker 40 183 0 20 Oct 2022
Toward Trustworthy Neural Program Synthesis Darren Key Wen-Ding Li Kevin Ellis NAI 147 5 0 29 Sep 2022
Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studies Gati Aher RosaI. Arriaga Adam Tauman Kalai 100 390 0 18 Aug 2022
Automatic Generation of Programming Exercises and Code Explanations using Large Language Models Sami Sarsa Paul Denny Arto Hellas Juho Leinonen ELM 151 351 0 03 Jun 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 738 9,267 0 28 Jan 2022
Synthesizing Tasks for Block-based Programming Umair Z. Ahmed M. Christakis A. Efremov Nigel Fernandez Ahana Ghosh Abhik Roychoudhury Adish Singla 26 22 0 17 Jun 2020