v1v2v3 (latest)

Generative AI for Programming Education: Benchmarking ChatGPT, GPT-4, and Human Tutors

29 June 2023

Tung Phung

Victor-Alexandru Pădurean

Papers citing "Generative AI for Programming Education: Benchmarking ChatGPT, GPT-4, and Human Tutors"

33 / 33 papers shown

Title
Synthesizing High-Quality Programming Tasks with LLM-based Expert and Student Agents Manh Hung Nguyen Victor-Alexandru Pădurean Alkis Gotovos Sebastian Tschiatschek Adish Singla 71 0 0 10 Apr 2025
Design of AI-Powered Tool for Self-Regulation Support in Programming Education Huiyong Li Boxuan Ma AI4Ed 114 0 0 03 Apr 2025
Rubric Is All You Need: Enhancing LLM-based Code Evaluation With Question-Specific Rubrics Aditya Pathak Rachit Gandhi Vaibhav Uttam Devansh Yashwanth Nakka ... Aditya Mittal Aashna Ased Chirag Khatri Jagat Sesh Challa Dhruv Kumar 80 0 0 31 Mar 2025
AI Literacy in K-12 and Higher Education in the Wake of Generative AI: An Integrative Review Xingjian Gu B. Ericson 154 0 0 27 Feb 2025
Emotionally Enriched Feedback via Generative AI Omar Alsaiari Nilufar Baghaei Hatim Lahza Jason M. Lodge Marie Boden Hassan Khosravi 67 3 0 19 Oct 2024
Crafting Generative Art through Genetic Improvement: Managing Creative Outputs in Diverse Fitness Landscapes Erik M. Fredericks Denton Bobeldyk Jared M. Moore 90 0 0 29 Jul 2024
No Size Fits All: The Perils and Pitfalls of Leveraging LLMs Vary with Company Size Ashok Urlana Charaka Vinayak Kumar B. Garlapati Ajeet Kumar Singh Rahul Mishra 93 1 0 21 Jul 2024
Evaluating Language Models for Generating and Judging Programming Feedback Charles Koutcheme Nicola Dainese Arto Hellas Sami Sarsa Juho Leinonen Syed Ashraf Paul Denny ELM 60 5 0 05 Jul 2024
Program Synthesis Benchmark for Visual Programming in XLogoOnline Environment Chao Wen Jacqueline Staub Adish Singla ELM 106 3 0 17 Jun 2024
Benchmarking Generative Models on Computational Thinking Tests in Elementary Visual Programming Victor-Alexandru Pădurean Adish Singla ELM 117 4 0 14 Jun 2024
Evaluating Contextually Personalized Programming Exercises Created with Generative AI E. Logacheva Arto Hellas James Prather Sami Sarsa Juho Leinonen 128 11 0 11 Jun 2024
Hints-In-Browser: Benchmarking Language Models for Programming Feedback Generation Nachiket Kotalwar Alkis Gotovos Adish Singla ALM 120 4 0 07 Jun 2024
Benchmarking Educational Program Repair Charles Koutcheme Nicola Dainese Sami Sarsa Juho Leinonen Arto Hellas Paul Denny AI4Ed 86 5 0 08 May 2024
Open Source Language Models Can Provide Feedback: Evaluating LLMs' Ability to Help Students Using GPT-4-As-A-Judge Charles Koutcheme Nicola Dainese Sami Sarsa Arto Hellas Juho Leinonen Paul Denny ELM ALM 77 24 0 08 May 2024
Task Synthesis for Elementary Visual Programming in XLogoOnline Environment Chao Wen Ahana Ghosh Jacqueline Staub Adish Singla 73 3 0 03 May 2024
Generating Feedback-Ladders for Logical Errors in Programming using Large Language Models Hasnain Heickal Andrew Lan LRM 65 4 0 01 May 2024
Towards Generalizable Agents in Text-Based Educational Environments: A Study of Integrating RL with LLMs Bahar Radmehr Adish Singla Tanja Käser LLMAG AI4CE 79 6 0 29 Apr 2024
Evaluating the Effectiveness of LLMs in Introductory Computer Science Education: A Semester-Long Field Study Wenhan Lyu Yimeng Wang Tingting Rachel Chung Chung Yifan Sun Yixuan Zhang 132 38 0 20 Apr 2024
Enhancing Programming Education with ChatGPT: A Case Study on Student Perceptions and Interactions in a Python Course Boxaun Ma Li Chen Shin’ichi Konomi 64 8 0 20 Mar 2024
Evaluating the Application of Large Language Models to Generate Feedback in Programming Education Sven Jacobs Steffen Jaschke 78 14 0 13 Mar 2024
A systematic evaluation of large language models for generating programming code Wenpin Hou Zhicheng Ji ELM 105 2 0 01 Mar 2024
LLMs with Industrial Lens: Deciphering the Challenges and Prospects -- A Survey Ashok Urlana Charaka Vinayak Kumar Ajeet Kumar Singh B. Garlapati S. Chalamala Rahul Mishra 124 8 0 22 Feb 2024
AutoTutor meets Large Language Models: A Language Model Tutor with Rich Pedagogy and Guardrails Sankalan Pal Chowdhury Vilém Zouhar Mrinmaya Sachan AI4Ed LRM 75 18 0 14 Feb 2024
Using Large Language Models for Student-Code Guided Test Case Generation in Computer Science Education Nischal Ashok Kumar Andrew Lan AI4Ed ELM 64 7 0 11 Feb 2024
Generative AI for Education (GAIED): Advances, Opportunities, and Challenges Paul Denny Sumit Gulwani Neil T. Heffernan Tanja Käser Steven Moore Anna N. Rafferty Adish Singla 92 20 0 02 Feb 2024
Adapting Large Language Models for Education: Foundational Capabilities, Potentials, and Challenges Qingyao Li Lingyue Fu Weiming Zhang Xianyu Chen Jingwei Yu Wei Xia Weinan Zhang Ruiming Tang Yong Yu AI4Ed ELM 146 24 0 27 Dec 2023
User Modeling in the Era of Large Language Models: Current Research and Future Directions Zhaoxuan Tan Meng Jiang 118 12 0 11 Dec 2023
Anticipating User Needs: Insights from Design Fiction on Conversational Agents for Computational Thinking Jacob Penney João Felipe Pimentel Igor Steinmacher M. Gerosa AI4CE 68 6 0 12 Nov 2023
Large Language Models for In-Context Student Modeling: Synthesizing Student's Behavior in Visual Programming Manh Hung Nguyen Sebastian Tschiatschek Adish Singla AI4Ed 58 7 0 15 Oct 2023
Automating Human Tutor-Style Programming Feedback: Leveraging GPT-4 Tutor Model for Hint Generation and GPT-3.5 Student Model for Hint Validation Tung Phung Victor-Alexandru Pădurean Anjali Singh Christopher A. Brooks J. Cambronero Sumit Gulwani Adish Singla Gustavo Soares 89 47 0 05 Oct 2023
The Robots are Here: Navigating the Generative AI Revolution in Computing Education James Prather Paul Denny Juho Leinonen Brett A. Becker Ibrahim Albluwi ... Stephen MacNeil Andrew Petersen Raymond Pettit Brent N. Reeves Jaromír Šavelka 84 219 0 01 Oct 2023
Evaluating ChatGPT and GPT-4 for Visual Programming Adish Singla 99 21 0 30 Jul 2023
Neural Task Synthesis for Visual Programming Victor-Alexandru Pădurean Georgios Tzannetos Adish Singla 108 17 0 26 May 2023