Thrilled by Your Progress! Large Language Models (GPT-4) No Longer Struggle to Pass Assessments in Higher Education Programming Courses

15 June 2023

Papers citing "Thrilled by Your Progress! Large Language Models (GPT-4) No Longer Struggle to Pass Assessments in Higher Education Programming Courses"

44 / 44 papers shown

Title
"All Roads Lead to ChatGPT": How Generative AI is Eroding Social Interactions and Student Learning Communities Irene Hou Owen Man Kate Hamilton Srishty Muthusekaran Jeffin Johnykutty Leili Zadeh Stephen MacNeil 30 0 0 14 Apr 2025
Design of AI-Powered Tool for Self-Regulation Support in Programming Education Huiyong Li Boxuan Ma AI4Ed 46 0 0 03 Apr 2025
Using Large Language Models for education managements in Vietnamese with low resources Duc Do Minh Vinh Nguyen Van Thang Dam Cong 43 0 0 28 Jan 2025
Beyond the Hype: A Comprehensive Review of Current Trends in Generative AI Research, Teaching Practices, and Tools James Prather Juho Leinonen Natalie Kiesler Jamie Gorson Benario Sam Lau ... Brent N. Reeves Jaromír Šavelka David H Smith IV Sven Strickroth Daniel Zingaro 81 5 0 19 Dec 2024
Breaking the Programming Language Barrier: Multilingual Prompting to Empower Non-Native English Learners James Prather B. Reeves Paul Denny Juho Leinonen Stephen MacNeil ... Thezyrie Amarouche Bailey Kimmel Jared Wright Musa Blake Gweneth Barbre 74 2 0 17 Dec 2024
Seeing the Forest and the Trees: Solving Visual Graph and Tree Based Data Structure Problems using Large Multimodal Models S. Gutierrez Irene Hou Jihye Lee Kenneth Angelikas Owen Man Sophia Mettille James Prather Paul Denny Stephen MacNeil 71 1 0 15 Dec 2024
An Eye for an AI: Evaluating GPT-4o's Visual Perception Skills and Geometric Reasoning Skills Using Computer Graphics Questions Tony Haoran Feng Paul Denny Burkhard C. Wünsche Andrew Luxton-Reilly Jacqueline Whalley 23 3 0 22 Oct 2024
Large Language Models in Computer Science Education: A Systematic Literature Review Nishat Raihan Mohammed Latif Siddiq Joanna C. S. Santos Marcos Zampieri ELM AI4CE 21 7 0 21 Oct 2024
Exploring the Design Space of Cognitive Engagement Techniques with AI-Generated Code for Enhanced Learning Majeed Kazemitabaar Oliver Huang Sangho Suh Austin Z. Henley Tovi Grossman 34 4 0 11 Oct 2024
Does GPT Really Get It? A Hierarchical Scale to Quantify Human vs AI's Understanding of Algorithms Mirabel Reid Santosh Vempala ELM 35 0 0 20 Jun 2024
Benchmarking Generative Models on Computational Thinking Tests in Elementary Visual Programming Victor-Alexandru Pădurean Adish Singla ELM 54 3 0 14 Jun 2024
Insights from Social Shaping Theory: The Appropriation of Large Language Models in an Undergraduate Programming Course Aadarsh Padiyath Xinying Hou Amy Pang Diego Viramontes Vargas Xingjian Gu Tamara Nelson-Fromm Zihan Wu M. Guzdial B. Ericson 38 17 0 10 Jun 2024
The Widening Gap: The Benefits and Harms of Generative AI for Novice Programmers James Prather Brent N. Reeves Juho Leinonen Stephen MacNeil Arisoa S. Randrianasolo Brett A. Becker Bailey Kimmel Jared Wright Ben Briggs 40 51 0 28 May 2024
Desirable Characteristics for AI Teaching Assistants in Programming Education Paul Denny Stephen MacNeil Jaromír Šavelka Leo Porter Andrew Luxton-Reilly 37 27 0 23 May 2024
Open Source Language Models Can Provide Feedback: Evaluating LLMs' Ability to Help Students Using GPT-4-As-A-Judge Charles Koutcheme Nicola Dainese Sami Sarsa Arto Hellas Juho Leinonen Paul Denny ELM ALM 47 22 0 08 May 2024
"ChatGPT Is Here to Help, Not to Replace Anybody" -- An Evaluation of Students' Opinions On Integrating ChatGPT In CS Courses Bruno Pereira Cipriano P. Alves 39 9 0 26 Apr 2024
Large Language Models for Education: A Survey and Outlook Shen Wang Tianlong Xu Hang Li Chaoli Zhang Joleen Liang Jiliang Tang Philip S. Yu Qingsong Wen AI4Ed 41 94 0 26 Mar 2024
A Picture Is Worth a Thousand Words: Exploring Diagram and Video-Based OOP Exercises to Counter LLM Over-Reliance Bruno Pereira Cipriano P. Alves Paul Denny 31 0 0 13 Mar 2024
Explaining Code with a Purpose: An Integrated Approach for Developing Code Comprehension and Prompting Skills Paul Denny IV DavidH.Smith Max Fowler James Prather Brett A. Becker Juho Leinonen 18 24 0 10 Mar 2024
Enhancing Programming Error Messages in Real Time with Generative AI Bailey Kimmel Austin Geisert Lily Yaro Brendan Gipson Ronald Taylor Hotchkiss Sidney Osae-Asante Hunter Vaught Grant Wininger Chase Yamaguchi 29 12 0 12 Feb 2024
Learning Agent-based Modeling with LLM Companions: Experiences of Novices and Experts Using ChatGPT & NetLogo Chat John Chen Xi Lu Michael Rejtig Yuzhou Du Ruth Bagley Mike Horn Uri Wilensky 34 29 0 30 Jan 2024
QACP: An Annotated Question Answering Dataset for Assisting Chinese Python Programming Learners Rui Xiao Lu Han Xiaoying Zhou Jiong Wang Na Zong Pengyu Zhang AI4Ed 40 1 0 30 Jan 2024
CodeAid: Evaluating a Classroom Deployment of an LLM-based Programming Assistant that Balances Student and Educator Needs Majeed Kazemitabaar Runlong Ye Xiaoning Wang Austin Z. Henley Paul Denny Michelle Craig Tovi Grossman AI4Ed ELM 38 109 0 20 Jan 2024
Interactions with Prompt Problems: A New Way to Teach Programming with Large Language Models James Prather Paul Denny Juho Leinonen IV DavidH.Smith Brent N. Reeves Stephen MacNeil Brett A. Becker Andrew Luxton-Reilly Thezyrie Amarouche Bailey Kimmel AI4Ed 31 5 0 19 Jan 2024
A Philosophical Introduction to Language Models -- Part I: Continuity With Classic Debates Raphael Milliere Cameron Buckner LRM ELM 41 20 0 08 Jan 2024
The Effects of Generative AI on Computing Students' Help-Seeking Preferences Irene Hou Sophia Mettille Zhuo Li Owen Man Cynthia Zastudil Stephen MacNeil 38 41 0 04 Jan 2024
A Comparative Study of AI-Generated (GPT-4) and Human-crafted MCQs in Programming Education J. Doughty Zipiao Wan Anishka Bompelli Jubahed Qayum Taozhi Wang ... Christopher Bogart Eric Keylor Can Kultur Jaromír Šavelka M. Sakr ELM 40 69 0 05 Dec 2023
Decoding Logic Errors: A Comparative Study on Bug Detection by Students and Large Language Models Stephen MacNeil Paul Denny Andrew Tran Juho Leinonen Seth Bernstein Arto Hellas Sami Sarsa Joanne Kim LRM 28 16 0 27 Nov 2023
More Robots are Coming: Large Multimodal Models (ChatGPT) can Solve Visually Diverse Images of Parsons Problems Irene Hou Owen Man Sophia Mettille Sebastian Gutierrez Kenneth Angelikas Stephen MacNeil 31 22 0 03 Nov 2023
Efficient Classification of Student Help Requests in Programming Courses Using Large Language Models Jaromír Šavelka Paul Denny Mark H. Liffiton Brad Sheese AI4Ed 28 6 0 31 Oct 2023
AI-enhanced Auto-correction of Programming Exercises: How Effective is GPT-3.5? Imen Azaiz Oliver Deckarm Sven Strickroth 48 18 0 24 Oct 2023
How to Teach Programming in the AI Era? Using LLMs as a Teachable Agent for Debugging Qianou Ma Hua Shen Kenneth R. Koedinger Tongshuang Wu LLMAG ELM 30 28 0 08 Oct 2023
The Robots are Here: Navigating the Generative AI Revolution in Computing Education James Prather Paul Denny Juho Leinonen Brett A. Becker Ibrahim Albluwi ... Stephen MacNeil Andrew Petersen Raymond Pettit Brent N. Reeves Jaromír Šavelka 36 193 0 01 Oct 2023
Learning from Teaching Assistants to Program with Subgoals: Exploring the Potential for AI Teaching Assistants Changyoon Lee Jun-Hee Myung Jieun Han Jiho Jin Alice H. Oh 34 8 0 19 Sep 2023
Harnessing LLMs in Curricular Design: Using GPT-4 to Support Authoring of Learning Objectives Pragnya Sridhar Aidan Doyle Arav Agarwal Chris Bogart Jaromír Šavelka M. Sakr 42 43 0 30 Jun 2023
A Preliminary Analysis on the Code Generation Capabilities of GPT-3.5 and Bard AI Models for Java Functions Giuseppe Destefanis Silvia Bartolucci Marco Ortu ELM 41 22 0 16 May 2023
Sparks of Artificial General Intelligence: Early experiments with GPT-4 Sébastien Bubeck Varun Chandrasekaran Ronen Eldan J. Gehrke Eric Horvitz ... Scott M. Lundberg Harsha Nori Hamid Palangi Marco Tulio Ribeiro Yi Zhang ELM AI4MH AI4CE ALM 322 3,021 0 22 Mar 2023
Large Language Models (GPT) Struggle to Answer Multiple-Choice Questions about Code Jaromír Šavelka Arav Agarwal Chris Bogart M. Sakr ELM 60 50 0 09 Mar 2023
Leveraging Large Language Models for Multiple Choice Question Answering Joshua Robinson Christopher Rytting David Wingate ELM 146 186 0 22 Oct 2022
Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering Pan Lu Swaroop Mishra Tony Xia Liang Qiu Kai-Wei Chang Song-Chun Zhu Oyvind Tafjord Peter Clark Ashwin Kalyan ELM ReLM LRM 211 1,113 0 20 Sep 2022
Automatic Generation of Programming Exercises and Code Explanations using Large Language Models Sami Sarsa Paul Denny Arto Hellas Juho Leinonen ELM 99 342 0 03 Jun 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 339 12,003 0 04 Mar 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 395 8,559 0 28 Jan 2022
Making Pre-trained Language Models Better Few-shot Learners Tianyu Gao Adam Fisch Danqi Chen 243 1,924 0 31 Dec 2020