Program Synthesis Benchmark for Visual Programming in XLogoOnline
Environment

Program Synthesis Benchmark for Visual Programming in XLogoOnline Environment

17 June 2024

Jacqueline Staub

ArXiv (abs)PDF HTML

Papers citing "Program Synthesis Benchmark for Visual Programming in XLogoOnline Environment"

13 / 13 papers shown

Title
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey Zeyu Han Chao Gao Jinyang Liu Jeff Zhang Sai Qian Zhang 257 398 0 21 Mar 2024
Generative AI for Education (GAIED): Advances, Opportunities, and Challenges Paul Denny Sumit Gulwani Neil T. Heffernan Tanja Käser Steven Moore Anna N. Rafferty Adish Singla 79 19 0 02 Feb 2024
Evaluating ChatGPT and GPT-4 for Visual Programming Adish Singla 81 21 0 30 Jul 2023
Generative AI for Programming Education: Benchmarking ChatGPT, GPT-4, and Human Tutors Tung Phung Victor-Alexandru Pădurean J. Cambronero Sumit Gulwani Tobias Kohn R. Majumdar Adish Singla Gustavo Soares ALM ELM 91 76 0 29 Jun 2023
PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about Change Karthik Valmeekam Matthew Marquez Alberto Olmo S. Sreedharan Subbarao Kambhampati ReLM LRM 105 237 0 21 Jun 2022
InCoder: A Generative Model for Code Infilling and Synthesis Daniel Fried Armen Aghajanyan Jessy Lin Sida I. Wang Eric Wallace Freda Shi Ruiqi Zhong Wen-tau Yih Luke Zettlemoyer M. Lewis SyDa 89 652 0 12 Apr 2022
Program Synthesis with Large Language Models Jacob Austin Augustus Odena Maxwell Nye Maarten Bosma Henryk Michalewski ... Ellen Jiang Carrie J. Cai Michael Terry Quoc V. Le Charles Sutton ELM AIMat ReCod ALM 216 2,009 0 16 Aug 2021
Evaluating Large Language Models Trained on Code Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Pondé ... Bob McGrew Dario Amodei Sam McCandlish Ilya Sutskever Wojciech Zaremba ELM ALM 238 5,665 0 07 Jul 2021
Measuring Coding Challenge Competence With APPS Dan Hendrycks Steven Basart Saurav Kadavath Mantas Mazeika Akul Arora ... Collin Burns Samir Puranik Horace He Basel Alomair Jacob Steinhardt ELM AIMat ALM 274 707 0 20 May 2021
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 420 5,000 0 24 Feb 2021
ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks Mohit Shridhar Jesse Thomason Daniel Gordon Yonatan Bisk Winson Han Roozbeh Mottaghi Luke Zettlemoyer Dieter Fox LM&Ro 124 781 0 03 Dec 2019
Touchdown: Natural Language Navigation and Spatial Reasoning in Visual Street Environments Howard Chen Alane Suhr Dipendra Kumar Misra Noah Snavely Yoav Artzi 86 390 0 29 Nov 2018
BabyAI: A Platform to Study the Sample Efficiency of Grounded Language Learning Maxime Chevalier-Boisvert Dzmitry Bahdanau Salem Lahlou Lucas Willems Chitwan Saharia Thien Huu Nguyen Yoshua Bengio ELM 106 241 0 18 Oct 2018