A Large-Scale Survey on the Usability of AI Programming Assistants: Successes and Challenges

30 March 2023

Chenyang Yang

Papers citing "A Large-Scale Survey on the Usability of AI Programming Assistants: Successes and Challenges"

37 / 37 papers shown

Title
Are Large Language Models Robust in Understanding Code Against Semantics-Preserving Mutations? Pedro Orvalho Marta Kwiatkowska LRM ELM 34 0 0 15 May 2025
Leveraging AI for Productive and Trustworthy HPC Software: Challenges and Research Directions K. Teranishi Harshitha Menon William F. Godoy Prasanna Balaprakash David Bau ... Swaroop Pophale Pedro Valero-Lara Jeffrey S. Vetter Samuel Williams Aaron R. Young 33 0 0 13 May 2025
Large Language Models are Qualified Benchmark Builders: Rebuilding Pre-Training Datasets for Advancing Code Intelligence Tasks Kang Yang Xinjun Mao Shangwen Wang Yunhong Wang Tanghaoran Zhang Bo Lin Yihao Qin Zhang Zhang Yao Lu Kamal Al-Sabahi ALM 170 1 0 28 Apr 2025
Do It For Me vs. Do It With Me: Investigating User Perceptions of Different Paradigms of Automation in Copilots for Feature-Rich Software Anjali Khurana Xiaotian Su April Yi Wang Parmit K. Chilana 43 1 0 22 Apr 2025
On Simulation-Guided LLM-based Code Generation for Safe Autonomous Driving Software Ali Nouri Johan Andersson Kailash De Jesus Hornig Zhennan Fei Emil Knabe H.akan Sivencrona Beatriz Cabrero-Daniel Christian Berger 31 0 0 02 Apr 2025
Junior Software Developers' Perspectives on Adopting LLMs for Software Engineering: a Systematic Literature Review Samuel Ferino Rashina Hoda John Grundy Christoph Treude 72 0 0 10 Mar 2025
The Impact of Generative AI Coding Assistants on Developers Who Are Visually Impaired Claudia Flores-Saviaga Benjamin V. Hanrahan Kashif Imteyaz Steven Clarke Saiph Savage 47 0 0 10 Mar 2025
From Idea to Implementation: Evaluating the Influence of Large Language Models in Software Development -- An Opinion Paper Sargam Yadav Asifa Mehmood Qureshi Abhishek Kaushik Shubham Sharma Roisin Loughran ... . Nikhil Singh Padraic O'Hara Pranay Jaiswal Roshan Chandru David Lillis 56 1 0 10 Mar 2025
Assessing LLMs for Front-end Software Architecture Knowledge L. P. Franciscatto Guerra N. Ernst 71 0 0 26 Feb 2025
Assistance or Disruption? Exploring and Evaluating the Design and Trade-offs of Proactive AI Programming Support Kevin Pu Daniel Lazaro Ian Arawjo Haijun Xia Ziang Xiao Tovi Grossman Yan Chen 70 1 0 25 Feb 2025
Software Engineering and Foundation Models: Insights from Industry Blogs Using a Jury of Foundation Models Hao Li C. Bezemer Ahmed E. Hassan 45 2 0 08 Jan 2025
Insights from the Frontline: GenAI Utilization Among Software Engineering Students Rudrajit Choudhuri Ambareesh Ramakrishnan Amreeta Chatterjee Bianca Trinkenreich Igor Steinmacher M. Gerosa Anita Sarma 96 3 0 20 Dec 2024
Beyond the Hype: A Comprehensive Review of Current Trends in Generative AI Research, Teaching Practices, and Tools James Prather Juho Leinonen Natalie Kiesler Jamie Gorson Benario Sam Lau ... Brent N. Reeves Jaromír Šavelka David H Smith IV Sven Strickroth Daniel Zingaro 81 6 0 19 Dec 2024
Survey of User Interface Design and Interaction Techniques in Generative AI Applications Reuben Luera Ryan Rossi Alexa F. Siu Franck Dernoncourt Tong Yu ... Hanieh Salehy Jian Zhao Samyadeep Basu Puneet Mathur Nedim Lipka AI4TS 68 1 0 28 Oct 2024
How much does AI impact development speed? An enterprise-based randomized controlled trial Elise Paradis Kate Grey Quinn Madison Daye Nam A. Macvean Vahid Meimand Nan Zhang Ben Ferrari-Church Satish Chandra 43 1 0 16 Oct 2024
Generalized Adversarial Code-Suggestions: Exploiting Contexts of LLM-based Code-Completion Karl Rubel Maximilian Noppel Christian Wressnegger AAML SILM 28 0 0 14 Oct 2024
The Design Space of in-IDE Human-AI Experience Agnia Sergeyuk Ekaterina Koshchenko Ilya Zakharov T. Bryksin Maliheh Izadi 29 4 0 11 Oct 2024
Constraint representation towards precise data-driven storytelling Yu-Zhe Shi Haotian Li Lecheng Ruan Huamin Qu 61 3 0 10 Oct 2024
CursorCore: Assist Programming through Aligning Anything Hao Jiang Qi Liu Rui Li Shengyu Ye Shijin Wang 55 1 0 09 Oct 2024
Need Help? Designing Proactive AI Assistants for Programming Valerie Chen Alan Zhu Sebastian Zhao Hussein Mozannar David Sontag Ameet Talwalkar 44 5 0 06 Oct 2024
Can Developers Prompt? A Controlled Experiment for Code Documentation Generation L. Herrmann Tim Puhlfürß Felix Dietrich 36 3 0 01 Aug 2024
Test Case Features as Hyper-heuristics for Inductive Programming Edward McDaid S. McDaid 29 0 0 29 Jun 2024
We Have a Package for You! A Comprehensive Analysis of Package Hallucinations by Code Generating LLMs Joseph Spracklen Raveen Wijewickrama A. H. M. N. Sakib Anindya Maiti Murtuza Jadliwala Murtuza Jadliwala 48 9 0 12 Jun 2024
Using AI-Based Coding Assistants in Practice: State of Affairs, Perceptions, and Ways Forward Agnia Sergeyuk Yaroslav Golubev T. Bryksin Iftekhar Ahmed 67 11 0 11 Jun 2024
RLSF: Reinforcement Learning via Symbolic Feedback Piyush Jha Prithwish Jana Arnav Arora Vijay Ganesh LRM 49 3 0 26 May 2024
ChatGPT in Data Visualization Education: A Student Perspective Nam Wook Kim Hyung-Kwon Ko Grace Myers Benjamin Bach 51 6 0 01 May 2024
Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineering Chenglei Si Yanzhe Zhang Zhengyuan Yang Zhengyuan Yang Ruibo Liu Diyi Yang 27 1 0 05 Mar 2024
Ivie: Lightweight Anchored Explanations of Just-Generated Code Litao Yan Alyssa Hwang Zhiyuan Wu Andrew Head 34 21 0 04 Mar 2024
Rocks Coding, Not Development--A Human-Centric, Experimental Evaluation of LLM-Supported SE Tasks Wei Wang Huilong Ning Gaowei Zhang Libo Liu Yi Wang 36 11 0 08 Feb 2024
How Beginning Programmers and Code LLMs (Mis)read Each Other S. Nguyen Hannah McLean Babe Yangtian Zi Arjun Guha C. Anderson Molly Q. Feldman 38 43 0 26 Jan 2024
Poisoned ChatGPT Finds Work for Idle Hands: Exploring Developers' Coding Practices with Insecure Suggestions from Poisoned AI Models Sanghak Oh Kiho Lee Seonhye Park Doowon Kim Hyoungshick Kim SILM 29 16 0 11 Dec 2023
Can GPT-4 Replicate Empirical Software Engineering Research? Jenny T Liang Carmen Badea Christian Bird R. Deline Denae Ford Nicole Forsgren Thomas Zimmermann 59 10 0 03 Oct 2023
How Do Analysts Understand and Verify AI-Assisted Data Analyses? Ken Gu Ruoxi Shang Tim Althoff Chenglong Wang Steven Drucker AAML 51 25 0 19 Sep 2023
Grounded Copilot: How Programmers Interact with Code-Generating Models Shraddha Barke M. James Nadia Polikarpova 169 212 0 30 Jun 2022
Productivity Assessment of Neural Code Completion Albert Ziegler Eirini Kalliamvakou Shawn Simister Ganesh Sittampalam Alice Li Andrew Rice Devon Rifkin E. Aftandilian 102 178 0 13 May 2022
A Systematic Evaluation of Large Language Models of Code Frank F. Xu Uri Alon Graham Neubig Vincent J. Hellendoorn ELM ALM 204 633 0 26 Feb 2022
Leaving My Fingerprints: Motivations and Challenges of Contributing to OSS for Social Good Yu Huang Denae Ford Thomas Zimmermann 53 31 0 26 Apr 2021