pix2code: Generating Code from a Graphical User Interface Screenshot

22 May 2017

Papers citing "pix2code: Generating Code from a Graphical User Interface Screenshot"

21 / 21 papers shown

Title
Multimodal graph representation learning for website generation based on visual sketch Tung D. Vu Chung Hoang Truong-Son Hy 3DV 56 0 0 25 Apr 2025
Unified Modeling Language Code Generation from Diagram Images Using Multimodal Large Language Models Averi Bates Ryan Vavricka Shane Carleton Ruosi Shao Chongle Pan 61 0 0 15 Mar 2025
Misty: UI Prototyping Through Interactive Conceptual Blending Yuwen Lu Alan Leung Amanda Swearngin Jeffrey Nichols Titus Barik 26 3 0 20 Sep 2024
Semantic GUI Scene Learning and Video Alignment for Detecting Duplicate Video-based Bug Reports Yanfu Yan Nathan Cooper Oscar Chaparro Kevin Moran Denys Poshyvanyk 46 5 0 11 Jul 2024
Automatically Generating UI Code from Screenshot: A Divide-and-Conquer-Based Approach Yuxuan Wan Chaozheng Wang Yi Dong Wenxuan Wang Shuqing Li Yintong Huo M. Lyu 3DV 76 10 0 24 Jun 2024
AI Assistance for UX: A Literature Review Through Human-Centered AI Yuwen Lu Yuewen Yang Qinyi Zhao Chengzhi Zhang Toby Jia-Jun Li 24 16 0 08 Feb 2024
EGFE: End-to-end Grouping of Fragmented Elements in UI Designs with Multimodal Learning Liuqing Chen Yunnong Chen Shuhong Xiao Yaxuan Song Lingyun Sun Yankun Zhen Tingting Zhou Yan-fang Chang 49 4 0 18 Sep 2023
Neural Machine Translation for Code Generation K. Dharma Clayton T. Morrison 32 4 0 22 May 2023
UI Layers Group Detector: Grouping UI Layers via Text Fusion and Box Attention Shuhong Xiao Tingting Zhou Yunnong Chen Dengming Zhang Liuqing Chen Lingyun Sun Shiyu Yue 21 4 0 07 Dec 2022
UI Layers Merger: Merging UI layers via Visual Learning and Boundary Prior Yunnong Chen Yankun Zhen Chuhao Shi Jiazhi Li Liuqing Chen Z. Li Lingyun Sun Tingting Zhou Yan-fang Chang 37 4 0 18 Jun 2022
Psychologically-Inspired, Unsupervised Inference of Perceptual Groups of GUI Widgets from GUI Images Mulong Xie Zhenchang Xing Sidong Feng Chunyang Chen Liming Zhu Xiwei Xu 29 28 0 15 Jun 2022
A Survey on Artificial Intelligence for Source Code: A Dialogue Systems Perspective Erfan Al-Hossami Samira Shaikh 32 6 0 10 Feb 2022
Screen Parsing: Towards Reverse Engineering of UI Models from Screenshots Jason Wu Xiaoyi Zhang Jeffrey Nichols Jeffrey P. Bigham 3DV 163 71 0 17 Sep 2021
Automatic code generation from sketches of mobile applications in end-user development using Deep Learning Daniel Baulé Christiane Gresse von Wangenheim A. V. Wangenheim J. Hauck Edson C. Vargas Júnior 3DV 15 5 0 09 Mar 2021
VINS: Visual Search for Mobile User Interface Design Sara Bunian Kai Li Chaima Jemmali Casper Harteveld Y. Fu M. S. El-Nasr 30 109 0 10 Feb 2021
GUIGAN: Learning to Generate GUI Designs Using Generative Adversarial Networks Tianming Zhao Chunyang Chen Yuanning Liu Xiaodong Zhu Jilin University 29 56 0 25 Jan 2021
Multi-Plane Program Induction with 3D Box Priors Yikai Li Jiayuan Mao Xiuming Zhang Bill Freeman J. Tenenbaum Noah Snavely Jiajun Wu 18 17 0 19 Nov 2020
Translating Video Recordings of Mobile App Usages into Replayable Scenarios Carlos Bernal-Cárdenas Nathan Cooper Kevin Moran Oscar Chaparro Andrian Marcus Denys Poshyvanyk 23 64 0 18 May 2020
Sketch2Code: Transformation of Sketches to UI in Real-time Using Deep Neural Network Vanita Jain P. Agrawal Subham Banga R. Kapoor Shashwat Gulyani 13 30 0 20 Oct 2019
Sketch2code: Generating a website from a paper mockup Alex Robinson 3DV 22 36 0 09 May 2019
Machine Learning-Based Prototyping of Graphical User Interfaces for Mobile Apps Kevin Moran Carlos Bernal-Cárdenas Michael Curcio R. Bonett Denys Poshyvanyk 32 202 0 07 Feb 2018