ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2406.16386
  4. Cited By
Automatically Generating UI Code from Screenshot: A Divide-and-Conquer-Based Approach
v1v2v3 (latest)

Automatically Generating UI Code from Screenshot: A Divide-and-Conquer-Based Approach

24 June 2024
Yuxuan Wan
Chaozheng Wang
Yi Dong
Wenxuan Wang
Shuqing Li
Yintong Huo
Michael R. Lyu
    3DV
ArXiv (abs)PDFHTML

Papers citing "Automatically Generating UI Code from Screenshot: A Divide-and-Conquer-Based Approach"

35 / 35 papers shown
Title
DesignBench: A Comprehensive Benchmark for MLLM-based Front-end Code Generation
DesignBench: A Comprehensive Benchmark for MLLM-based Front-end Code Generation
Jingyu Xiao
Ming Wang
Man Ho Lam
Yuxuan Wan
Junliang Liu
Yintong Huo
Michael R. Lyu
53
1
0
06 Jun 2025
PixelWeb: The First Web GUI Dataset with Pixel-Wise Labels
PixelWeb: The First Web GUI Dataset with Pixel-Wise Labels
Qi Yang
Weichen Bi
Haiyang Shen
Y. Guo
Yudong Han
105
0
0
23 Apr 2025
Interaction2Code: Benchmarking MLLM-based Interactive Webpage Code Generation from Interactive Prototyping
Interaction2Code: Benchmarking MLLM-based Interactive Webpage Code Generation from Interactive Prototyping
Jingyu Xiao
Yuxuan Wan
Yintong Huo
Zihan Wang
Xinyi Xu
Wenxuan Wang
Zhiyao Xu
Yansen Wang
Michael R. Lyu
179
0
0
21 Feb 2025
Can't See the Forest for the Trees: Benchmarking Multimodal Safety Awareness for Multimodal LLMs
Can't See the Forest for the Trees: Benchmarking Multimodal Safety Awareness for Multimodal LLMs
Wenxuan Wang
Xiaoyuan Liu
Kuiyi Gao
Jen-tse Huang
Youliang Yuan
Pinjia He
Shuai Wang
Zhaopeng Tu
114
2
0
16 Feb 2025
DynEx: Dynamic Code Synthesis with Structured Design Exploration for
  Accelerated Exploratory Programming
DynEx: Dynamic Code Synthesis with Structured Design Exploration for Accelerated Exploratory Programming
Jenny Ma
Karthik Sreedhar
Vivian Liu
Sitong Wang
Pedro Alejandro Perez
Riya Sahni
Lydia B. Chilton
87
2
0
01 Oct 2024
InternLM-XComposer-2.5: A Versatile Large Vision Language Model
  Supporting Long-Contextual Input and Output
InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output
Pan Zhang
Xiaoyi Dong
Yuhang Zang
Yuhang Cao
Rui Qian
...
Kai Chen
Jifeng Dai
Yu Qiao
Dahua Lin
Jiaqi Wang
146
117
0
03 Jul 2024
Language Models as Compilers: Simulating Pseudocode Execution Improves
  Algorithmic Reasoning in Language Models
Language Models as Compilers: Simulating Pseudocode Execution Improves Algorithmic Reasoning in Language Models
Hyungjoo Chae
Yeonghyeon Kim
Seungone Kim
Kai Tzu-iunn Ong
Beong-woo Kwak
...
Seonghwan Kim
Taeyoon Kwon
Jiwan Chung
Youngjae Yu
Jinyoung Yeo
LRMReLM
78
16
0
03 Apr 2024
Unlocking the conversion of Web Screenshots into HTML Code with the
  WebSight Dataset
Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Dataset
Hugo Laurençon
Léo Tronchon
Victor Sanh
VLM
95
43
0
14 Mar 2024
Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMs
Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMs
Shengbang Tong
Zhuang Liu
Yuexiang Zhai
Yi-An Ma
Yann LeCun
Saining Xie
VLMMLLM
176
349
0
11 Jan 2024
The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)
The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)
Zhengyuan Yang
Linjie Li
Kevin Qinghong Lin
Jianfeng Wang
Chung-Ching Lin
Nasim Shakouri Mahmoudabadi
Lijuan Wang
LM&MA
116
647
0
29 Sep 2023
ClassEval: A Manually-Crafted Benchmark for Evaluating LLMs on
  Class-level Code Generation
ClassEval: A Manually-Crafted Benchmark for Evaluating LLMs on Class-level Code Generation
Xueying Du
Wentai Deng
Kaixin Wang
Hanlin Wang
Junwei Liu
Yixuan Chen
Jiayi Feng
Chaofeng Sha
Xin Peng
Xin Peng
ELMALM
88
153
0
03 Aug 2023
A Survey on Multimodal Large Language Models
A Survey on Multimodal Large Language Models
Shukang Yin
Chaoyou Fu
Sirui Zhao
Ke Li
Xing Sun
Tong Xu
Enhong Chen
MLLMLRM
154
615
0
23 Jun 2023
AlpacaFarm: A Simulation Framework for Methods that Learn from Human
  Feedback
AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedback
Yann Dubois
Xuechen Li
Rohan Taori
Tianyi Zhang
Ishaan Gulrajani
Jimmy Ba
Carlos Guestrin
Percy Liang
Tatsunori B. Hashimoto
ALM
156
608
0
22 May 2023
LIMA: Less Is More for Alignment
LIMA: Less Is More for Alignment
Chunting Zhou
Pengfei Liu
Puxin Xu
Srini Iyer
Jiao Sun
...
Susan Zhang
Gargi Ghosh
M. Lewis
Luke Zettlemoyer
Omer Levy
ALM
153
856
0
18 May 2023
InstructBLIP: Towards General-purpose Vision-Language Models with
  Instruction Tuning
InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning
Wenliang Dai
Junnan Li
Dongxu Li
A. M. H. Tiong
Junqi Zhao
Weisheng Wang
Boyang Albert Li
Pascale Fung
Steven C. H. Hoi
MLLMVLM
276
2,105
0
11 May 2023
Semantic Compression With Large Language Models
Semantic Compression With Large Language Models
Henry Gilbert
Michael Sandborn
Douglas C. Schmidt
Jesse Spencer-Smith
Jules White
54
23
0
25 Apr 2023
Teaching Large Language Models to Self-Debug
Teaching Large Language Models to Self-Debug
Xinyun Chen
Maxwell Lin
Nathanael Scharli
Denny Zhou
LRM
164
711
0
11 Apr 2023
Exploring Distributional Shifts in Large Language Models for Code
  Analysis
Exploring Distributional Shifts in Large Language Models for Code Analysis
Shushan Arakelyan
Rocktim Jyoti Das
Yi Mao
Xiang Ren
ALM
105
21
0
16 Mar 2023
PaLM-E: An Embodied Multimodal Language Model
PaLM-E: An Embodied Multimodal Language Model
Danny Driess
F. Xia
Mehdi S. M. Sajjadi
Corey Lynch
Aakanksha Chowdhery
...
Marc Toussaint
Klaus Greff
Andy Zeng
Igor Mordatch
Peter R. Florence
LM&Ro
165
1,679
0
06 Mar 2023
Program of Thoughts Prompting: Disentangling Computation from Reasoning
  for Numerical Reasoning Tasks
Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Tasks
Wenhu Chen
Xueguang Ma
Xinyi Wang
William W. Cohen
ReLMReCodLRM
400
829
0
22 Nov 2022
On the Transferability of Pre-trained Language Models for Low-Resource
  Programming Languages
On the Transferability of Pre-trained Language Models for Low-Resource Programming Languages
Fuxiang Chen
F. Fard
David Lo
T. Bryksin
81
49
0
05 Apr 2022
CodeGen: An Open Large Language Model for Code with Multi-Turn Program
  Synthesis
CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis
Erik Nijkamp
Bo Pang
Hiroaki Hayashi
Lifu Tu
Haiquan Wang
Yingbo Zhou
Silvio Savarese
Caiming Xiong
ELM
202
1,057
0
25 Mar 2022
Assemble Foundation Models for Automatic Code Summarization
Assemble Foundation Models for Automatic Code Summarization
Jian Gu
P. Salza
H. Gall
101
36
0
13 Jan 2022
Screen Parsing: Towards Reverse Engineering of UI Models from
  Screenshots
Screen Parsing: Towards Reverse Engineering of UI Models from Screenshots
Jason Wu
Xiaoyi Zhang
Jeffrey Nichols
Jeffrey P. Bigham
3DV
188
72
0
17 Sep 2021
Evaluating Large Language Models Trained on Code
Evaluating Large Language Models Trained on Code
Mark Chen
Jerry Tworek
Heewoo Jun
Qiming Yuan
Henrique Pondé
...
Bob McGrew
Dario Amodei
Sam McCandlish
Ilya Sutskever
Wojciech Zaremba
ELMALM
307
5,702
0
07 Jul 2021
Multimodal Few-Shot Learning with Frozen Language Models
Multimodal Few-Shot Learning with Frozen Language Models
Maria Tsimpoukelli
Jacob Menick
Serkan Cabi
S. M. Ali Eslami
Oriol Vinyals
Felix Hill
MLLM
272
792
0
25 Jun 2021
Learning Transferable Visual Models From Natural Language Supervision
Learning Transferable Visual Models From Natural Language Supervision
Alec Radford
Jong Wook Kim
Chris Hallacy
Aditya A. Ramesh
Gabriel Goh
...
Amanda Askell
Pamela Mishkin
Jack Clark
Gretchen Krueger
Ilya Sutskever
CLIPVLM
1.1K
30,116
0
26 Feb 2021
VisualGPT: Data-efficient Adaptation of Pretrained Language Models for
  Image Captioning
VisualGPT: Data-efficient Adaptation of Pretrained Language Models for Image Captioning
Jun Chen
Han Guo
Kai Yi
Boyang Albert Li
Mohamed Elhoseiny
VLM
166
227
0
20 Feb 2021
CodeBLEU: a Method for Automatic Evaluation of Code Synthesis
CodeBLEU: a Method for Automatic Evaluation of Code Synthesis
Shuo Ren
Daya Guo
Shuai Lu
Long Zhou
Shujie Liu
Duyu Tang
Neel Sundaresan
M. Zhou
Ambrosio Blanco
Shuai Ma
ELM
169
546
0
22 Sep 2020
Code Generation as a Dual Task of Code Summarization
Code Generation as a Dual Task of Code Summarization
Bolin Wei
Ge Li
Xin Xia
Zhiyi Fu
Zhi Jin
85
226
0
14 Oct 2019
Tranco: A Research-Oriented Top Sites Ranking Hardened Against
  Manipulation
Tranco: A Research-Oriented Top Sites Ranking Hardened Against Manipulation
Victor Le Pochat
Tom van Goethem
Samaneh Tajalizadehkhoob
Maciej Korczyński
Wouter Joosen
111
659
0
04 Jun 2018
Learning to Mine Aligned Code and Natural Language Pairs from Stack
  Overflow
Learning to Mine Aligned Code and Natural Language Pairs from Stack Overflow
Pengcheng Yin
Bowen Deng
Edgar Chen
Bogdan Vasilescu
Graham Neubig
91
305
0
23 May 2018
Machine Learning-Based Prototyping of Graphical User Interfaces for
  Mobile Apps
Machine Learning-Based Prototyping of Graphical User Interfaces for Mobile Apps
Kevin Moran
Carlos Bernal-Cárdenas
Michael Curcio
R. Bonett
Denys Poshyvanyk
97
208
0
07 Feb 2018
pix2code: Generating Code from a Graphical User Interface Screenshot
pix2code: Generating Code from a Graphical User Interface Screenshot
Tony Beltramelli
80
277
0
22 May 2017
Sequence to Sequence Learning with Neural Networks
Sequence to Sequence Learning with Neural Networks
Ilya Sutskever
Oriol Vinyals
Quoc V. Le
AIMat
586
20,640
0
10 Sep 2014
1