VINS: Visual Search for Mobile User Interface Design

10 February 2021

Papers citing "VINS: Visual Search for Mobile User Interface Design"

45 / 45 papers shown

Title
PixelWeb: The First Web GUI Dataset with Pixel-Wise Labels Qi Yang Weichen Bi Haiyang Shen Y. Guo Yun Ma 37 0 0 23 Apr 2025
Explorer: Robust Collection of Interactable GUI Elements Iason Chaimalas Arnas Vyšniauskas Gabriel Brostow 31 0 0 12 Apr 2025
Towards Human-AI Synergy in UI Design: Enhancing Multi-Agent Based UI Generation with Intent Clarification and Alignment M. Yuan Jieshan Chen Yongquan Hu Sidong Feng Mulong Xie Gelareh Mohammadi Zhenchang Xing Aaron Quigley LLMAG 46 1 0 28 Dec 2024
TA3: Testing Against Adversarial Attacks on Machine Learning Models Yuanzhe Jin Min Chen 33 0 0 06 Oct 2024
DreamStruct: Understanding Slides and User Interfaces via Synthetic Data Generation Yi-Hao Peng Faria Huq Yue Jiang Jason Wu Amanda Li Jeffrey P. Bigham Amy Pavel DiffM 35 4 0 30 Sep 2024
Misty: UI Prototyping Through Interactive Conceptual Blending Yuwen Lu Alan Leung Amanda Swearngin Jeffrey Nichols Titus Barik 26 3 0 20 Sep 2024
PeriGuru: A Peripheral Robotic Mobile App Operation Assistant based on GUI Image Understanding and Prompting with LLM Kelin Fu Yang Tian Kaigui Bian 26 0 0 14 Sep 2024
GUI Element Detection Using SOTA YOLO Deep Learning Models Seyed Shayan Daneshvar Shaowei Wang 19 1 0 07 Aug 2024
MAxPrototyper: A Multi-Agent Generation System for Interactive User Interface Prototyping Mingyue Yuan Jieshan Chen Aaron Quigley LLMAG 40 5 0 12 May 2024
MUD: Towards a Large-Scale and Noise-Filtered UI Dataset for Modern Style UI Modeling Sidong Feng Suyu Ma Han Wang David Kong Chunyang Chen 42 9 0 11 May 2024
GUing: A Mobile GUI Search Engine using a Vision-Language Model Jialiang Wei A. Courbis Thomas Lambolais Binbin Xu P. Bernard Gérard Dray Walid Maalej DiffM CLIP 34 6 0 30 Apr 2024
Graph4GUI: Graph Neural Networks for Representing Graphical User Interfaces Yue Jiang Changkong Zhou Vikas Garg Antti Oulasvirta 41 7 0 21 Apr 2024
UIClip: A Data-driven Model for Assessing User Interface Design Jason Wu Yi-Hao Peng Amanda Li Amanda Swearngin Jeffrey P. Bigham Jeffrey Nichols HAI 29 6 0 18 Apr 2024
LlamaTouch: A Faithful and Scalable Testbed for Mobile UI Automation Task Evaluation Li Zhang Shihe Wang Xianqing Jia Zhihan Zheng Yun-Yu Yan Longxi Gao Yuanchun Li Mengwei Xu LLMAG 32 10 0 12 Apr 2024
Computer User Interface Understanding. A New Dataset and a Learning Framework Andrés Munoz Daniel Borrajo 30 0 0 15 Mar 2024
AI-Assisted Causal Pathway Diagram for Human-Centered Design Ruican Zhong Donghoon Shin Rosemary Meza P. Klasnja Lucas Colusso Gary Hsieh 36 5 0 12 Mar 2024
Demystifying Tacit Knowledge in Graphic Design: Characteristics, Instances, Approaches, and Guidelines Kihoon Son DaEun Choi Tae Soo Kim Juho Kim 11 7 0 10 Mar 2024
{A New Hope}: Contextual Privacy Policies for Mobile Applications and An Approach Toward Automated Generation Shidong Pan Zhenyuan Tao Thong Hoang Dawen Zhang Tianshi Li Zhenchang Xing Sherry Xu Mark Staples Thierry Rakotoarivelo David Lo 31 6 0 22 Feb 2024
AI Assistance for UX: A Literature Review Through Human-Centered AI Yuwen Lu Yuewen Yang Qinyi Zhao Chengzhi Zhang Toby Jia-Jun Li 24 16 0 08 Feb 2024
Designing with Language: Wireframing UI Design Intent with Generative Large Language Models Sidong Feng Mingyue Yuan Jieshan Chen Zhenchang Xing Chunyang Chen AI4CE 3DV 19 7 0 12 Dec 2023
ILuvUI: Instruction-tuned LangUage-Vision modeling of UIs from Machine Conversations Yue Jiang E. Schoop Amanda Swearngin Jeffrey Nichols MLLM 18 17 0 07 Oct 2023
Pairwise GUI Dataset Construction Between Android Phones and Tablets Han Hu Haolan Zhan Yujin Huang Di Liu 30 3 0 07 Oct 2023
GenQuery: Supporting Expressive Visual Search with Generative Models Kihoon Son DaEun Choi Tae Soo Kim Young‐Ho Kim Juho Kim 21 24 0 02 Oct 2023
Towards Automated Accessibility Report Generation for Mobile Apps Amanda Swearngin Jason Wu Xiaoyi Zhang Esteban Gomez Jen Coughenour ... Bhavya Garg Greg Hughes Adriana Hilliard Jeffrey P. Bigham Jeffrey Nichols 23 10 0 29 Sep 2023
Computational Approaches for App-to-App Retrieval and Design Consistency Check Seokhyeon Park Wonjae Kim Young-Ho Kim Jinwook Seo 11 4 0 19 Sep 2023
EGFE: End-to-end Grouping of Fragmented Elements in UI Designs with Multimodal Learning Liuqing Chen Yunnong Chen Shuhong Xiao Yaxuan Song Lingyun Sun Yankun Zhen Tingting Zhou Yan-fang Chang 49 4 0 18 Sep 2023
Never-ending Learning of User Interfaces Jason Wu Rebecca Krosnick E. Schoop Amanda Swearngin Jeffrey P. Bigham Jeffrey Nichols VLM HAI 19 15 0 17 Aug 2023
Towards a New Interface for Music Listening: A User Experience Study on YouTube A. Choi Eunsik Shin Haesun Joung Joongseek Lee Kyogu Lee 27 2 0 27 Jul 2023
A Pairwise Dataset for GUI Conversion and Retrieval between Android Phones and Tablets Han Hu Haolan Zhan Yujin Huang Di Liu 30 0 0 25 Jul 2023
SeePrivacy: Automated Contextual Privacy Policy Generation for Mobile Applications Shidong Pan Zhenyuan Tao Thong Hoang Dawen Zhang Zhenchang Xing Xiwei Xu Mark Staples David Lo 27 4 0 04 Jul 2023
Boosting GUI Prototyping with Diffusion Models Jialiang Wei A. Courbis Thomas Lambolais Binbin Xu P. Bernard Gérard Dray DiffM 24 22 0 09 Jun 2023
Mobile User Interface Element Detection Via Adaptively Prompt Tuning Zhangxuan Gu Zhuoer Xu Haoxing Chen Jun Lan Changhua Meng Weiqiang Wang 19 4 0 16 May 2023
DualSlide: Global-to-Local Sketching Interface for Slide Content and Layout Design Jiahao Weng Xu Du Haoran Xie 30 1 0 25 Apr 2023
WebUI: A Dataset for Enhancing Visual UI Understanding with Web Semantics Jason Wu Siyan Wang Siman Shen Yi-Hao Peng Jeffrey Nichols Jeffrey P. Bigham 21 69 0 30 Jan 2023
Screen Correspondence: Mapping Interchangeable Elements between UIs Jason Wu Amanda Swearngin Xiaoyi Zhang Jeffrey Nichols Jeffrey P. Bigham 43 7 0 20 Jan 2023
Interactive Layout Drawing Interface with Shadow Guidance Jiahao Weng Haoran Xie 3DV 13 2 0 26 Dec 2022
UI Layers Group Detector: Grouping UI Layers via Text Fusion and Box Attention Shuhong Xiao Tingting Zhou Yunnong Chen Dengming Zhang Liuqing Chen Lingyun Sun Shiyu Yue 21 4 0 07 Dec 2022
Towards Better Semantic Understanding of Mobile Interfaces Srinivas Sunkara Maria Wang Lijuan Liu Gilles Baechler Yu-Chung Hsiao Jindong Chen Chen Abhanshu Sharma James Stout 21 22 0 06 Oct 2022
UI Layers Merger: Merging UI layers via Visual Learning and Boundary Prior Yunnong Chen Yankun Zhen Chuhao Shi Jiazhi Li Liuqing Chen Z. Li Lingyun Sun Tingting Zhou Yan-fang Chang 37 4 0 18 Jun 2022
Auto-Icon+: An Automated End-to-End Code Generation Tool for Icon Designs in UI Development Sidong Feng Minmin Jiang Tingting Zhou Yankun Zhen Chunyang Chen 11 20 0 19 Apr 2022
PSDoodle: Searching for App Screens via Interactive Sketching Soumik Mohian Christoph Csallner 14 8 0 05 Apr 2022
GANSpiration: Balancing Targeted and Serendipitous Inspiration in User Interface Design with Style-Based Generative Adversarial Network Mohammad Amin Mozaffari Xinyuan Zhang Jinghui Cheng Jin L. C. Guo 32 28 0 08 Mar 2022
Screen2Words: Automatic Mobile UI Summarization with Multimodal Learning Bryan Wang Gang Li Xin Zhou Zhourong Chen Tovi Grossman Yang Li 167 153 0 07 Aug 2021
Understanding Mobile GUI: from Pixel-Words to Screen-Sentences Jingwen Fu Xiaoyi Zhang Yuwang Wang Wenjun Zeng Sam Yang Grayson Hilliard 29 14 0 25 May 2021
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 950 20,572 0 17 Apr 2017