Reinforced UI Instruction Grounding: Towards a Generic UI Task
Automation API

Reinforced UI Instruction Grounding: Towards a Generic UI Task Automation API

7 October 2023

Papers citing "Reinforced UI Instruction Grounding: Towards a Generic UI Task Automation API"

10 / 10 papers shown

Title
UI-E2I-Synth: Advancing GUI Grounding with Large-Scale Instruction Synthesis Xinyi Liu Xiaoyi Zhang Ziyun Zhang Yan Lu 39 0 0 15 Apr 2025
From Grounding to Planning: Benchmarking Bottlenecks in Web Agents Segev Shlomov Ben Wiesel Aviad Sela Ido Levy Liane Galanti Roy Abitbol LLMAG 36 3 0 03 Sep 2024
E-ANT: A Large-Scale Dataset for Efficient Automatic GUI NavigaTion Ke Wang Tianyu Xia Zhangxuan Gu Yi Zhao Shuheng Shen Changhua Meng Weiqiang Wang Ke Xu 38 0 0 20 Jun 2024
GUI Action Narrator: Where and When Did That Action Take Place? Qinchen Wu Difei Gao Kevin Qinghong Lin Zhuoyu Wu Xiangwu Guo Peiran Li Weichen Zhang Hengxu Wang Mike Zheng Shou 39 3 0 19 Jun 2024
SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents Kanzhi Cheng Qiushi Sun Yougang Chu Fangzhi Xu Yantao Li Jianbing Zhang Zhiyong Wu LLMAG 175 138 0 17 Jan 2024
ASSISTGUI: Task-Oriented Desktop Graphical User Interface Automation Difei Gao Lei Ji Zechen Bai Mingyu Ouyang Peiran Li ... Peiyi Wang Xiangwu Guo Hengxu Wang Luowei Zhou Mike Zheng Shou LLMAG 23 21 0 20 Dec 2023
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 313 11,953 0 04 Mar 2022
SelectAugment: Hierarchical Deterministic Sample Selection for Data Augmentation Shiqi Lin Zhizheng Zhang Xin Li Wenjun Zeng Zhibo Chen 24 9 0 06 Dec 2021
Pix2seq: A Language Modeling Framework for Object Detection Ting-Li Chen Saurabh Saxena Lala Li David J. Fleet Geoffrey E. Hinton MLLM ViT VLM 244 344 0 22 Sep 2021
Unifying Vision-and-Language Tasks via Text Generation Jaemin Cho Jie Lei Hao Tan Joey Tianyi Zhou MLLM 256 525 0 04 Feb 2021