Video2Action: Reducing Human Interactions in Action Annotation of App Tutorial Videos

7 August 2023

Papers citing "Video2Action: Reducing Human Interactions in Action Annotation of App Tutorial Videos"

20 / 20 papers shown

Title
Extracting Replayable Interactions from Videos of Mobile App Usage Jieshan Chen Amanda Swearngin Jason Wu Titus Barik Jeffrey Nichols Xiaoyi Zhang 52 10 0 09 Jul 2022
Psychologically-Inspired, Unsupervised Inference of Perceptual Groups of GUI Widgets from GUI Images Mulong Xie Zhenchang Xing Sidong Feng Chunyang Chen Liming Zhu Xiwei Xu 45 29 0 15 Jun 2022
Auto-Icon+: An Automated End-to-End Code Generation Tool for Icon Designs in UI Development Sidong Feng Minmin Jiang Tingting Zhou Yankun Zhen Chunyang Chen 38 20 0 19 Apr 2022
Learning to Denoise Raw Mobile UI Layouts for Improving Datasets at Scale Gang Li Gilles Baechler Manuel Tragut Yang Li 47 49 0 11 Jan 2022
Large-Scale Modeling of Mobile User Click Behaviors Using Deep Learning Xin Zhou Yang Li HAI 42 12 0 11 Aug 2021
HelpViz: Automatic Generation of Contextual Visual MobileTutorials from Text-Based Instructions Mingyuan Zhong Gang Li Peggy Chi Yang Li 32 24 0 07 Aug 2021
Soloist: Generating Mixed-Initiative Tutorials from Existing Guitar Instructional Videos Through Audio Processing Bryan Wang Mengyu Yang Tovi Grossman 23 22 0 21 Jan 2021
EventAnchor: Reducing Human Interactions in Event Annotation of Racket Sports Videos Dazhen Deng Jiang Wu Jiachen Wang Yihong Wu Xiao Xie Zheng Zhou Hui Zhang X. Zhang Yingcai Wu 49 39 0 13 Jan 2021
Screen Recognition: Creating Accessibility Metadata for Mobile Applications from Pixels Xiaoyi Zhang Lilian de Greef Amanda Swearngin Samuel White Kyle I. Murray ... Jeffrey Nichols Jason Wu Chris Fleizach Aaron Everitt Jeffrey P. Bigham 306 171 0 13 Jan 2021
ActionBert: Leveraging User Actions for Semantic Understanding of User Interfaces Zecheng He Srinivas Sunkara Xiaoxue Zang Ying Xu Lijuan Liu Nevan Wichers Gabriel Schubiner Ruby B. Lee Jindong Chen Blaise Agüera y Arcas 61 79 0 22 Dec 2020
From Lost to Found: Discover Missing UI Design Semantics through Recovering Missing Tags Chunyang Chen Sidong Feng Zhengyang Liu Zhenchang Xing Shengdong Zhao 3DV 46 23 0 16 Aug 2020
Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination? Jieshan Chen Mulong Xie Zhenchang Xing Chunyang Chen Xiwei Xu Liming Zhu Guoqiang Li OOD 44 148 0 12 Aug 2020
Translating Video Recordings of Mobile App Usages into Replayable Scenarios Carlos Bernal-Cárdenas Nathan Cooper Kevin Moran Oscar Chaparro Andrian Marcus Denys Poshyvanyk 45 65 0 18 May 2020
Behavior Sequence Transformer for E-commerce Recommendation in Alibaba Qiwei Chen Huan Zhao Wei Li Pipei Huang Wenwu Ou 60 389 0 15 May 2019
Modeling Mobile Interface Tappability Using Crowdsourcing and Deep Learning Amanda Swearngin Yongqian Li HAI 41 62 0 28 Feb 2019
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 687 131,526 0 12 Jun 2017
Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? Nima Tajbakhsh Jae Y. Shin S. Gurudu R. T. Hurst Christopher B. Kendall Michael B. Gotway Jianming Liang 222 2,526 0 02 Jun 2017
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization Ramprasaath R. Selvaraju Michael Cogswell Abhishek Das Ramakrishna Vedantam Devi Parikh Dhruv Batra FAtt 294 19,981 0 07 Oct 2016
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks Shaoqing Ren Kaiming He Ross B. Girshick Jian Sun AIMat ObjD 497 62,243 0 04 Jun 2015
Fast R-CNN Ross B. Girshick ObjD 301 25,045 0 30 Apr 2015