Turning a CLIP Model into a Scene Text Spotter

21 August 2023

Yuliang Liu

ArXiv (abs)PDF HTML Github (193★)

Papers citing "Turning a CLIP Model into a Scene Text Spotter"

50 / 55 papers shown

Title
SwinTextSpotter v2: Towards Better Synergy for Scene Text Spotting Mingxin Huang Dezhi Peng Hongliang Li Zhenghao Peng Chongyu Liu Dahua Lin Yuliang Liu Xiang Bai Lianwen Jin 140 1 0 15 Jan 2024
DeepSolo: Let Transformer Decoder with Explicit Points Solo for Text Spotting Maoyuan Ye Jing Zhang Shanshan Zhao Juhua Liu Tongliang Liu Bo Du Dacheng Tao 117 77 0 19 Nov 2022
ABINet++: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Spotting Shancheng Fang Zhendong Mao Hongtao Xie Yuxin Wang C. Yan Yongdong Zhang 97 55 0 19 Nov 2022
DPText-DETR: Towards Better Scene Text Detection with Dynamic Points in Transformer Maoyuan Ye Jing Zhang Shanshan Zhao Juhua Liu Bo Du Dacheng Tao ViT 82 76 0 10 Jul 2022
Arbitrary Shape Text Detection via Boundary Transformer Shi-Xue Zhang Chun Yang Xiaobin Zhu Xu-Cheng Yin 75 40 0 11 May 2022
Vision-Language Pre-Training for Boosting Scene Text Detectors Sibo Song Jianqiang Wan Zhibo Yang Jun Tang Wenqing Cheng Xiang Bai Cong Yao VLM 97 24 0 29 Apr 2022
Text Spotting Transformers Xiang Zhang Yongwen Su Subarna Tripathi Zhuowen Tu ViT 89 95 0 05 Apr 2022
Few Could Be Better Than All: Feature Sampling and Grouping for Scene Text Detection Jixin Tang Wenqing Zhang Hong-yi Liu Mingkun Yang Ziwei He Guan-Nan Hu Xiang Bai ViT 49 67 0 29 Mar 2022
SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognition Mingxin Huang Yuliang Liu Zhenghao Peng Chongyu Liu Dahua Lin Shenggao Zhu N. Yuan Kai Ding Lianwen Jin ViT 57 103 0 19 Mar 2022
Conditional Prompt Learning for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VLM CLIP VPVLM 148 1,359 0 10 Mar 2022
Towards Weakly-Supervised Text Spotting using a Multi-Task Transformer Yair Kittenplon I. Lavi Sharon Fogel Yarin Bar R. Manmatha Pietro Perona ViT 50 55 0 11 Feb 2022
SPTS: Single-Point Text Spotting Dezhi Peng Xinyu Wang Yuliang Liu Jiaxin Zhang Mingxin Huang ... Jing Li Dahua Lin Chunhua Shen Xiang Bai Lianwen Jin ViT 101 65 0 15 Dec 2021
DenseCLIP: Language-Guided Dense Prediction with Context-Aware Prompting Yongming Rao Wenliang Zhao Guangyi Chen Yansong Tang Zheng Zhu Guan Huang Jie Zhou Jiwen Lu VLM CLIP 214 581 0 02 Dec 2021
Learning to Prompt for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VPVLM CLIP VLM 507 2,413 0 02 Sep 2021
Adaptive Boundary Proposal Network for Arbitrary Shape Text Detection Shi-Xue Zhang Xiaobin Zhu Chun Yang Hongfa Wang Xu-Cheng Yin 69 84 0 27 Jul 2021
Learning High-Precision Bounding Box for Rotated Object Detection via Kullback-Leibler Divergence Xue Yang Xiaojiang Yang Jirui Yang Qi Ming Wentao Wang Qi Tian Junchi Yan 107 389 0 03 Jun 2021
TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene text Amanpreet Singh Guan Pang Mandy Toh Jing Huang Wojciech Galuba Tal Hassner 68 174 0 12 May 2021
ABCNet v2: Adaptive Bezier-Curve Network for Real-time End-to-end Text Spotting Yuliang Liu Chunhua Shen Lianwen Jin Tong He Peng Chen Chongyu Liu Hao Chen 111 142 0 08 May 2021
PAN++: Towards Efficient and Accurate End-to-End Spotting of Arbitrarily-Shaped Text Wenhai Wang Enze Xie Xiang Li Xuebo Liu Ding Liang Yang Zhibo Tong Lu Chunhua Shen 93 144 0 02 May 2021
Open-vocabulary Object Detection via Vision and Language Knowledge Distillation Xiuye Gu Nayeon Lee Weicheng Kuo Huayu Chen VLM ObjD 296 920 0 28 Apr 2021
Fourier Contour Embedding for Arbitrary-Shaped Text Detection Yiqin Zhu Jianyong Chen Lingyu Liang Zhuanghui Kuang Lianwen Jin Wayne Zhang 74 194 0 21 Apr 2021
PGNet: Real-time Arbitrarily-Shaped Text Spotting with Point Gathering Network Pengfei Wang Chengquan Zhang Fei Qi Shanshan Liu Xiaoqiang Zhang Pengyuan Lyu Junyu Han Jingtuo Liu Errui Ding Guangming Shi 94 83 0 12 Apr 2021
MOST: A Multi-Oriented Scene Text Detector with Localization Refinement Minghang He Minghui Liao Zhibo Yang Humen Zhong Jun Tang Wenqing Cheng Cong Yao Yongpan Wang X. Bai 87 75 0 02 Apr 2021
Rethinking Rotated Object Detection with Gaussian Wasserstein Distance Loss Xue Yang Junchi Yan Qi Ming Wentao Wang Xiaopeng Zhang Qi Tian 186 410 0 28 Jan 2021
PolarDet: A Fast, More Precise Detector for Rotated Target in Aerial Images Pengbo Zhao Zhenshen Qu Yingjia Bu Wenming Tan Ye Ren Shiliang Pu ObjD 140 84 0 17 Oct 2020
Deformable DETR: Deformable Transformers for End-to-End Object Detection Xizhou Zhu Weijie Su Lewei Lu Bin Li Xiaogang Wang Jifeng Dai ViT 251 5,102 0 08 Oct 2020
Character Region Attention For Text Spotting Youngmin Baek Seung Shin Jeonghun Baek Sungrae Park Junyeop Lee Daehyun Nam Hwalsuk Lee 82 72 0 19 Jul 2020
Mask TextSpotter v3: Segmentation Proposal Network for Robust Scene Text Spotting Minghui Liao Guan Pang Jing Huang Tal Hassner X. Bai 84 184 0 18 Jul 2020
End-to-End Object Detection with Transformers Nicolas Carion Francisco Massa Gabriel Synnaeve Nicolas Usunier Alexander Kirillov Sergey Zagoruyko ViT 3DV PINN 440 13,130 0 26 May 2020
ContourNet: Taking a Further Step toward Accurate Arbitrary-shaped Scene Text Detection Yuxin Wang Hongtao Xie Zhengjun Zha Mengting Xing Zilong Fu Yongdong Zhang 108 177 0 10 Apr 2020
ABCNet: Real-time Scene Text Spotting with Adaptive Bezier-Curve Network Yuliang Liu Hao Chen Chunhua Shen Tong He Lianwen Jin Liangwei Wang 99 335 0 24 Feb 2020
Text Perceptron: Towards End-to-End Arbitrary-Shaped Text Spotting Liang Qiao Sanli Tang Zhanzhan Cheng Yunlu Xu Yi Niu Shiliang Pu Leilei Gan 86 114 0 17 Feb 2020
Bridging the Gap Between Anchor-based and Anchor-free Detection via Adaptive Training Sample Selection Shifeng Zhang Cheng Chi Yongqiang Yao Zhen Lei Stan Z. Li ObjD 169 1,548 0 05 Dec 2019
All You Need Is Boundary: Toward Arbitrary-Shaped Text Spotting Hao Wang Pu Lu Hui Zhang Mingkun Yang X. Bai Yongchao Xu Mengchao He Yongpan Wang Wenyu Liu 92 129 0 21 Nov 2019
Real-time Scene Text Detection with Differentiable Binarization Minghui Liao Zhaoyi Wan Cong Yao Kai Chen X. Bai 80 683 0 20 Nov 2019
Convolutional Character Networks Linjie Xing Zhi Tian Weilin Huang Matthew R. Scott 118 159 0 17 Oct 2019
ICDAR2019 Robust Reading Challenge on Arbitrary-Shaped Text (RRC-ArT) Chee-Kheng Chng Yuliang Liu Yipeng Sun Chun Chet Ng Canjie Luo ... Errui Ding Jingtuo Liu Dimosthenis Karatzas Chee Seng Chan Lianwen Jin 3DV 95 215 0 16 Sep 2019
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 579 2,677 0 03 Sep 2019
Towards Unconstrained End-to-End Text Spotting Siyang Qin Alessandro Bissacco Michalis Raptis Yasuhisa Fujii Y. Xiao 66 130 0 24 Aug 2019
Efficient and Accurate Arbitrary-Shaped Text Detection with Pixel Aggregation Network Wenhai Wang Enze Xie Xiaoge Song Yuhang Zang Wenjia Wang Tong Lu Gang Yu Chunhua Shen 65 418 0 16 Aug 2019
GA-DAN: Geometry-Aware Domain Adaptation Network for Scene Text Detection and Recognition Fangneng Zhan Chuhui Xue Shijian Lu 65 82 0 23 Jul 2019
ICDAR2019 Robust Reading Challenge on Multi-lingual Scene Text Detection and Recognition -- RRC-MLT-2019 Nibal Nayef Yash J. Patel M. Busta Pinaki Nath Chowdhury Dimosthenis Karatzas ... Jirí Matas Umapada Pal J. Burie Cheng-Lin Liu J. Ogier 3DV 80 251 0 01 Jul 2019
Towards End-to-End Text Spotting in Natural Scenes Peng Wang Hui Li Chunhua Shen 63 32 0 14 Jun 2019
Arbitrary Shape Scene Text Detection with Adaptive Text Region Representation Xiaobing Wang Yingying Jiang Zhenbo Luo Cheng-Lin Liu Hyunsoo Choi Sungjin Kim 59 170 0 15 May 2019
Look More Than Once: An Accurate Detector for Text of Arbitrary Shapes Chengquan Zhang Borong Liang Zuming Huang Mengyi En Junyu Han Errui Ding Xinghao Ding 67 232 0 13 Apr 2019
Character Region Awareness for Text Detection Youngmin Baek Bado Lee Dongyoon Han Sangdoo Yun Hwalsuk Lee 69 784 0 03 Apr 2019
FCOS: Fully Convolutional One-Stage Object Detection Zhi Tian Chunhua Shen Hao Chen Tong He ObjD 143 5,018 0 02 Apr 2019
Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapes Pengyuan Lyu Minghui Liao Cong Yao Wenhao Wu X. Bai 92 599 0 06 Jul 2018
Shape Robust Text Detection with Progressive Scale Expansion Network Xiang Li Wenhai Wang Wenbo Hou Ruo-Ze Liu Tong Lu Jian Yang 92 611 0 07 Jun 2018
FOTS: Fast Oriented Text Spotting with a Unified Network Xuebo Liu Ding Liang Shipeng Yan Dagui Chen Yu Qiao Junjie Yan ObjD 91 500 0 05 Jan 2018