Uni-MuMER: Unified Multi-Task Fine-Tuning of Vision-Language Model for Handwritten Mathematical Expression Recognition

29 May 2025

Papers citing "Uni-MuMER: Unified Multi-Task Fine-Tuning of Vision-Language Model for Handwritten Mathematical Expression Recognition"

29 / 29 papers shown

Title
MMHMER:Multi-viewer and Multi-task for Handwritten Mathematical Expression Recognition Kehua Chen Haoyang Shen Lifan Zhong Mingyi Chen 129 1 0 08 Feb 2025
TAMER: Tree-Aware Transformer for Handwritten Mathematical Expression Recognition Jianhua Zhu Wenqi Zhao Yu Li Xingjian Hu Liangcai Gao 90 2 0 16 Aug 2024
PosFormer: Recognizing Complex Handwritten Mathematical Expression with Position Forest Transformer Tongkun Guan Chengyu Lin Wei Shen Xiaokang Yang 64 6 0 10 Jul 2024
ICAL: Implicit Character-Aided Learning for Enhanced Handwritten Mathematical Expression Recognition Jianhua Zhu Liangcai Gao Wenqi Zhao HAI 46 3 0 15 May 2024
UniMERNet: A Universal Network for Real-World Mathematical Expression Recognition Bin Wang Zhuangcheng Gu Chaochao Xu Bo Zhang Botian Shi Conghui He OffRL 72 13 0 23 Apr 2024
MathNet: A Data-Centric Approach for Printed Mathematical Expression Recognition Felix M. Schmitt-Koopmann Elaine M. Huang Hans-Peter Hutter Thilo Stadelmann Alireza Darvishy 62 5 0 21 Apr 2024
MathWriting: A Dataset For Handwritten Mathematical Expression Recognition Philippe Gervais Asya Fadeeva Andrii Maksai 56 7 0 16 Apr 2024
TextMonkey: An OCR-Free Large Multimodal Model for Understanding Document Yuliang Liu Biao Yang Qiang Liu Zhang Li Zhiyin Ma Shuo Zhang Xiang Bai MLLM VLM 81 102 0 07 Mar 2024
Representing Online Handwriting for Recognition in Large Vision-Language Models Anastasiia Fadeeva Philippe Schlattner Andrii Maksai Mark Collier Efi Kokiopoulou Jesse Berent C. Musat 149 6 0 23 Feb 2024
Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Models Zhang Li Biao Yang Qiang Liu Zhiyin Ma Shuo Zhang Jingxu Yang Yabo Sun Yuliang Liu Xiang Bai MLLM 89 267 0 11 Nov 2023
Efficient Memory Management for Large Language Model Serving with PagedAttention Woosuk Kwon Zhuohan Li Siyuan Zhuang Ying Sheng Lianmin Zheng Cody Hao Yu Joseph E. Gonzalez Haotong Zhang Ion Stoica VLM 182 2,197 0 12 Sep 2023
Tree of Thoughts: Deliberate Problem Solving with Large Language Models Shunyu Yao Dian Yu Jeffrey Zhao Izhak Shafran Thomas Griffiths Yuan Cao Karthik Narasimhan LM&Ro LRM AI4CE 138 1,949 0 17 May 2023
Self-Refine: Iterative Refinement with Self-Feedback Aman Madaan Niket Tandon Prakhar Gupta Skyler Hallinan Luyu Gao ... Bodhisattwa Prasad Majumder Katherine Hermann Sean Welleck Amir Yazdanbakhsh Peter Clark ReLM LRM DiffM 147 1,633 0 30 Mar 2023
PaLM-E: An Embodied Multimodal Language Model Danny Driess F. Xia Mehdi S. M. Sajjadi Corey Lynch Aakanksha Chowdhery ... Marc Toussaint Klaus Greff Andy Zeng Igor Mordatch Peter R. Florence LM&Ro 98 1,641 0 06 Mar 2023
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models Junnan Li Dongxu Li Silvio Savarese Steven C. H. Hoi VLM MLLM 426 4,550 0 30 Jan 2023
PaLI: A Jointly-Scaled Multilingual Language-Image Model Xi Chen Tianlin Li Soravit Changpinyo A. Piergiovanni Piotr Padlewski ... Andreas Steiner A. Angelova Xiaohua Zhai N. Houlsby Radu Soricut MLLM VLM 92 720 0 14 Sep 2022
When Counting Meets HMER: Counting-Aware Network for Handwritten Mathematical Expression Recognition Bohan Li Ye Yuan Dingkang Liang Xiao-Chang Liu Zhilong Ji Jinfeng Bai Wenyu Liu Xiang Bai 65 50 0 23 Jul 2022
CoMER: Modeling Coverage for Transformer-based Handwritten Mathematical Expression Recognition Wenqi Zhao Liang Gao ViT 36 29 0 10 Jul 2022
LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking Yupan Huang Tengchao Lv Lei Cui Yutong Lu Furu Wei 89 454 0 18 Apr 2022
Syntax-Aware Network for Handwritten Mathematical Expression Recognition Ye Yuan Xiao-Chang Liu Wondimu Dikubab Hui Liu Zhilong Ji Zhongqin Wu X. Bai 67 66 0 03 Mar 2022
BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Junnan Li Dongxu Li Caiming Xiong Guosheng Lin MLLM BDL VLM CLIP 530 4,360 0 28 Jan 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 814 9,387 0 28 Jan 2022
Handwritten Mathematical Expression Recognition via Attention Aggregation based Bi-directional Mutual Learning Xiaohang Bian Bo Qin Xiaozhe Xin Jianwu Li Xuefeng Su Yanfeng Wang 65 51 0 07 Dec 2021
Handwritten Mathematical Expression Recognition with Bidirectionally Trained Transformer Wenqi Zhao Liangcai Gao Zuoyu Yan Shuai Peng Lin Du Ziyin Zhang ViT 134 55 0 06 May 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 925 29,436 0 26 Feb 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 443 3,856 0 11 Feb 2021
uniblock: Scoring and Filtering Corpus with Unicode Block Information Yingbo Gao Weiyue Wang Hermann Ney 17 1 0 26 Aug 2019
Multi-Scale Attention with Dense Encoder for Handwritten Mathematical Expression Recognition Jianshu Zhang Jun Du Lirong Dai 69 126 0 05 Jan 2018
Image-to-Markup Generation with Coarse-to-Fine Attention Yuntian Deng Anssi Kanervisto Jeffrey Ling Alexander M. Rush 44 228 0 16 Sep 2016