CoTBal: Comprehensive Task Balancing for Multi-Task Visual Instruction Tuning

v1v2 (latest)

CoTBal: Comprehensive Task Balancing for Multi-Task Visual Instruction Tuning

7 March 2024

Nanyi Fei

Guoxing Yang

Zhiwu Lu

ArXiv (abs)PDF HTML

Papers citing "CoTBal: Comprehensive Task Balancing for Multi-Task Visual Instruction Tuning"

3 / 3 papers shown

Title
Collaborative Multi-LoRA Experts with Achievement-based Multi-Tasks Loss for Unified Multimodal Information Extraction Li Yuan Yi Cai Xudong Shen Qing Li Qingbao Huang Zikun Deng Tao Wang MoMe OffRL MoE 91 0 0 08 May 2025
Filter Images First, Generate Instructions Later: Pre-Instruction Data Selection for Visual Instruction Tuning Bardia Safaei Faizan Siddiqui Jiacong Xu Vishal M. Patel Shao-Yuan Lo VLM 472 1 0 10 Mar 2025
MMRole: A Comprehensive Framework for Developing and Evaluating Multimodal Role-Playing Agents Yanqi Dai Huanran Hu Lei Wang Shengjie Jin X. Chen Zhiwu Lu LLMAG 119 9 0 08 Aug 2024