v1v2 (latest)

Multi-Task Dense Prediction via Mixture of Low-Rank Experts

26 March 2024

ArXiv (abs)PDF HTML Github (77★)

Papers citing "Multi-Task Dense Prediction via Mixture of Low-Rank Experts"

33 / 33 papers shown

Title
Occlusion Boundary and Depth: Mutual Enhancement via Multi-Task Learning Lintao Xu Yinghao Wang Chaohui Wang MDE 215 0 0 27 May 2025
A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applications Siyuan Mu Sen Lin MoE 479 5 0 10 Mar 2025
SM3Det: A Unified Model for Multi-Modal Remote Sensing Object Detection Yuchen Li Xianrui Li Yunheng Li Yanzhe Zhang Yimian Dai Qibin Hou Ming-Ming Cheng Jian Yang 221 7 0 31 Dec 2024
Collaborative and Efficient Personalization with Mixtures of Adaptors Abdulla Jasem Almansoori Samuel Horváth Martin Takáč FedML 85 3 0 04 Oct 2024
FacT: Factor-Tuning for Lightweight Adaptation on Vision Transformer Shibo Jie Zhi-Hong Deng 74 135 0 06 Dec 2022
M $^3$ ViT: Mixture-of-Experts Vision Transformer for Efficient Multi-task Learning with Model-Accelerator Co-design Hanxue Liang Zhiwen Fan Rishov Sarkar Ziyu Jiang Tianlong Chen Kai Zou Yu Cheng Cong Hao Zhangyang Wang MoE 70 88 0 26 Oct 2022
InvPT: Inverted Pyramid Multi-task Transformer for Dense Scene Understanding Hanrong Ye Dan Xu ViT 61 89 0 15 Mar 2022
VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks Yi-Lin Sung Jaemin Cho Joey Tianyi Zhou VLM VPVLM 112 356 0 13 Dec 2021
LoRA: Low-Rank Adaptation of Large Language Models J. E. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang Weizhu Chen OffRL AI4TS AI4CE ALM AIMat 502 10,526 0 17 Jun 2021
Scaling Vision with Sparse Mixture of Experts C. Riquelme J. Puigcerver Basil Mustafa Maxim Neumann Rodolphe Jenatton André Susano Pinto Daniel Keysers N. Houlsby MoE 129 610 0 10 Jun 2021
Exploring Relational Context for Multi-Task Dense Prediction David Brüggemann Menelaos Kanakis Anton Obukhov Stamatios Georgoulis Luc Van Gool 114 77 0 28 Apr 2021
Multi-task Learning with Attention for End-to-end Autonomous Driving Keishi Ishihara Anssi Kanervisto J. Miura Ville Hautamaki 99 64 0 21 Apr 2021
Diverse Branch Block: Building a Convolution as an Inception-like Unit Xiaohan Ding Xinming Zhang Jungong Han Guiguang Ding AI4CE 72 288 0 24 Mar 2021
Vision Transformers for Dense Prediction René Ranftl Alexey Bochkovskiy V. Koltun ViT MDE 138 1,747 0 24 Mar 2021
Coordinate Attention for Efficient Mobile Network Design Qibin Hou Daquan Zhou Jiashi Feng 92 3,082 0 04 Mar 2021
RepVGG: Making VGG-style ConvNets Great Again Xiaohan Ding Xinming Zhang Ningning Ma Jungong Han Guiguang Ding Jian Sun 295 1,603 0 11 Jan 2021
Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning Armen Aghajanyan Luke Zettlemoyer Sonal Gupta 110 571 1 22 Dec 2020
AdaBins: Depth Estimation using Adaptive Bins S. Bhat Ibraheem Alhashim Peter Wonka 3DV MDE ViT 139 861 0 28 Nov 2020
Automated Search for Resource-Efficient Branched Multi-Task Networks David Brüggemann Menelaos Kanakis Stamatios Georgoulis Luc Van Gool 59 65 0 24 Aug 2020
Learning to Branch for Multi-Task Learning Pengsheng Guo Chen-Yu Lee Daniel Ulbricht 77 179 0 02 Jun 2020
MTI-Net: Multi-Scale Task Interaction Networks for Multi-Task Learning Simon Vandenhende Stamatios Georgoulis Luc Van Gool 90 224 0 19 Jan 2020
Pattern-Affinitive Propagation across Depth, Surface Normal and Semantic Segmentation Zhenyu Zhang Zhen Cui Chunyan Xu Yan Yan N. Sebe Jian Yang MDE 70 285 0 08 Jun 2019
Branched Multi-Task Networks: Deciding What Layers To Share Simon Vandenhende Stamatios Georgoulis Bert De Brabandere Luc Van Gool 114 145 0 05 Apr 2019
Deep High-Resolution Representation Learning for Human Pose Estimation Ke Sun Bin Xiao Dong Liu Jingdong Wang 3DV 138 4,063 0 25 Feb 2019
BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentation Changqian Yu Jingbo Wang Chao Peng Changxin Gao Gang Yu Nong Sang SSeg 132 2,207 0 02 Aug 2018
BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning Feng Yu Haofeng Chen Xin Wang Wenqi Xian Yingying Chen Fangchen Liu Vashisht Madhavan Trevor Darrell VLM 346 2,158 0 12 May 2018
PAD-Net: Multi-Tasks Guided Prediction-and-Distillation Network for Simultaneous Depth Estimation and Scene Parsing Dan Xu Wanli Ouyang Xiaogang Wang N. Sebe MoE 69 480 0 11 May 2018
Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics Alex Kendall Y. Gal R. Cipolla 3DH 272 3,136 0 19 May 2017
RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentation Guosheng Lin Anton Milan Chunhua Shen Ian Reid AI4TS SSeg 282 2,851 0 20 Nov 2016
Trace Norm Regularised Deep Multi-Task Learning Yongxin Yang Timothy M. Hospedales FedML 99 220 0 13 Jun 2016
DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs Liang-Chieh Chen George Papandreou Iasonas Kokkinos Kevin Patrick Murphy Alan Yuille SSeg 273 18,284 0 02 Jun 2016
Fully Convolutional Networks for Semantic Segmentation Evan Shelhamer Jonathan Long Trevor Darrell VOS SSeg 755 37,895 0 20 May 2016
Detect What You Can: Detecting and Representing Objects using Holistic Models and Body Parts Xianjie Chen Roozbeh Mottaghi Xiaobai Liu Sanja Fidler R. Urtasun Alan Yuille 103 643 0 08 Jun 2014