v1v2 (latest)

Learning Sparse Sharing Architectures for Multiple Tasks

12 November 2019

Tianxiang Sun

Xipeng Qiu

Xuanjing Huang

MoE

ArXiv (abs)PDF HTML

Papers citing "Learning Sparse Sharing Architectures for Multiple Tasks"

35 / 35 papers shown

Title
Measure Domain's Gap: A Similar Domain Selection Principle for Multi-Domain Recommendation Yi Wen Yue Liu Derong Xu Huishi Luo Pengyue Jia ... K. Liang Maolin Wang Yiqi Wang Fuzhen Zhuang Xiangyu Zhao 48 0 0 26 May 2025
Meta-Sparsity: Learning Optimal Sparse Structures in Multi-task Networks through Meta-learning Richa Upadhyay Ronald Phlypo Rajkumar Saini Marcus Liwicki 119 0 0 21 Jan 2025
Learning Task-Specific Sampling Strategy for Sparse-View CT Reconstruction Liutao Yang Jiahao Huang Yingying Fang Angelica I Aviles-Rivero Carola-Bibiane Schonlieb Daoqiang Zhang Guang Yang 52 0 0 03 Sep 2024
AdapMTL: Adaptive Pruning Framework for Multitask Learning Model Mingcan Xiang Steven Jiaxun Tang Qizheng Yang Hui Guan Tongping Liu VLM 70 0 0 07 Aug 2024
A Survey of Lottery Ticket Hypothesis Bohan Liu Zijie Zhang Peixiong He Zhensen Wang Yang Xiao Ruimeng Ye Yang Zhou Wei-Shinn Ku Bo Hui UQCV 91 15 0 07 Mar 2024
What the Weight?! A Unified Framework for Zero-Shot Knowledge Composition Carolin Holtermann Markus Frohmann Navid Rekabsaz Anne Lauscher MoMe 64 5 0 23 Jan 2024
Unified Lattice Graph Fusion for Chinese Named Entity Recognition Di Zhang Junyu Lu Pingjian Zhang 52 2 0 28 Dec 2023
Examining Modularity in Multilingual LMs via Language-Specialized Subnetworks Rochelle Choenni Ekaterina Shutova Daniel H Garrette 85 8 0 14 Nov 2023
Interpreting and Exploiting Functional Specialization in Multi-Head Attention under Multi-task Learning Chong Li Shaonan Wang Yunhao Zhang Jiajun Zhang Chengqing Zong 78 6 0 16 Oct 2023
Dynamic ASR Pathways: An Adaptive Masking Approach Towards Efficient Pruning of A Multilingual ASR Model Jiamin Xie Ke Li Jinxi Guo Andros Tjandra Shangguan Yuan Leda Sari Chunyang Wu Junteng Jia Jay Mahadeokar Ozlem Kalinli 125 2 0 22 Sep 2023
CPMR: Context-Aware Incremental Sequential Recommendation with Pseudo-Multi-Task Learning Qingtian Bian Jiaxing Xu Hui Fang Yiping Ke 53 9 0 09 Sep 2023
Less is More -- Towards parsimonious multi-task models using structured sparsity Richa Upadhyay Ronald Phlypo Rajkumar Saini Marcus Liwicki MoE 50 3 0 23 Aug 2023
Dual-Balancing for Multi-Task Learning Baijiong Lin Weisen Jiang Feiyang Ye Yu Zhang Pengguang Chen Yingke Chen Shu Liu James T. Kwok CVBM 98 15 0 23 Aug 2023
Auxiliary Task-based Deep Reinforcement Learning for Quantum Control Shumin Zhou Hailan Ma S. Kuang Daoyi Dong 87 5 0 28 Feb 2023
Modular Deep Learning Jonas Pfeiffer Sebastian Ruder Ivan Vulić Edoardo Ponti MoMe OOD 159 80 0 22 Feb 2023
Multi-task Highly Adaptive Lasso Ivana Malenica Rachael V. Phillips D. Lazzareschi Jeremy Coyle Romain Pirracchio Mark van der Laan 83 0 0 27 Jan 2023
Voting from Nearest Tasks: Meta-Vote Pruning of Pre-trained Models for Downstream Tasks Haiyan Zhao Tianyi Zhou Guodong Long Jing Jiang Chengqi Zhang 76 0 0 27 Jan 2023
One Model for All Domains: Collaborative Domain-Prefix Tuning for Cross-Domain NER Xiang Chen Lei Li Q. Fei Ningyu Zhang Chuanqi Tan Yong Jiang Fei Huang Huajun Chen 98 24 0 25 Jan 2023
Data-Efficient Cross-Lingual Transfer with Language-Specific Subnetworks Rochelle Choenni Dan Garrette Ekaterina Shutova 92 2 0 31 Oct 2022
Multitask Pre-training of Modular Prompt for Chinese Few-Shot Learning Tianxiang Sun Zhengfu He Qinen Zhu Xipeng Qiu Xuanjing Huang VLM VPVLM 38 21 0 14 Oct 2022
Learning ASR pathways: A sparse multilingual ASR model Mu Yang Andros Tjandra Chunxi Liu David C. Zhang Duc Le Ozlem Kalinli 94 14 0 13 Sep 2022
NFLAT: Non-Flat-Lattice Transformer for Chinese Named Entity Recognition Shuang Wu Xiaoning Song Zhenhua Feng Xiaojun Wu 103 24 0 12 May 2022
Language Adaptive Cross-lingual Speech Representation Learning with Sparse Sharing Sub-networks Yizhou Lu Mingkun Huang Xinghua Qu Pengfei Wei Zejun Ma 84 19 0 09 Mar 2022
Learning Multi-Tasks with Inconsistent Labels by using Auxiliary Big Task Quan Feng Songcan Chen 108 5 0 07 Jan 2022
AdaptCL: Efficient Collaborative Learning with Dynamic and Adaptive Pruning Guangmeng Zhou Ke Xu Qi Li Yang Liu Yi Zhao 54 8 0 27 Jun 2021
Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization Chen Liang Simiao Zuo Minshuo Chen Haoming Jiang Xiaodong Liu Pengcheng He T. Zhao Weizhu Chen 59 69 0 25 May 2021
Learning Language Specific Sub-network for Multilingual Machine Translation Zehui Lin Liwei Wu Mingxuan Wang Lei Li 78 84 0 19 May 2021
Learning Twofold Heterogeneous Multi-Task by Sharing Similar Convolution Kernel Pairs Quan Feng Songcan Chen 51 6 0 29 Jan 2021
Finding Sparse Structures for Domain Specific Neural Machine Translation Jianze Liang Chengqi Zhao Mingxuan Wang Xipeng Qiu Lei Li CLL 73 4 0 19 Dec 2020
Unsupervised Natural Language Inference via Decoupled Multimodal Contrastive Learning Wanyun Cui Guangyu Zheng Wei Wang SSL 52 21 0 16 Oct 2020
Multi-Task Learning with Deep Neural Networks: A Survey M. Crawshaw CVBM 220 627 0 10 Sep 2020
NCS4CVR: Neuron-Connection Sharing for Multi-Task Learning in Video Conversion Rate Prediction Xuanji Xiao Huabin Chen Yuzhen Liu Xing Yao Pei Liu Chaosheng Fan Nian Ji Xirong Jiang 20 1 0 22 Aug 2020
On the Transferability of Winning Tickets in Non-Natural Image Datasets M. Sabatelli M. Kestemont Pierre Geurts 64 15 0 11 May 2020
FLAT: Chinese NER Using Flat-Lattice Transformer Xiaonan Li Hang Yan Xipeng Qiu Xuanjing Huang 72 401 0 24 Apr 2020
Progressive Local Filter Pruning for Image Retrieval Acceleration Xiaodong Wang Zhedong Zheng Yang He Fei Yan Zhi-qiang Zeng Yi Yang 85 36 0 24 Jan 2020