v1v2 (latest)

When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applications

21 October 2023

Xiangyu Zhao

Papers citing "When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applications"

21 / 21 papers shown

Title
ConTextual: Improving Clinical Text Summarization in LLMs with Context-preserving Token Filtering and Knowledge Graphs Fahmida Liza Piya Rahmatollah Beheshti 265 0 0 23 Apr 2025
Large Language Model Distilling Medication Recommendation Model Qidong Liu Xian Wu Xiangyu Zhao Yuanshao Zhu Zijian Zhang Feng Tian Yefeng Zheng LM&MA 125 20 0 28 Jan 2025
TAPO: Task-Referenced Adaptation for Prompt Optimization Wenxin Luo Wenjie Wang Xiaopeng Li Weibo Zhou Pengyue Jia Xiangyu Zhao 108 0 0 12 Jan 2025
A Contrastive Pretrain Model with Prompt Tuning for Multi-center Medication Recommendation Qiang Liu Zhaopeng Qiu Xiangyu Zhao X. Wu Zijian Zhang Tong Xu Feng Tian 123 0 0 31 Dec 2024
MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning Yaming Yang Dilxat Muhtar Yelong Shen Yuefeng Zhan Jianfeng Liu ... Denvy Deng Feng Sun Qi Zhang Weizhu Chen Yunhai Tong MoE MoMe 128 4 0 12 Oct 2024
Baichuan 2: Open Large-scale Language Models Ai Ming Yang Bin Xiao Bingning Wang Borong Zhang Ce Bian ... Youxin Jiang Yuchen Gao Yupeng Zhang Guosheng Dong Zhiying Wu ELM LRM 209 751 0 19 Sep 2023
LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition Chengsong Huang Qian Liu Bill Yuchen Lin Tianyu Pang Chao Du Min Lin MoMe 103 214 0 25 Jul 2023
Recommender Systems in the Era of Large Language Models (LLMs) Zihuai Zhao Wenqi Fan Jiatong Li Yunqing Liu Xiaowei Mei ... Zhen Wen Fei Wang Xiangyu Zhao Jiliang Tang Qing Li KELM 138 344 0 05 Jul 2023
A Comprehensive Survey on Trustworthy Recommender Systems Wenqi Fan Xiangyu Zhao Xiao Chen Jingran Su Jingtong Gao ... Qidong Liu Yiqi Wang Hanfeng Xu Lei Chen Qing Li FaML 90 47 0 21 Sep 2022
Hyper-X: A Unified Hypernetwork for Multi-Task Multilingual Transfer Ahmet Üstün Arianna Bisazza G. Bouma Gertjan van Noord Sebastian Ruder 114 33 0 24 May 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 847 9,683 0 28 Jan 2022
LoRA: Low-Rank Adaptation of Large Language Models J. E. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang Weizhu Chen OffRL AI4TS AI4CE ALM AIMat 493 10,526 0 17 Jun 2021
Scaling Vision with Sparse Mixture of Experts C. Riquelme J. Puigcerver Basil Mustafa Maxim Neumann Rodolphe Jenatton André Susano Pinto Daniel Keysers N. Houlsby MoE 112 609 0 10 Jun 2021
GLM: General Language Model Pretraining with Autoregressive Blank Infilling Zhengxiao Du Yujie Qian Xiao Liu Ming Ding J. Qiu Zhilin Yang Jie Tang BDL AI4CE 142 1,554 0 18 Mar 2021
One Model to Serve All: Star Topology Adaptive Recommender for Multi-Domain CTR Prediction Xiang-Rong Sheng Liqin Zhao Guorui Zhou Xinyao Ding Binding Dai ... Siran Yang Jingshan Lv Chi Zhang Hongbo Deng Xiaoqiang Zhu LRM 56 186 0 27 Jan 2021
Prefix-Tuning: Optimizing Continuous Prompts for Generation Xiang Lisa Li Percy Liang 252 4,305 0 01 Jan 2021
Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning Armen Aghajanyan Luke Zettlemoyer Sonal Gupta 107 570 1 22 Dec 2020
Multi-Task Learning with Deep Neural Networks: A Survey M. Crawshaw CVBM 217 625 0 10 Sep 2020
Macro F1 and Macro F1 Juri Opitz S. Burst 64 180 0 08 Nov 2019
Dice Loss for Data-imbalanced NLP Tasks Xiaoya Li Xiaofei Sun Yuxian Meng Junjun Liang Leilei Gan Jiwei Li 91 588 0 07 Nov 2019
A Survey on Multi-Task Learning Yu Zhang Qiang Yang AIMat 605 2,243 0 25 Jul 2017