Scalable Multitask Learning Using Gradient-based Estimation of Task Affinity

9 September 2024

Papers citing "Scalable Multitask Learning Using Gradient-based Estimation of Task Affinity"

25 / 25 papers shown

Title
Towards Principled Task Grouping for Multi-Task Learning Chenguang Wang Xuanhao Pan Tianshu Yu 154 1 0 23 Feb 2024
Fine-Tuning Language Models with Just Forward Passes Sadhika Malladi Tianyu Gao Eshaan Nichani Alexandru Damian Jason D. Lee Danqi Chen Sanjeev Arora 115 196 0 27 May 2023
"It's a Match!" -- A Benchmark of Task Affinity Scores for Joint Learning Raphaël Azorin Massimo Gallo A. Finamore Dario Rossi Pietro Michiardi 109 1 0 07 Jan 2023
An Information-Theoretic Approach to Transferability in Task Transfer Learning Yajie Bao Yongni Li Shao-Lun Huang Lin Zhang Lizhong Zheng Amir Zamir Leonidas Guibas 61 121 0 20 Dec 2022
A Kernel-Based View of Language Model Fine-Tuning Sadhika Malladi Alexander Wettig Dingli Yu Danqi Chen Sanjeev Arora VLM 112 67 0 11 Oct 2022
Auto-Lambda: Disentangling Dynamic Task Relationships Shikun Liu Stephen James Andrew J. Davison Edward Johns 86 75 0 07 Feb 2022
PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts Stephen H. Bach Victor Sanh Zheng-Xin Yong Albert Webson Colin Raffel ... Khalid Almubarak Xiangru Tang Dragomir R. Radev Mike Tian-Jian Jiang Alexander M. Rush VLM 322 348 0 02 Feb 2022
Datamodels: Predicting Predictions from Training Data Andrew Ilyas Sung Min Park Logan Engstrom Guillaume Leclerc Aleksander Madry TDI 115 140 0 01 Feb 2022
SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer Tu Vu Brian Lester Noah Constant Rami Al-Rfou Daniel Cer VLM LRM 198 286 0 15 Oct 2021
Efficiently Identifying Task Groupings for Multi-Task Learning Christopher Fifty Ehsan Amid Zhe Zhao Tianhe Yu Rohan Anil Chelsea Finn 277 254 1 10 Sep 2021
LoRA: Low-Rank Adaptation of Large Language Models J. E. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang Weizhu Chen OffRL AI4TS AI4CE ALM AIMat 466 10,367 0 17 Jun 2021
Precise High-Dimensional Asymptotics for Quantifying Heterogeneous Transfers Fan Yang Hongyang R. Zhang Sen Wu Christopher Ré Weijie J. Su 94 11 0 22 Oct 2020
Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self-Training Approach Yue Yu Simiao Zuo Haoming Jiang Wendi Ren T. Zhao Chao Zhang AI4MH 48 133 0 15 Oct 2020
Transfer Learning of Graph Neural Networks with Ego-graph Information Maximization Qi Zhu Carl Yang Yidan Xu Haonan Wang Chao Zhang Jiawei Han 100 119 0 11 Sep 2020
Graph Clustering with Graph Neural Networks Anton Tsitsulin John Palowitch Bryan Perozzi Emmanuel Müller GNN AI4CE 78 266 0 30 Jun 2020
Learning to Branch for Multi-Task Learning Pengsheng Guo Chen-Yu Lee Daniel Ulbricht 56 179 0 02 Jun 2020
Meta-Learning in Neural Networks: A Survey Timothy M. Hospedales Antreas Antoniou P. Micaelli Amos Storkey OOD 393 1,979 0 11 Apr 2020
Which Tasks Should Be Learned Together in Multi-task Learning? Trevor Scott Standley Amir Zamir Dawn Chen Leonidas Guibas Jitendra Malik Silvio Savarese 103 517 0 18 May 2019
Branched Multi-Task Networks: Deciding What Layers To Share Simon Vandenhende Stamatios Georgoulis Bert De Brabandere Luc Van Gool 94 145 0 05 Apr 2019
VERSE: Versatile Graph Embeddings from Similarity Measures Anton Tsitsulin Davide Mottin Panagiotis Karras Emmanuel Müller 58 269 0 13 Mar 2018
A Survey on Multi-Task Learning Yu Zhang Qiang Yang AIMat 605 2,230 0 25 Jul 2017
Understanding Black-box Predictions via Influence Functions Pang Wei Koh Percy Liang TDI 210 2,894 0 14 Mar 2017
node2vec: Scalable Feature Learning for Networks Aditya Grover J. Leskovec 186 10,876 0 03 Jul 2016
Best Subset Selection via a Modern Optimization Lens Dimitris Bertsimas Angela King Rahul Mazumder 435 663 0 11 Jul 2015
Relax, no need to round: integrality of clustering formulations Pranjal Awasthi Afonso S. Bandeira Moses Charikar Ravishankar Krishnaswamy Soledad Villar Rachel A. Ward 130 114 0 18 Aug 2014