v1v2 (latest)

Adapting Auxiliary Losses Using Gradient Similarity

5 December 2018

Yunshu Du

Wojciech M. Czarnecki

Siddhant M. Jayakumar

Mehrdad Farajtabar

Razvan Pascanu

Balaji Lakshminarayanan

ArXiv (abs)PDF HTML

Papers citing "Adapting Auxiliary Losses Using Gradient Similarity"

50 / 100 papers shown

Title
Multi-task Learning for Heterogeneous Multi-source Block-Wise Missing Data Yang Sui Qi Xu Y. Bai Annie Qu 39 2 0 30 May 2025
OASIS: Online Sample Selection for Continual Visual Instruction Tuning Minjae Lee Minhyuk Seo Tingyu Qu Tinne Tuytelaars Jonghyun Choi VLM 17 1 0 27 May 2025
Generalized Task-Driven Medical Image Quality Enhancement with Gradient Promotion Dong Zhang Kwang-Ting Cheng MedIm 141 0 0 03 Jan 2025
AMAGO-2: Breaking the Multi-Task Barrier in Meta-Reinforcement Learning with Transformers Jake Grigsby Justin Sasek Samyak Parajuli Daniel Adebi Amy Zhang Yuke Zhu OffRL 68 6 0 17 Nov 2024
Budgeted Online Continual Learning by Adaptive Layer Freezing and Frequency-based Sampling Minhyuk Seo Hyunseo Koh Jonghyun Choi 100 3 0 19 Oct 2024
Using dynamic loss weighting to boost improvements in forecast stability Daan Caljon Jeff Vercauteren Simon De Vos Wouter Verbeke Jente Van Belle 111 0 0 26 Sep 2024
Learning Representation for Multitask learning through Self Supervised Auxiliary learning Seokwon Shin Hyungrok Do Youngdoo Son SSL 73 1 0 25 Sep 2024
Can Optimization Trajectories Explain Multi-Task Transfer? David Mueller Mark Dredze Nicholas Andrews 138 1 0 26 Aug 2024
Mixture-of-Skills: Learning to Optimize Data Usage for Fine-Tuning Large Language Models Minghao Wu Thuy-Trang Vu Zhuang Li Gholamreza Haffari 72 6 0 13 Jun 2024
$α$ VIL: Learning to Leverage Auxiliary Tasks for Multitask Learning Rafael Kourdis Gabriel Gordon-Hall P. Gorinski 37 0 0 13 May 2024
Aux-NAS: Exploiting Auxiliary Labels with Negligibly Extra Inference Cost Yuan Gao Weizhong Zhang Wenhan Luo Lin Ma Jin-Gang Yu Gui-Song Xia Jiayi Ma 75 1 0 09 May 2024
Grad Queue : A probabilistic framework to reinforce sparse gradients Irfan Mohammad Al Hasib 78 0 0 25 Apr 2024
Make Continual Learning Stronger via C-Flat Ang Bian Wei Li Hangjie Yuan Chengrong Yu Zixiang Zhao Mang Wang Aojun Lu Tao Feng 77 12 0 01 Apr 2024
Improving Image Coding for Machines through Optimizing Encoder via Auxiliary Loss Kei Iino Shunsuke Akamatsu Hiroshi Watanabe Shohei Enomoto Akira Sakamoto Takeharu Eda 40 0 0 13 Feb 2024
Two-Stage Multi-task Self-Supervised Learning for Medical Image Segmentation Binyan Hu •. A. K. Qin SSL 45 0 0 11 Feb 2024
Careful with that Scalpel: Improving Gradient Surgery with an EMA Yu-Guan Hsieh James Thornton Eugène Ndiaye Michal Klein Marco Cuturi Pierre Ablin MedIm 77 0 0 05 Feb 2024
Enhancing Molecular Property Prediction with Auxiliary Learning and Task-Specific Adaptation Vishal Dey Xia Ning AAML AI4CE 71 1 0 29 Jan 2024
Gradient Shaping for Multi-Constraint Safe Reinforcement Learning Yi-Fan Yao Zuxin Liu Zhepeng Cen Peide Huang Tingnan Zhang Wenhao Yu Ding Zhao OffRL 156 6 0 23 Dec 2023
D4AM: A General Denoising Framework for Downstream Acoustic Models H. Wang Yu Tsao Hsin-Min Wang Chu-Song Chen 65 4 0 28 Nov 2023
Fast-Slow Test-Time Adaptation for Online Vision-and-Language Navigation Junyu Gao Xuan Yao Changsheng Xu TTA 136 5 0 22 Nov 2023
FairBranch: Fairness Conflict Correction on Task-group Branches for Fair Multi-Task Learning Arjun Roy C. Koutlis Symeon Papadopoulos Eirini Ntoutsi 68 0 0 20 Oct 2023
Scalarization for Multi-Task and Multi-Domain Learning at Scale Amelie Royer Tijmen Blankevoort B. Bejnordi 93 18 0 13 Oct 2023
Label Budget Allocation in Multi-Task Learning Ximeng Sun Kihyuk Sohn Kate Saenko Clayton Mellina Xiao Bian 83 0 0 24 Aug 2023
When Multi-Task Learning Meets Partial Supervision: A Computer Vision Review Maxime Fontana Michael W. Spratling Miaojing Shi 85 7 0 25 Jul 2023
Overcoming Distribution Mismatch in Quantizing Image Super-Resolution Networks Chee Hong Kyoung Mu Lee SupR MQ 48 1 0 25 Jul 2023
Auxiliary-Tasks Learning for Physics-Informed Neural Network-Based Partial Differential Equations Solving Junjun Yan Xinhai Chen Zhichao Wang Enqiang Zhou Jie Liu PINN AI4CE 83 1 0 12 Jul 2023
Measuring and Mitigating Interference in Reinforcement Learning Vincent Liu Han Wang Ruo Yu Tao Khurram Javed Adam White Martha White 110 6 0 10 Jul 2023
MultiWave: Multiresolution Deep Architectures through Wavelet Decomposition for Multivariate Time Series Prediction I. Deznabi M. Fiterau AI4TS 63 6 0 16 Jun 2023
Sample-Level Weighting for Multi-Task Learning with Auxiliary Tasks Emilie Grégoire M. H. Chaudhary Sam Verboven 72 2 0 07 Jun 2023
Exploring the Relationship between Alignment and Cross-lingual Transfer in Multilingual Transformers Félix Gaschi Patricio Cerda Parisa Rastin Y. Toussaint 88 13 0 05 Jun 2023
Investigating Navigation Strategies in the Morris Water Maze through Deep Reinforcement Learning A. Liu Alla Borisyuk 48 7 0 01 Jun 2023
SRIL: Selective Regularization for Class-Incremental Learning Jisu Han Jaemin Na Wonjun Hwang CLL 141 0 0 09 May 2023
CRRS: Concentric Rectangles Regression Strategy for Multi-point Representation on Fisheye Images Xihan Wang Xi Xu Yu Gao Yi Yang Yufeng Yue M. Fu 62 0 0 26 Mar 2023
Improving Few-Shot Generalization by Exploring and Exploiting Auxiliary Data Alon Albalak Colin Raffel William Yang Wang 89 12 0 01 Feb 2023
Auxiliary Learning as an Asymmetric Bargaining Game Aviv Shamsian Aviv Navon Neta Glazer Kenji Kawaguchi Gal Chechik Ethan Fetaya 84 8 0 31 Jan 2023
GDOD: Effective Gradient Descent using Orthogonal Decomposition for Multi-Task Learning Xin Dong Ruize Wu Chao Xiong Hai Li Lei Cheng Yong He Shiyou Qian Jian Cao Linjian Mo 73 5 0 31 Jan 2023
ForkMerge: Mitigating Negative Transfer in Auxiliary-Task Learning Junguang Jiang Baixu Chen Junwei Pan Ximei Wang Liu Dapeng Jie Jiang Mingsheng Long MoMe 66 22 0 30 Jan 2023
Gradient Imitation Reinforcement Learning for General Low-Resource Information Extraction Xuming Hu Shiao Meng Chenwei Zhang Xiangli Yang Lijie Wen Irwin King Philip S. Yu 92 0 0 11 Nov 2022
Auxiliary task discovery through generate-and-test Banafsheh Rafiee Sina Ghiassian Jun Jin R. Sutton Jun Luo Adam White 93 0 0 25 Oct 2022
Resolving Class Imbalance for LiDAR-based Object Detector by Dynamic Weight Average and Contextual Ground Truth Sampling Daeun Lee Jong-Hwa Park Jinkyu Kim 3DPC 36 0 0 07 Oct 2022
Adaptive Meta-learner via Gradient Similarity for Few-shot Text Classification Tianyi Lei Honghui Hu Qiaoyang Luo Dezhong Peng Xu Wang 68 12 0 10 Sep 2022
Fix-A-Step: Semi-supervised Learning from Uncurated Unlabeled Data Zhe Huang Mary-Joy Sidhom B. Wessler M. C. Hughes 72 10 0 25 Aug 2022
Switchable Representation Learning Framework with Self-compatibility Shengsen Wu Yan Bai Yihang Lou Xiongkun Linghu Jianzhong He Ling-yu Duan 83 1 0 16 Jun 2022
The CLRS Algorithmic Reasoning Benchmark Petar Velivcković Adria Puigdomenech Badia David Budden Razvan Pascanu Andrea Banino Mikhail Dashevskiy R. Hadsell Charles Blundell 211 96 0 31 May 2022
Recent Advances in Embedding Methods for Multi-Object Tracking: A Survey Gaoang Wang Xiuming Zhang Lei Li VOT 165 17 0 22 May 2022
It's All In the Teacher: Zero-Shot Quantization Brought Closer to the Teacher Kanghyun Choi Hye Yoon Lee Deokki Hong Joonsang Yu Noseong Park Youngsok Kim Jinho Lee MQ 101 33 0 31 Mar 2022
MetaBalance: Improving Multi-Task Recommendations via Adapting Gradient Magnitudes of Auxiliary Tasks Yun He Xuening Feng Cheng Cheng Geng Ji Yunsong Guo James Caverlee 68 43 0 14 Mar 2022
Deep AutoAugment Yu Zheng Zikai Zhang Shen Yan Mi Zhang ViT 100 28 0 11 Mar 2022
Multi-Agent Policy Transfer via Task Relationship Modeling Rongjun Qin F. Chen Tonghan Wang Lei Yuan Xiaoran Wu Zongzhang Zhang Chongjie Zhang Yang Yu 86 20 0 09 Mar 2022
On Steering Multi-Annotations per Sample for Multi-Task Learning Yuan Li Yiwen Guo Qizhang Li Hongzhi Zhang W. Zuo 56 0 0 06 Mar 2022