Gradient Surgery for Multi-Task Learning

19 January 2020

Abhishek Gupta

Papers citing "Gradient Surgery for Multi-Task Learning"

50 / 198 papers shown

Title
A Survey on Machine Unlearning: Techniques and New Emerged Privacy Risks Hengzhu Liu Ping Xiong Tianqing Zhu Philip S. Yu 35 6 0 10 Jun 2024
Safe and Balanced: A Framework for Constrained Multi-Objective Reinforcement Learning Shangding Gu Bilgehan Sel Yuhao Ding Lu Wang Qingwei Lin Alois Knoll Ming Jin 42 1 0 26 May 2024
Unlearning Concepts in Diffusion Model via Concept Domain Correction and Concept Preserving Gradient Yongliang Wu Shiji Zhou Mingzhuo Yang Lianzhe Wang Wenbo Zhu Heng Chang Xiao Zhou Xu Yang Xu Yang 58 19 0 24 May 2024
Preparing for Black Swans: The Antifragility Imperative for Machine Learning Ming Jin 36 2 0 18 May 2024
Balance Reward and Safety Optimization for Safe Reinforcement Learning: A Perspective of Gradient Manipulation Shangding Gu Bilgehan Sel Yuhao Ding Lu Wang Qingwei Lin Ming Jin Alois Knoll 57 9 0 02 May 2024
CoTBal: Comprehensive Task Balancing for Multi-Task Visual Instruction Tuning Yanqi Dai Dong Jing Nanyi Fei Zhiwu Lu Nanyi Fei Guoxing Yang Zhiwu Lu 55 3 0 07 Mar 2024
Towards Principled Task Grouping for Multi-Task Learning Chenguang Wang Xuanhao Pan Tianshu Yu 31 0 0 23 Feb 2024
Rethinking Invariance Regularization in Adversarial Training to Improve Robustness-Accuracy Trade-off Futa Waseda Ching-Chun Chang Isao Echizen AAML 29 0 0 22 Feb 2024
Multi Task Inverse Reinforcement Learning for Common Sense Reward Neta Glazer Aviv Navon Aviv Shamsian Ethan Fetaya 27 0 0 17 Feb 2024
Robust Analysis of Multi-Task Learning Efficiency: New Benchmarks on Light-Weighed Backbones and Effective Measurement of Multi-Task Learning Challenges by Feature Disentanglement Dayou Mao Yuhao Chen Yifan Wu Maximilian Gilles Alexander Wong AAML 41 0 0 05 Feb 2024
Careful with that Scalpel: Improving Gradient Surgery with an EMA Yu-Guan Hsieh James Thornton Eugène Ndiaye Michal Klein Marco Cuturi Pierre Ablin MedIm 39 0 0 05 Feb 2024
A First-Order Multi-Gradient Algorithm for Multi-Objective Bi-Level Optimization Feiyang Ye Baijiong Lin Xiao-Qun Cao Yu Zhang Ivor Tsang 50 6 0 17 Jan 2024
Enhancing the Performance of Neural Networks Through Causal Discovery and Integration of Domain Knowledge Xiaoge Zhang Xiao-Lin Wang Fenglei Fan Yiu-ming Cheung Indranil Bose 36 1 0 29 Nov 2023
MELA: Multilingual Evaluation of Linguistic Acceptability Ziyin Zhang Yikang Liu Wei Huang Junyu Mao Rui Wang Hai Hu 24 3 0 15 Nov 2023
From Molecules to Materials: Pre-training Large Generalizable Models for Atomic Property Prediction Nima Shoghi Adeesh Kolluru John R. Kitchin Zachary W. Ulissi C. L. Zitnick Brandon M. Wood AI4CE 24 32 0 25 Oct 2023
GradSim: Gradient-Based Language Grouping for Effective Multilingual Training Mingyang Wang Heike Adel Lukas Lange Jannik Strötgen Hinrich Schütze 30 3 0 23 Oct 2023
Adaptive Neural Ranking Framework: Toward Maximized Business Goal for Cascade Ranking Systems Yunli Wang Zhiqiang Wang Jian Yang Shiyang Wen Dongying Kong Han Li Kun Gai 29 10 0 16 Oct 2023
Tackling the Non-IID Issue in Heterogeneous Federated Learning by Gradient Harmonization Xinyu Zhang Weiyu Sun Ying Chen FedML 36 5 0 13 Sep 2023
Post-Deployment Adaptation with Access to Source Data via Federated Learning and Source-Target Remote Gradient Alignment Felix Wagner Zeju Li Pramit Saha Konstantinos Kamnitsas MedIm 8 4 0 31 Aug 2023
Disentanglement Learning via Topology Nikita Balabin Daria Voronkova I. Trofimov Evgeny Burnaev S. Barannikov DRL 58 2 0 24 Aug 2023
GiGaMAE: Generalizable Graph Masked Autoencoder via Collaborative Latent Space Reconstruction Yucheng Shi Yushun Dong Qiaoyu Tan Jundong Li Ninghao Liu 48 24 0 18 Aug 2023
Deep Task-specific Bottom Representation Network for Multi-Task Recommendation Qi Liu Zhilong Zhou Gangwei Jiang T. Ge Defu Lian 18 12 0 11 Aug 2023
Improving Generalization in Visual Reinforcement Learning via Conflict-aware Gradient Agreement Augmentation Siao Liu Zhaoyu Chen Yang Liu Yuzheng Wang Dingkang Yang ... Ziqing Zhou Xie Yi Wei Li Wenqiang Zhang Zhongxue Gan 41 22 0 02 Aug 2023
Isolation and Induction: Training Robust Deep Neural Networks against Model Stealing Attacks Jun Guo Aishan Liu Xingyu Zheng Siyuan Liang Yisong Xiao Yichao Wu Xianglong Liu AAML 35 12 0 02 Aug 2023
TaskExpert: Dynamically Assembling Multi-Task Representations with Memorial Mixture-of-Experts Hanrong Ye Dan Xu MoE 42 26 0 28 Jul 2023
Gradient Surgery for One-shot Unlearning on Generative Model Seohui Bae Seoyoon Kim Hyemin Jung Woohyung Lim BDL MU 24 8 0 10 Jul 2023
Shape Guided Gradient Voting for Domain Generalization Jiaqi Xu Yuwang Wang Xuejin Chen 21 0 0 19 Jun 2023
Fairness in Multi-Task Learning via Wasserstein Barycenters Franccois Hu Philipp Ratz Arthur Charpentier 37 10 0 16 Jun 2023
Sample-Level Weighting for Multi-Task Learning with Auxiliary Tasks Emilie Grégoire M. H. Chaudhary Sam Verboven 24 1 0 07 Jun 2023
FAMO: Fast Adaptive Multitask Optimization B. Liu Yihao Feng Peter Stone Qian Liu 41 30 0 06 Jun 2023
Biologically-Motivated Learning Model for Instructed Visual Processing R. Abel S. Ullman 25 0 0 04 Jun 2023
Addressing Negative Transfer in Diffusion Models Hyojun Go Jinyoung Kim Yunsung Lee Seunghyun Lee Shinhyeok Oh Hyeongdon Moon Seungtaek Choi DiffM VLM 32 24 0 01 Jun 2023
Direction-oriented Multi-objective Learning: Simple and Provable Stochastic Algorithms Peiyao Xiao Hao Ban Kaiyi Ji 32 18 0 28 May 2023
How do languages influence each other? Studying cross-lingual data sharing during LM fine-tuning Rochelle Choenni Dan Garrette Ekaterina Shutova 40 16 0 22 May 2023
FedAds: A Benchmark for Privacy-Preserving CVR Estimation with Vertical Federated Learning Penghui Wei Hongjian Dou Shaoguo Liu Rong Tang Li Liu Liangji Wang Bo Zheng FedML 24 12 0 15 May 2023
On the Pareto Front of Multilingual Neural Machine Translation Liang Chen Shuming Ma Dongdong Zhang Furu Wei Baobao Chang MoE 23 5 0 06 Apr 2023
CGDTest: A Constrained Gradient Descent Algorithm for Testing Neural Networks Vineel Nagisetty Laura Graves Guanting Pan Piyush Jha Vijay Ganesh AAML OOD 34 1 0 04 Apr 2023
Implicit Visual Bias Mitigation by Posterior Estimate Sharpening of a Bayesian Neural Network Rebecca S Stone Nishant Ravikumar A. Bulpitt David C. Hogg BDL 36 0 0 29 Mar 2023
Improving physics-informed neural networks with meta-learned optimization Alexander Bihlo PINN 36 18 0 13 Mar 2023
ViM: Vision Middleware for Unified Downstream Transferring Yutong Feng Biao Gong Jianwen Jiang Yiliang Lv Yujun Shen Deli Zhao Jingren Zhou 32 1 0 13 Mar 2023
HumanBench: Towards General Human-centric Perception with Projector Assisted Pretraining Shixiang Tang Cheng Chen Qingsong Xie Meilin Chen Yizhou Wang ... Feng Zhu Haiyang Yang Li Yi Rui Zhao Wanli Ouyang VLM 26 36 0 10 Mar 2023
SemEval-2023 Task 10: Explainable Detection of Online Sexism Hannah Rose Kirk Wenjie Yin Bertie Vidgen Paul Röttger 21 117 0 07 Mar 2023
Layer Grafted Pre-training: Bridging Contrastive Learning And Masked Image Modeling For Label-Efficient Representations Ziyu Jiang Yinpeng Chen Mengchen Liu Dongdong Chen Xiyang Dai Lu Yuan Zicheng Liu Zhangyang Wang SSL VLM CLIP 38 16 0 27 Feb 2023
Gradient Remedy for Multi-Task Learning in End-to-End Noise-Robust Speech Recognition Yuchen Hu Chen Chen Ruizhe Li Qiu-shi Zhu E. Chng 35 15 0 22 Feb 2023
MaxGNR: A Dynamic Weight Strategy via Maximizing Gradient-to-Noise Ratio for Multi-Task Learning Caoyun Fan Wenqing Chen Jidong Tian Yitian Li Hao He Yaohui Jin 14 2 0 18 Feb 2023
GAT: Guided Adversarial Training with Pareto-optimal Auxiliary Tasks Salah Ghamizi Jingfeng Zhang Maxime Cordy Mike Papadakis Masashi Sugiyama Yves Le Traon AAML 28 2 0 06 Feb 2023
Multipath agents for modular multitask ML systems Andrea Gesmundo 28 1 0 06 Feb 2023
GDOD: Effective Gradient Descent using Orthogonal Decomposition for Multi-Task Learning Xin Dong Ruize Wu Chao Xiong Hai Li Lei Cheng Yong He Shiyou Qian Jian Cao Linjian Mo 6 4 0 31 Jan 2023
Learning Vision-based Robotic Manipulation Tasks Sequentially in Offline Reinforcement Learning Settings Sudhir Pratap Yadav R. Nagar S. Shah OffRL 24 3 0 31 Jan 2023
Wormhole MAML: Meta-Learning in Glued Parameter Space C. Chang Yuan Gao B. Lou 29 0 0 28 Dec 2022