Gradient Surgery for Multi-Task Learning

19 January 2020

Abhishek Gupta

Papers citing "Gradient Surgery for Multi-Task Learning"

48 / 198 papers shown

Title
Learning Multiple Dense Prediction Tasks from Partially Annotated Data Weihong Li Xialei Liu Hakan Bilen 45 39 0 29 Nov 2021
Cross-Task Consistency Learning Framework for Multi-Task Learning Akihiro Nakano Shi Chen K. Demachi CVBM 22 3 0 28 Nov 2021
PolyViT: Co-training Vision Transformers on Images, Videos and Audio Valerii Likhosherstov Anurag Arnab K. Choromanski Mario Lucic Yi Tay Adrian Weller Mostafa Dehghani ViT 35 73 0 25 Nov 2021
Multi-Task Neural Processes Jiayi Shen Xiantong Zhen M. Worring Ling Shao BDL 21 8 0 10 Nov 2021
Generalization in Dexterous Manipulation via Geometry-Aware Multi-Task Learning Wenlong Huang Igor Mordatch Pieter Abbeel Deepak Pathak 37 63 0 04 Nov 2021
Towards Fairness-Aware Federated Learning Yuxin Shi Han Yu Cyril Leung FedML 21 79 0 02 Nov 2021
Conflict-Averse Gradient Descent for Multi-task Learning Bo Liu Xingchao Liu Xiaojie Jin Peter Stone Qiang Liu 47 297 0 26 Oct 2021
Game of Gradients: Mitigating Irrelevant Clients in Federated Learning Lokesh Nagalapatti Mahdi S. Hosseini FedML 22 75 0 23 Oct 2021
Speech Representation Learning Through Self-supervised Pretraining And Multi-task Finetuning Yi-Chen Chen Shu-Wen Yang Cheng-Kuang Lee Simon See Hung-yi Lee SSL 19 12 0 18 Oct 2021
Learning Multi-Objective Curricula for Robotic Policy Learning Jikun Kang Miao Liu Abhinav Gupta C. Pal Xue Liu Jie Fu 36 4 0 06 Oct 2021
ClimateGAN: Raising Climate Change Awareness by Generating Images of Floods Victor Schmidt A. Luccioni Mélisande Teng Tianyu Zhang Alexia Reynaud ... Gautier Cosne Adrien Juraver V. Vardanyan Alex Hernandez-Garcia Yoshua Bengio GAN AI4CE 23 18 0 06 Oct 2021
Sequential Reptile: Inter-Task Gradient Alignment for Multilingual Learning Seanie Lee Haebeom Lee Juho Lee Sung Ju Hwang MoMe CLL 40 16 0 06 Oct 2021
Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasets F. Ebert Yanlai Yang Karl Schmeckpeper Bernadette Bucher G. Georgakis Kostas Daniilidis Chelsea Finn Sergey Levine 169 219 0 27 Sep 2021
Improved optimization strategies for deep Multi-Task Networks Lucas Pascal Pietro Michiardi Xavier Bost B. Huet Maria A. Zuluaga 35 6 0 21 Sep 2021
SLAW: Scaled Loss Approximate Weighting for Efficient Multi-Task Learning M. Crawshaw Jana Kosecka 20 7 0 16 Sep 2021
Conservative Data Sharing for Multi-Task Offline Reinforcement Learning Tianhe Yu Aviral Kumar Yevgen Chebotar Karol Hausman Sergey Levine Chelsea Finn OffRL 35 77 0 16 Sep 2021
Fishr: Invariant Gradient Variances for Out-of-Distribution Generalization Alexandre Ramé Corentin Dancette Matthieu Cord OOD 40 204 0 07 Sep 2021
Multi-Task Self-Training for Learning General Representations Golnaz Ghiasi Barret Zoph E. D. Cubuk Quoc V. Le Nayeon Lee SSL 24 100 0 25 Aug 2021
Auxiliary Task Update Decomposition: The Good, The Bad and The Neutral Lucio Dery Yann N. Dauphin David Grangier MoMe 13 29 0 25 Aug 2021
Domain Generalization via Gradient Surgery Lucas Mansilla Rodrigo Echeveste Diego H. Milone Enzo Ferrante OOD 22 78 0 03 Aug 2021
Multi-modal Residual Perceptron Network for Audio-Video Emotion Recognition Xin Chang W. Skarbek 22 19 0 21 Jul 2021
Evaluating the progress of Deep Reinforcement Learning in the real world: aligning domain-agnostic and domain-specific research J. Luis E. Crawley B. Cameron OffRL 25 6 0 07 Jul 2021
Relational graph convolutional networks for predicting blood-brain barrier penetration of drug molecules Yan Ding Xiaoqian Jiang Yejin Kim GNN 22 19 0 04 Jul 2021
Stabilizing Deep Q-Learning with ConvNets and Vision Transformers under Data Augmentation Nicklas Hansen H. Su Xiaolong Wang OffRL 26 134 0 01 Jul 2021
Modularity in Reinforcement Learning via Algorithmic Independence in Credit Assignment Michael Chang Sid Kaushik Sergey Levine Thomas L. Griffiths 31 8 0 28 Jun 2021
Same State, Different Task: Continual Reinforcement Learning without Interference Samuel Kessler Jack Parker-Holder Philip J. Ball S. Zohren Stephen J. Roberts CLL OffRL 19 46 0 05 Jun 2021
Understanding and Improving Fairness-Accuracy Trade-offs in Multi-Task Learning Yuyan Wang Xuezhi Wang Alex Beutel Flavien Prost Jilin Chen Ed H. Chi FaML 27 47 0 04 Jun 2021
Privacy-Preserving Constrained Domain Generalization via Gradient Alignment Chris Xing Tian Haoliang Li Yufei Wang Shiqi Wang 13 4 0 14 May 2021
Adversarial Multi-task Learning Enhanced Physics-informed Neural Networks for Solving Partial Differential Equations Pongpisit Thanasutives M. Numao Ken-ichi Fukui AI4CE 22 24 0 29 Apr 2021
ImageNet-21K Pretraining for the Masses T. Ridnik Emanuel Ben-Baruch Asaf Noy Lihi Zelnik-Manor SSeg VLM CLIP 181 687 0 22 Apr 2021
MT-Opt: Continuous Multi-Task Robotic Reinforcement Learning at Scale Dmitry Kalashnikov Jacob Varley Yevgen Chebotar Benjamin Swanson Rico Jonschkowski Chelsea Finn Sergey Levine Karol Hausman OffRL 47 270 0 16 Apr 2021
Continual Learning for Text Classification with Information Disentanglement Based Regularization Yufan Huang Yanzhe Zhang Jiaao Chen Xuezhi Wang Diyi Yang CLL 17 106 0 12 Apr 2021
Universal Representation Learning from Multiple Domains for Few-shot Classification Weihong Li Xialei Liu Hakan Bilen SSL OOD VLM 30 84 0 25 Mar 2021
RotoGrad: Gradient Homogenization in Multitask Learning Adrián Javaloy Isabel Valera 21 86 0 03 Mar 2021
Multi-Task Reinforcement Learning with Context-based Representations Shagun Sodhani Amy Zhang Joelle Pineau 32 181 0 11 Feb 2021
MLPF: Efficient machine-learned particle-flow reconstruction using graph neural networks J. Pata Javier Mauricio Duarte J. Vlimant M. Pierini M. Spiropulu 113 76 0 21 Jan 2021
Atlas-ISTN: Joint Segmentation, Registration and Atlas Construction with Image-and-Spatial Transformer Networks Matthew Sinclair A. Schuh K. Hahn K. Petersen Ying Bai James Batten M. Schaap Ben Glocker 25 29 0 18 Dec 2020
Detecting 32 Pedestrian Attributes for Autonomous Vehicles Taylor Mordan Matthieu Cord P. Pérez Alexandre Alahi 24 22 0 04 Dec 2020
Measuring and Harnessing Transference in Multi-Task Learning Christopher Fifty Ehsan Amid Zhe Zhao Tianhe Yu Rohan Anil Chelsea Finn 28 15 0 29 Oct 2020
Just Pick a Sign: Optimizing Deep Multitask Models with Gradient Sign Dropout Zhao Chen Jiquan Ngiam Yanping Huang Thang Luong Henrik Kretzschmar Yuning Chai Dragomir Anguelov 41 206 0 14 Oct 2020
A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap Matrix T. Doan Mehdi Abbana Bennani Bogdan Mazoure Guillaume Rabusseau Pierre Alquier CLL 17 80 0 07 Oct 2020
Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data Jonathan Pilault Amine Elhattami C. Pal CLL MoE 24 89 0 19 Sep 2020
Multi-Task Learning with Deep Neural Networks: A Survey M. Crawshaw CVBM 48 609 0 10 Sep 2020
Generalisation Guarantees for Continual Learning with Orthogonal Gradient Descent Mehdi Abbana Bennani Thang Doan Masashi Sugiyama CLL 50 61 0 21 Jun 2020
Meta-Learning in Neural Networks: A Survey Timothy M. Hospedales Antreas Antoniou P. Micaelli Amos Storkey OOD 49 1,928 0 11 Apr 2020
Multi-Task Reinforcement Learning with Soft Modularization Ruihan Yang Huazhe Xu Yi Wu Xiaolong Wang 27 175 0 30 Mar 2020
Rewriting History with Inverse RL: Hindsight Inference for Policy Improvement Benjamin Eysenbach Xinyang Geng Sergey Levine Ruslan Salakhutdinov OffRL 18 86 0 25 Feb 2020
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation Vijay Badrinarayanan Alex Kendall R. Cipolla SSeg 446 15,639 0 02 Nov 2015