Jacobian Descent for Multi-Objective Optimization

23 June 2024

Papers citing "Jacobian Descent for Multi-Objective Optimization"

29 / 29 papers shown

Title
GO4Align: Group Optimization for Multi-Task Alignment Jiayi Shen Cheems Wang Zehao Xiao Nanne van Noord M. Worring 72 4 0 09 Apr 2024
Three-Way Trade-Off in Multi-Objective Learning: Optimization, Generalization and Conflict-Avoidance Lisha Chen H. Fernando Yiming Ying Tianyi Chen 50 23 0 31 May 2023
Independent Component Alignment for Multi-Task Learning Dmitry Senushkin Nikolay Patakin Arseny Kuznetsov Anton Konushin CVBM 71 41 0 30 May 2023
Direction-oriented Multi-objective Learning: Simple and Provable Stochastic Algorithms Peiyao Xiao Hao Ban Kaiyi Ji 82 20 0 28 May 2023
Do Current Multi-Task Optimization Methods in Deep Learning Even Help? Derrick Xin Behrooz Ghorbani Ankush Garg Orhan Firat Justin Gilmer MoMe 93 65 0 23 Sep 2022
Multi-Task Learning as a Bargaining Game Aviv Navon Aviv Shamsian Idan Achituve Haggai Maron Kenji Kawaguchi Gal Chechik Ethan Fetaya 66 145 0 02 Feb 2022
In Defense of the Unitary Scalarization for Deep Multi-Task Learning Vitaly Kurin Alessandro De Palma Ilya Kostrikov Shimon Whiteson M. P. Kumar 67 75 0 11 Jan 2022
Reasonable Effectiveness of Random Weighting: A Litmus Test for Multi-Task Learning Baijiong Lin Feiyang Ye Yu Zhang Ivor W. Tsang 69 95 0 20 Nov 2021
Conflict-Averse Gradient Descent for Multi-task Learning Bo Liu Xingchao Liu Xiaojie Jin Peter Stone Qiang Liu 69 304 0 26 Oct 2021
Efficiently Identifying Task Groupings for Multi-Task Learning Christopher Fifty Ehsan Amid Zhe Zhao Tianhe Yu Rohan Anil Chelsea Finn 264 243 1 10 Sep 2021
Just Pick a Sign: Optimizing Deep Multitask Models with Gradient Sign Dropout Zhao Chen Jiquan Ngiam Yanping Huang Thang Luong Henrik Kretzschmar Yuning Chai Dragomir Anguelov 61 212 0 14 Oct 2020
Gradient Surgery for Multi-Task Learning Tianhe Yu Saurabh Kumar Abhishek Gupta Sergey Levine Karol Hausman Chelsea Finn 114 1,190 0 19 Jan 2020
Advances and Open Problems in Federated Learning Peter Kairouz H. B. McMahan Brendan Avent A. Bellet M. Bennis ... Zheng Xu Qiang Yang Felix X. Yu Han Yu Sen Zhao FedML AI4CE 129 6,177 0 10 Dec 2019
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 282 42,038 0 03 Dec 2019
The stochastic multi-gradient algorithm for multi-objective optimization and its application to supervised machine learning Suyun Liu Luis Nunes Vicente 103 74 0 10 Jul 2019
Deep Learning for Classical Japanese Literature Tarin Clanuwat Mikel Bober-Irizar A. Kitamoto Alex Lamb Kazuaki Yamamoto David R Ha 71 705 0 03 Dec 2018
Multi-Task Learning as Multi-Objective Optimization Ozan Sener V. Koltun 112 1,266 0 10 Oct 2018
Taskonomy: Disentangling Task Transfer Learning Amir Zamir Alexander Sax Bokui (William) Shen Leonidas Guibas Jitendra Malik Silvio Savarese 78 1,209 0 23 Apr 2018
Byzantine-Robust Distributed Learning: Towards Optimal Statistical Rates Dong Yin Yudong Chen Kannan Ramchandran Peter L. Bartlett OOD FedML 72 1,483 0 05 Mar 2018
The Hidden Vulnerability of Distributed Learning in Byzantium El-Mahdi El-Mhamdi R. Guerraoui Sébastien Rouault AAML FedML 57 743 0 22 Feb 2018
EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification P. Helber B. Bischke Andreas Dengel Damian Borth 106 1,790 0 31 Aug 2017
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms Han Xiao Kashif Rasul Roland Vollgraf 178 8,807 0 25 Aug 2017
Gradient Episodic Memory for Continual Learning David Lopez-Paz MarcÁurelio Ranzato VLM CLL 72 2,684 0 26 Jun 2017
An Overview of Multi-Task Learning in Deep Neural Networks Sebastian Ruder CVBM 98 2,817 0 15 Jun 2017
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) Djork-Arné Clevert Thomas Unterthiner Sepp Hochreiter 220 5,502 0 23 Nov 2015
Domain-Adversarial Training of Neural Networks Yaroslav Ganin E. Ustinova Hana Ajakan Pascal Germain Hugo Larochelle François Laviolette M. Marchand Victor Lempitsky GAN OOD 347 9,418 0 28 May 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 354 43,154 0 11 Feb 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 907 149,474 0 22 Dec 2014
Learning Task Grouping and Overlap in Multi-task Learning Abhishek Kumar Hal Daumé 243 526 0 27 Jun 2012