Does Learning from Decentralized Non-IID Unlabeled Data Benefit from Self Supervision?

20 October 2022

Yunzhu Li

Papers citing "Does Learning from Decentralized Non-IID Unlabeled Data Benefit from Self Supervision?"

23 / 23 papers shown

Title
LW-FedSSL: Resource-efficient Layer-wise Federated Self-supervised Learning Ye Lin Tun Chu Myaet Thwal Le Quang Huy Minh N. H. Nguyen Choong Seon Hong FedML 88 2 0 22 Jan 2024
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 427 7,705 0 11 Nov 2021
Can contrastive learning avoid shortcut solutions? Joshua Robinson Li Sun Ke Yu Kayhan Batmanghelich Stefanie Jegelka S. Sra SSL 69 144 0 21 Jun 2021
Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Loss Jeff Z. HaoChen Colin Wei Adrien Gaidon Tengyu Ma SSL 52 315 0 08 Jun 2021
FedBN: Federated Learning on Non-IID Features via Local Batch Normalization Xiaoxiao Li Meirui Jiang Xiaofei Zhang Michael Kamp Qi Dou OOD FedML 271 809 0 15 Feb 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 419 3,826 0 11 Feb 2021
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 247 4,047 0 20 Nov 2020
Contrastive learning, multi-view redundancy, and linear models Christopher Tosh A. Krishnamurthy Daniel J. Hsu SSL 63 166 0 24 Aug 2020
Federated Semi-Supervised Learning with Inter-Client Consistency & Disjoint Learning Wonyong Jeong Jaehong Yoon Eunho Yang Sung Ju Hwang FedML 51 220 0 22 Jun 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 215 4,070 0 17 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 345 6,773 0 13 Jun 2020
Three Approaches for Personalization with Applications to Federated Learning Yishay Mansour M. Mohri Jae Hun Ro A. Suresh FedML 131 574 0 25 Feb 2020
Advances and Open Problems in Federated Learning Peter Kairouz H. B. McMahan Brendan Avent A. Bellet M. Bennis ... Zheng Xu Qiang Yang Felix X. Yu Han Yu Sen Zhao FedML AI4CE 210 6,229 0 10 Dec 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 177 12,065 0 13 Nov 2019
The Non-IID Data Quagmire of Decentralized Machine Learning Kevin Hsieh Amar Phanishayee O. Mutlu Phillip B. Gibbons 137 566 0 01 Oct 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 155 2,395 0 13 Jun 2019
Dense Object Nets: Learning Dense Visual Object Descriptors By and For Robotic Manipulation Peter R. Florence Lucas Manuelli Russ Tedrake SSL 90 278 0 22 Jun 2018
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction Leland McInnes John Healy James Melville 154 9,390 0 09 Feb 2018
Decoupled Weight Decay Regularization I. Loshchilov Frank Hutter OffRL 132 2,132 0 14 Nov 2017
Federated Learning: Strategies for Improving Communication Efficiency Jakub Konecný H. B. McMahan Felix X. Yu Peter Richtárik A. Suresh Dave Bacon FedML 291 4,636 0 18 Oct 2016
Context Encoders: Feature Learning by Inpainting Deepak Pathak Philipp Krahenbuhl Jeff Donahue Trevor Darrell Alexei A. Efros SSL 67 5,287 0 25 Apr 2016
Learning Representations for Automatic Colorization Gustav Larsson Michael Maire Gregory Shakhnarovich VLM SSL 81 1,012 0 22 Mar 2016
Unsupervised Visual Representation Learning by Context Prediction Carl Doersch Abhinav Gupta Alexei A. Efros DRL SSL 164 2,782 0 19 May 2015