Diversified Ensemble of Independent Sub-Networks for Robust
Self-Supervised Representation Learning

Diversified Ensemble of Independent Sub-Networks for Robust Self-Supervised Representation Learning

28 August 2023

Amirhossein Vahidi

Eyke Hüllermeier

Papers citing "Diversified Ensemble of Independent Sub-Networks for Robust Self-Supervised Representation Learning"

16 / 16 papers shown

Title
The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning Zixin Wen Yuanzhi Li SSL 76 34 0 12 May 2022
SCD: Self-Contrastive Decorrelation for Sentence Embeddings T. Klein Moin Nabi SSL 45 25 0 15 Mar 2022
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language Alexei Baevski Wei-Ning Hsu Qiantong Xu Arun Babu Jiatao Gu Michael Auli SSL VLM ViT 87 845 0 07 Feb 2022
CLIP-Event: Connecting Text and Images with Event Structures Manling Li Ruochen Xu Shuohang Wang Luowei Zhou Xudong Lin Chenguang Zhu Michael Zeng Heng Ji Shih-Fu Chang VLM CLIP 59 126 0 13 Jan 2022
VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning Adrien Bardes Jean Ponce Yann LeCun SSL DML 125 925 0 11 May 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 247 2,321 0 04 Mar 2021
Understanding self-supervised Learning Dynamics without Contrastive Pairs Yuandong Tian Xinlei Chen Surya Ganguli SSL 183 282 0 12 Feb 2021
A Survey on Contrastive Self-supervised Learning Ashish Jaiswal Ashwin Ramesh Babu Mohammad Zaki Zadeh Debapriya Banerjee F. Makedon SSL 107 1,379 0 31 Oct 2020
Training independent subnetworks for robust prediction Marton Havasi Rodolphe Jenatton Stanislav Fort Jeremiah Zhe Liu Jasper Snoek Balaji Lakshminarayanan Andrew M. Dai Dustin Tran UQCV OOD 77 211 0 13 Oct 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 308 6,718 0 13 Jun 2020
BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong Learning Yeming Wen Dustin Tran Jimmy Ba OOD FedML UQCV 131 487 0 17 Feb 2020
Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learning Arsenii Ashukha Alexander Lyzhov Dmitry Molchanov Dmitry Vetrov UQCV FedML 69 315 0 15 Feb 2020
Deep Ensembles: A Loss Landscape Perspective Stanislav Fort Huiyi Hu Balaji Lakshminarayanan OOD UQCV 89 624 0 05 Dec 2019
Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift Yaniv Ovadia Emily Fertig Jie Jessie Ren Zachary Nado D. Sculley Sebastian Nowozin Joshua V. Dillon Balaji Lakshminarayanan Jasper Snoek UQCV 148 1,677 0 06 Jun 2019
Improving Adversarial Robustness via Promoting Ensemble Diversity Tianyu Pang Kun Xu Chao Du Ning Chen Jun Zhu AAML 60 436 0 25 Jan 2019
Parseval Networks: Improving Robustness to Adversarial Examples Moustapha Cissé Piotr Bojanowski Edouard Grave Yann N. Dauphin Nicolas Usunier AAML 133 802 0 28 Apr 2017