Perfectly Balanced: Improving Transfer and Robustness of Supervised Contrastive Learning

15 April 2022

Papers citing "Perfectly Balanced: Improving Transfer and Robustness of Supervised Contrastive Learning"

35 / 35 papers shown

Title
A Theoretical Framework for Preventing Class Collapse in Supervised Contrastive Learning Chungpa Lee Jeongheon Oh Kibok Lee Jy-yong Sohn SSL 86 1 0 11 Mar 2025
A Generalized Theory of Mixup for Structure-Preserving Synthetic Data Chungpa Lee Jongho Im Joseph H.T. Kim 41 0 0 03 Mar 2025
Multi-level Supervised Contrastive Learning Naghmeh Ghanooni Barbod Pajoum Harshit Rawal Sophie Fellenz Vo Nguyen Le Duy Marius Kloft 86 0 0 04 Feb 2025
BioNCERE: Non-Contrastive Enhancement For Relation Extraction In Biomedical Texts Farshad Noravesh 39 0 0 31 Oct 2024
CLOSER: Towards Better Representation Learning for Few-Shot Class-Incremental Learning Junghun Oh Sungyong Baik Kyoung Mu Lee CLL 34 3 0 08 Oct 2024
Exploiting Supervised Poison Vulnerability to Strengthen Self-Supervised Defense Jeremy A. Styborski Mingzhi Lyu Y. Huang Adams Kong 39 0 0 13 Sep 2024
Cell-ontology guided transcriptome foundation model Xinyu Yuan Zhihao Zhan Zuobai Zhang Manqi Zhou Jianan Zhao Boyu Han Yue Li Jian Tang 47 1 0 22 Aug 2024
CLOVER: Context-aware Long-term Object Viewpoint- and Environment- Invariant Representation Learning Dongmyeong Lee Amanda Adkins Joydeep Biswas 49 0 0 12 Jul 2024
On the Effectiveness of Supervision in Asymmetric Non-Contrastive Learning Jeongheon Oh Kibok Lee SSL 37 1 0 16 Jun 2024
OrCo: Towards Better Generalization via Orthogonality and Contrast for Few-Shot Class-Incremental Learning Noor Ahmed Anna Kukleva Bernt Schiele CLL 32 12 0 27 Mar 2024
Investigating the Benefits of Projection Head for Representation Learning Yihao Xue Eric Gan Jiayi Ni Siddharth Joshi Baharan Mirzasoleiman 44 10 0 18 Mar 2024
Benchmarking and Building Long-Context Retrieval Models with LoCo and M2-BERT Jon Saad-Falcon Daniel Y. Fu Simran Arora Neel Guha Christopher Ré RALM 34 16 0 12 Feb 2024
Asymptotic Midpoint Mixup for Margin Balancing and Moderate Broadening Hoyong Kim Semi Lee Kangil Kim CLL 29 2 0 26 Jan 2024
FALCON: Fairness Learning via Contrastive Attention Approach to Continual Semantic Scene Understanding Thanh-Dat Truong Utsav Prabhu Bhiksha Raj Jackson Cothren Khoa Luu CLL 37 3 0 27 Nov 2023
DualTalker: A Cross-Modal Dual Learning Approach for Speech-Driven 3D Facial Animation Guinan Su Yanwu Yang Zhifeng Li VGen 38 1 0 08 Nov 2023
Neural Collapse in Multi-label Learning with Pick-all-label Loss Pengyu Li Xiao Li Yutong Wang Qing Qu 27 8 0 24 Oct 2023
SINCERE: Supervised Information Noise-Contrastive Estimation REvisited Patrick Feeney M. C. Hughes 33 3 0 25 Sep 2023
Road Disease Detection based on Latent Domain Background Feature Separation and Suppression Juwu Zheng Jiangtao Ren 29 2 0 14 Sep 2023
Self-Supervised Representation Learning with Cross-Context Learning between Global and Hypercolumn Features Zheng Gao Chen Feng Ioannis Patras SSL 36 3 0 25 Aug 2023
M-FLAG: Medical Vision-Language Pre-training with Frozen Language Models and Latent Space Geometry Optimization Che Liu Sibo Cheng Cheng Chen Mengyun Qiao Weitong Zhang Anand Shah Wenjia Bai Rossella Arcucci VLM 30 56 0 17 Jul 2023
Rethinking Weak Supervision in Helping Contrastive Learning Jingyi Cui Weiran Huang Yifei Wang Yisen Wang NoLa SSL 32 13 0 07 Jun 2023
Quantifying the Variability Collapse of Neural Networks Jing-Xue Xu Haoxiong Liu 36 4 0 06 Jun 2023
Demystifying Structural Disparity in Graph Neural Networks: Can One Size Fit All? Haitao Mao Zhikai Chen Wei Jin Haoyu Han Yao Ma Tong Zhao Neil Shah Jiliang Tang 30 32 0 02 Jun 2023
Balanced Supervised Contrastive Learning for Few-Shot Class-Incremental Learning In-Ug Yoon Taehyean Choi Young-Min Kim Jong-Hwan Kim CLL 24 2 0 26 May 2023
Which Features are Learnt by Contrastive Learning? On the Role of Simplicity Bias in Class Collapse and Feature Suppression Yihao Xue S. Joshi Eric Gan Pin-Yu Chen Baharan Mirzasoleiman SSL 30 23 0 25 May 2023
A Survey on the Robustness of Computer Vision Models against Common Corruptions Shunxin Wang Raymond N. J. Veldhuis Christoph Brune N. Strisciuglio OOD VLM 27 11 0 10 May 2023
Contrastive Tuning: A Little Help to Make Masked Autoencoders Forget Johannes Lehner Benedikt Alkin Andreas Fürst Elisabeth Rumetshofer Lukas Miklautz Sepp Hochreiter 23 18 0 20 Apr 2023
SC-Block: Supervised Contrastive Blocking within Entity Resolution Pipelines Alexander Brinkmann Roee Shraga Christian Bizer 47 9 0 06 Mar 2023
InfoNCE Loss Provably Learns Cluster-Preserving Representations Advait Parulekar Liam Collins Karthikeyan Shanmugam Aryan Mokhtari Sanjay Shakkottai SSL 34 20 0 15 Feb 2023
Learning Generalized Zero-Shot Learners for Open-Domain Image Geolocalization Lukas Haas Silas Alberti Michal Skreta VLM 32 21 0 01 Feb 2023
Principled and Efficient Transfer Learning of Deep Models via Neural Collapse Xiao Li Sheng Liu Jin-li Zhou Xin Lu C. Fernandez‐Granda Zhihui Zhu Q. Qu AAML 28 18 0 23 Dec 2022
Continual Contrastive Finetuning Improves Low-Resource Relation Extraction Wenxuan Zhou Sheng Zhang Tristan Naumann Muhao Chen Hoifung Poon 54 6 0 21 Dec 2022
Self-Contrastive Learning: Single-viewed Supervised Contrastive Framework using Sub-network Sangmin Bae Sungnyun Kim Jongwoo Ko Gihun Lee SeungJong Noh Se-Young Yun SSL 26 6 0 29 Jun 2021
Contrastive Learning Inverts the Data Generating Process Roland S. Zimmermann Yash Sharma Steffen Schneider Matthias Bethge Wieland Brendel SSL 238 207 0 17 Feb 2021
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 267 3,371 0 09 Mar 2020