Understanding the Behaviour of Contrastive Loss

15 December 2020

Papers citing "Understanding the Behaviour of Contrastive Loss"

50 / 308 papers shown

Title
Establishing a stronger baseline for lightweight contrastive models Wenye Lin Yifeng Ding Zhixiong Cao Haitao Zheng 25 2 0 14 Dec 2022
Teaching Matters: Investigating the Role of Supervision in Vision Transformers Matthew Walmer Saksham Suri Kamal Gupta Abhinav Shrivastava 35 33 0 07 Dec 2022
Few-Shot Nested Named Entity Recognition Hong Ming Jiaoyun Yang Lili Jiang Yan Pan Ning An 27 10 0 02 Dec 2022
CL4CTR: A Contrastive Learning Framework for CTR Prediction Fang Wang Yingxu Wang Dongsheng Li Hansu Gu T. Lu Peng-Zhen Zhang Ning Gu SSL 18 42 0 01 Dec 2022
Delving into Out-of-Distribution Detection with Vision-Language Representations Yifei Ming Ziyan Cai Jiuxiang Gu Yiyou Sun W. Li Yixuan Li VLM OODD 40 157 0 24 Nov 2022
SeeABLE: Soft Discrepancies and Bounded Contrastive Learning for Exposing Deepfakes Nicolas Larue Ngoc-Son Vu Vitomir Štruc Peter Peer V. Christophides AAML 32 27 0 21 Nov 2022
Reconstructing high-order sequence features of dynamic functional connectivity networks based on diversified covert attention patterns for Alzheimer's disease classification Zhixiang Zhang Biao Jie Zhengdong Wang Jie Zhou Yang Yang 26 0 0 19 Nov 2022
Curiosity in Hindsight: Intrinsic Exploration in Stochastic Environments Daniel Jarrett Corentin Tallec Florent Altché Thomas Mesnard Rémi Munos Michal Valko 40 5 0 18 Nov 2022
Contrastive Losses Are Natural Criteria for Unsupervised Video Summarization Zongshang Pang Yuta Nakashima Mayu Otani Hajime Nagahara 23 6 0 18 Nov 2022
Self-supervised learning of audio representations using angular contrastive loss Shanshan Wang S. Tripathy A. Mesaros SSL 24 4 0 10 Nov 2022
Combining Contrastive Learning and Knowledge Graph Embeddings to develop medical word embeddings for the Italian language Denys Amore Bondarenko Roger Ferrod Luigi Di Caro 16 1 0 09 Nov 2022
CLOP: Video-and-Language Pre-Training with Knowledge Regularizations Guohao Li Hu Yang Feng He Zhifan Feng Yajuan Lyu Hua-Hong Wu Haifeng Wang VLM 19 1 0 07 Nov 2022
MuMIC -- Multimodal Embedding for Multi-label Image Classification with Tempered Sigmoid Feng Wang Sarai Mizrachi Moran Beladev Guy Nadav Gil Amsalem Karen Lastmann Assaraf Hadas Harush Boker VLM 22 13 0 02 Nov 2022
Beyond Instance Discrimination: Relation-aware Contrastive Self-supervised Learning Yifei Zhang Chang-rui Liu Yu Zhou Weiping Wang QiXiang Ye Xiangyang Ji SSL ISeg BDL 19 6 0 02 Nov 2022
Probability-Dependent Gradient Decay in Large Margin Softmax Siyuan Zhang Linbo Xie Ying Chen 10 0 0 31 Oct 2022
Facial Video-based Remote Physiological Measurement via Self-supervised Learning Zijie Yue Miaojing Shi Shuai Ding CVBM 50 39 0 27 Oct 2022
Self-Supervised Learning via Maximum Entropy Coding Xin Liu Zhongdao Wang Yali Li Shengjin Wang SSL 24 40 0 20 Oct 2022
Self-Supervised Learning Through Efference Copies Franz Scherr Qinghai Guo Timoleon Moraitis 19 10 0 17 Oct 2022
Fine-grained Category Discovery under Coarse-grained supervision with Hierarchical Weighted Self-contrastive Learning Wenbin An Feng Tian Ping Chen Siliang Tang Qinghua Zheng Qianying Wang 23 17 0 14 Oct 2022
Low-resource Neural Machine Translation with Cross-modal Alignment Zhe Yang Qingkai Fang Yang Feng VLM 34 9 0 13 Oct 2022
Self-supervised debiasing using low rank regularization Geon Yeong Park Chanyong Jung Sangmin Lee Jong Chul Ye Sang Wan Lee CML SSL 36 3 0 11 Oct 2022
Contrastive Trajectory Similarity Learning with Dual-Feature Attention Yanchuan Chang Jianzhong Qi Yuxuan Liang E. Tanin 22 33 0 11 Oct 2022
Unsupervised Few-shot Learning via Deep Laplacian Eigenmaps Kuilin Chen Chi-Guhn Lee SSL 38 3 0 07 Oct 2022
Zero-shot stance detection based on cross-domain feature enhancement by contrastive learning Xuechen Zhao Jiaying Zou Zhong Zhang Feng Xie Bin Zhou Lei Tian 29 3 0 07 Oct 2022
Domain Generalization via Contrastive Causal Learning Qiaowei Miao Junkun Yuan Kun Kuang BDL OOD 33 12 0 06 Oct 2022
ContraCLM: Contrastive Learning For Causal Language Model Nihal Jain Dejiao Zhang Wasi Uddin Ahmad Zijian Wang Feng Nan ... Ramesh Nallapati Baishakhi Ray Parminder Bhatia Xiaofei Ma Bing Xiang 23 16 0 03 Oct 2022
What shapes the loss landscape of self-supervised learning? Liu Ziyin Ekdeep Singh Lubana Masakuni Ueda Hidenori Tanaka 50 20 0 02 Oct 2022
Rethinking the Learning Paradigm for Facial Expression Recognition Weijie Wang N. Sebe Bruno Lepri 29 2 0 30 Sep 2022
Variance Covariance Regularization Enforces Pairwise Independence in Self-Supervised Representations Grégoire Mialon Randall Balestriero Yann LeCun 29 9 0 29 Sep 2022
The Geometry of Self-supervised Learning Models and its Impact on Transfer Learning Romain Cosentino Sarath Shekkizhar Mahdi Soltanolkotabi A. Avestimehr Antonio Ortega SSL 51 7 0 18 Sep 2022
Weakly Supervised Invariant Representation Learning Via Disentangling Known and Unknown Nuisance Factors Jiageng Zhu Hanchen Xie Wael AbdAlmageed 24 1 0 15 Sep 2022
A Review and Roadmap of Deep Learning Causal Discovery in Different Variable Paradigms Hang Chen Keqing Du Xinyu Yang Chenguang Li CML 39 11 0 14 Sep 2022
Improving Self-Supervised Learning by Characterizing Idealized Representations Yann Dubois Tatsunori Hashimoto Stefano Ermon Percy Liang SSL 83 40 0 13 Sep 2022
SimCLF: A Simple Contrastive Learning Framework for Function-level Binary Embeddings Ruijin Sun Guo Shize Jinhong Guo Li Wei Zhan Dazhi Sun Meng Zhisong Pan 19 0 0 06 Sep 2022
Design of the topology for contrastive visual-textual alignment Zhun Sun 25 1 0 05 Sep 2022
Relational Self-Supervised Learning on Graphs Namkyeong Lee Dongmin Hyun Junseok Lee Chanyoung Park SSL 11 22 0 21 Aug 2022
KRACL: Contrastive Learning with Graph Context Modeling for Sparse Knowledge Graph Completion Zhaoxuan Tan Zilong Chen Shangbin Feng Qingyue Zhang Qinghua Zheng Jundong Li Minnan Luo 26 36 0 16 Aug 2022
On the Pros and Cons of Momentum Encoder in Self-Supervised Visual Representation Learning T. Pham Chaoning Zhang Axi Niu Kang Zhang Chang-Dong Yoo 36 11 0 11 Aug 2022
Improving Fine-tuning of Self-supervised Models with Contrastive Initialization Haolin Pan Yong Guo Qinyi Deng Hao-Fan Yang Yiqun Chen Jian Chen SSL 18 19 0 30 Jul 2022
Contrastive Self-Supervised Learning Leads to Higher Adversarial Susceptibility Rohit Gupta Naveed Akhtar Ajmal Saeed Mian M. Shah AAML SSL 21 5 0 22 Jul 2022
Balanced Contrastive Learning for Long-Tailed Visual Recognition Jianggang Zhu Z. Wang Jingjing Chen Yi-Ping Phoebe Chen Yueping Jiang 24 167 0 19 Jul 2022
Model-Aware Contrastive Learning: Towards Escaping the Dilemmas Zizheng Huang Haoxing Chen Ziqi Wen Chao Zhang Huaxiong Li Bojuan Wang Chunlin Chen 24 8 0 16 Jul 2022
Contrastive Deep Supervision Linfeng Zhang Xin Chen Junbo Zhang Runpei Dong Kaisheng Ma 67 28 0 12 Jul 2022
CCPL: Contrastive Coherence Preserving Loss for Versatile Style Transfer Zijie Wu Zhen Zhu Junping Du Xiang Bai 64 82 0 11 Jul 2022
Utilizing Expert Features for Contrastive Learning of Time-Series Representations Manuel Nonnenmacher Lukas Oldenburg Ingo Steinwart David Reeb AI4TS 21 21 0 23 Jun 2022
C-SENN: Contrastive Self-Explaining Neural Network Yoshihide Sawada Keigo Nakamura SSL 13 8 0 20 Jun 2022
Beyond Supervised vs. Unsupervised: Representative Benchmarking and Analysis of Image Representation Learning M. Gwilliam Abhinav Shrivastava SSL 76 19 1 16 Jun 2022
Let Invariant Rationale Discovery Inspire Graph Contrastive Learning Sihang Li Xiang Wang An Zhang Y. Wu Xiangnan He Tat-Seng Chua 21 93 0 16 Jun 2022
Is Self-Supervised Learning More Robust Than Supervised Learning? Yuanyi Zhong Haoran Tang Jun-Kun Chen Jian-wei Peng Yu-xiong Wang SSL OOD 25 24 0 10 Jun 2022
I'm Me, We're Us, and I'm Us: Tri-directional Contrastive Learning on Hypergraphs Dongjin Lee Kijung Shin 30 36 0 09 Jun 2022