v1v2 (latest)

RenyiCL: Contrastive Representation Learning with Skew Renyi Divergence

12 August 2022

Papers citing "RenyiCL: Contrastive Representation Learning with Skew Renyi Divergence"

50 / 62 papers shown

Title
Robust Contrastive Learning against Noisy Views Ching-Yao Chuang R. Devon Hjelm Xin Eric Wang Vibhav Vineet Neel Joshi Antonio Torralba Stefanie Jegelka Ya-heng Song NoLa 55 72 0 12 Jan 2022
Pseudo-Spherical Contrastive Divergence Lantao Yu Jiaming Song Yang Song Stefano Ermon 43 7 0 01 Nov 2021
Compressive Visual Representations Kuang-Huei Lee Anurag Arnab S. Guadarrama John F. Canny Ian S. Fischer SSL 112 48 0 27 Sep 2021
Simpler, Faster, Stronger: Breaking The log-K Curse On Contrastive Learners With FlatNCE Junya Chen Zhe Gan Xuan Li Qing Guo Liqun Chen ... Belinda Zeng Wenlian Lu Fan Li Lawrence Carin Chenyang Tao 73 28 0 02 Jul 2021
Tight Mutual Information Estimation With Contrastive Fenchel-Legendre Optimization Qing Guo Junya Chen Dong Wang Yuewei Yang Xinwei Deng Lawrence Carin Fan Li Jing-Zheng Huang Chenyang Tao 57 21 0 02 Jul 2021
SCARF: Self-Supervised Contrastive Learning using Random Feature Corruption Dara Bahri Heinrich Jiang Yi Tay Donald Metzler SSL 70 175 0 29 Jun 2021
Divergence Frontiers for Generative Models: Sample Complexity, Quantization Effects, and Frontier Integrals Lang Liu Krishna Pillutla Sean Welleck Sewoong Oh Yejin Choi Zaïd Harchaoui MQ 71 14 0 15 Jun 2021
Graph Contrastive Learning Automated Yuning You Tianlong Chen Yang Shen Zhangyang Wang 81 479 0 10 Jun 2021
Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Loss Jeff Z. HaoChen Colin Wei Adrien Gaidon Tengyu Ma SSL 77 321 0 08 Jun 2021
With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations Debidatta Dwibedi Y. Aytar Jonathan Tompson P. Sermanet Andrew Zisserman SSL 241 467 0 29 Apr 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 708 6,127 0 29 Apr 2021
A Note on Connecting Barlow Twins with Negative-Sample-Free Contrastive Learning Yao-Hung Hubert Tsai Shaojie Bai Louis-Philippe Morency Ruslan Salakhutdinov SSL 57 39 0 28 Apr 2021
Contrastive Learning with Stronger Augmentations Tianlin Li Guo-Jun Qi CLL 97 225 0 15 Apr 2021
An Empirical Study of Training Self-Supervised Vision Transformers Xinlei Chen Saining Xie Kaiming He ViT 159 1,869 0 05 Apr 2021
Self-supervised Representation Learning with Relative Predictive Coding Yao-Hung Hubert Tsai Martin Q. Ma Muqiao Yang Han Zhao Louis-Philippe Morency Ruslan Salakhutdinov SSL AI4TS 62 38 0 21 Mar 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 347 2,362 0 04 Mar 2021
How to Train Your Energy-Based Models Yang Song Diederik P. Kingma DiffM 78 265 0 09 Jan 2021
Boosting Contrastive Self-Supervised Learning with False Negative Cancellation T. Huynh Simon Kornblith Matthew R. Walter Michael Maire M. Khademi SSL 75 170 0 23 Nov 2020
Contrastive Learning of General-Purpose Audio Representations Aaqib Saeed David Grangier Neil Zeghidour VLM SSL 76 272 0 21 Oct 2020
Contrastive Learning with Hard Negative Samples Joshua Robinson Ching-Yao Chuang S. Sra Stefanie Jegelka SSL 150 787 0 09 Oct 2020
Hard Negative Mixing for Contrastive Learning Yannis Kalantidis Mert Bulent Sariyildiz Noé Pion Philippe Weinzaepfel Diane Larlus SSL 134 645 0 02 Oct 2020
SelfAugment: Automatic Augmentation Policies for Self-Supervised Learning Colorado Reed Sean L. Metzger A. Srinivas Trevor Darrell Kurt Keutzer SSL 79 49 0 16 Sep 2020
Spatiotemporal Contrastive Video Representation Learning Rui Qian Tianjian Meng Boqing Gong Ming-Hsuan Yang Haoran Wang Serge J. Belongie Huayu Chen SSL AI4TS 114 501 0 09 Aug 2020
Multi-label Contrastive Predictive Coding Jiaming Song Stefano Ermon SSL VLM 56 50 0 20 Jul 2020
TUDataset: A collection of benchmark datasets for learning with graphs Christopher Morris Nils M. Kriege Franka Bause Kristian Kersting Petra Mutzel Marion Neumann 239 827 0 16 Jul 2020
Variational Representations and Neural Network Estimation of Rényi Divergences Jeremiah Birrell P. Dupuis Markos A. Katsoulakis Luc Rey-Bellet Jie Wang 49 32 0 07 Jul 2020
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations Alexei Baevski Henry Zhou Abdel-rahman Mohamed Michael Auli SSL 297 5,837 0 20 Jun 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 261 4,098 0 17 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 395 6,837 0 13 Jun 2020
DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations John Giorgi Osvald Nitski Bo Wang Gary D. Bader SSL 93 498 0 05 Jun 2020
Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere Tongzhou Wang Phillip Isola SSL 162 1,855 0 20 May 2020
What Makes for Good Views for Contrastive Learning? Yonglong Tian Chen Sun Ben Poole Dilip Krishnan Cordelia Schmid Phillip Isola SSL 114 1,335 0 20 May 2020
Audio-Visual Instance Discrimination with Cross-Modal Agreement Pedro Morgado Nuno Vasconcelos Ishan Misra SSL 82 276 0 27 Apr 2020
Supervised Contrastive Learning Prannay Khosla Piotr Teterwak Chen Wang Aaron Sarna Yonglong Tian Phillip Isola Aaron Maschinot Ce Liu Dilip Krishnan SSL 165 4,572 0 23 Apr 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 492 3,443 0 09 Mar 2020
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 213 12,124 0 13 Nov 2019
Understanding the Limitations of Variational Mutual Information Estimators Jiaming Song Stefano Ermon SSL DRL 74 204 0 14 Oct 2019
RandAugment: Practical automated data augmentation with a reduced search space E. D. Cubuk Barret Zoph Jonathon Shlens Quoc V. Le MQ 253 3,502 0 30 Sep 2019
InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximization Fan-Yun Sun Jordan Hoffmann Vikas Verma Jian Tang SSL 158 864 0 31 Jul 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 174 2,409 0 13 Jun 2019
Practical and Consistent Estimation of f-Divergences Paul Kishan Rubenstein Olivier Bousquet Josip Djolonga C. Riquelme Ilya O. Tolstikhin 44 45 0 27 May 2019
On Variational Bounds of Mutual Information Ben Poole Sherjil Ozair Aaron van den Oord Alexander A. Alemi George Tucker SSL 111 814 0 16 May 2019
Wasserstein Dependency Measure for Representation Learning Sherjil Ozair Corey Lynch Yoshua Bengio Aaron van den Oord Sergey Levine P. Sermanet SSL DRL 144 118 0 28 Mar 2019
Formal Limitations on the Measurement of Mutual Information David A. McAllester K. Stratos SSL 68 277 0 10 Nov 2018
How Powerful are Graph Neural Networks? Keyulu Xu Weihua Hu J. Leskovec Stefanie Jegelka GNN 257 7,695 0 01 Oct 2018
Learning deep representations by mutual information estimation and maximization R. Devon Hjelm A. Fedorov Samuel Lavoie-Marchildon Karan Grewal Phil Bachman Adam Trischler Yoshua Bengio SSL DRL 337 2,672 0 20 Aug 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 351 10,356 0 10 Jul 2018
AutoAugment: Learning Augmentation Policies from Data E. D. Cubuk Barret Zoph Dandelion Mané Vijay Vasudevan Quoc V. Le 135 1,775 0 24 May 2018
TADAM: Task dependent adaptive metric for improved few-shot learning Boris N. Oreshkin Pau Rodríguez López Alexandre Lacoste 96 1,313 0 23 May 2018
Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination Zhirong Wu Yuanjun Xiong Stella X. Yu Dahua Lin SSL 182 3,466 0 05 May 2018