Homomorphic Self-Supervised Learning

15 November 2022

Thomas Anderson Keller

Xavier Suau

Luca Zappella

SSL

ArXiv (abs)PDF HTML

Papers citing "Homomorphic Self-Supervised Learning"

45 / 45 papers shown

Title
Homomorphism Autoencoder -- Learning Group Structured Representations from Observed Transitions Hamza Keurti Hsiao-Ru Pan M. Besserve Benjamin Grewe Bernhard Schölkopf AI4CE 42 15 0 25 Jul 2022
Chaos is a Ladder: A New Theoretical Understanding of Contrastive Learning via Augmentation Overlap Yifei Wang Qi Zhang Yisen Wang Jiansheng Yang Zhouchen Lin 68 101 0 25 Mar 2022
Conditional Contrastive Learning with Kernel Yao-Hung Hubert Tsai Tianqi Li Martin Q. Ma Han Zhao Kun Zhang Louis-Philippe Morency Ruslan Salakhutdinov 48 26 0 11 Feb 2022
Adversarial Masking for Self-Supervised Learning Yuge Shi N. Siddharth Philip Torr Adam R. Kosiorek SSL 127 83 0 31 Jan 2022
Challenges of Adversarial Image Augmentations Arno Blaas Xavier Suau Jason Ramapuram N. Apostoloff Luca Zappella AAML 27 4 0 24 Nov 2021
Residual Relaxation for Multi-view Representation Learning Yifei Wang Zhengyang Geng Feng Jiang Chuming Li Yisen Wang Jiansheng Yang Zhouchen Lin 54 39 0 28 Oct 2021
The Power of Contrast for Feature Learning: A Theoretical Analysis Wenlong Ji Zhun Deng Ryumei Nakada James Zou Linjun Zhang SSL 90 52 0 06 Oct 2021
Automatic Symmetry Discovery with Lie Algebra Convolutional Network Nima Dehmamy Robin Walters Yanchen Liu Dashun Wang Rose Yu AI4CE 160 88 0 15 Sep 2021
Topographic VAEs learn Equivariant Capsules Thomas Anderson Keller Max Welling BDL 71 39 0 03 Sep 2021
Self-Supervised Learning with Data Augmentations Provably Isolates Content from Style Julius von Kügelgen Yash Sharma Luigi Gresele Wieland Brendel Bernhard Schölkopf M. Besserve Francesco Locatello 97 314 0 08 Jun 2021
FILTRA: Rethinking Steerable CNN by Filter Transform Yue Liu Qili Wang G. Lee 39 4 0 25 May 2021
A Practical Method for Constructing Equivariant Multilayer Perceptrons for Arbitrary Matrix Groups Marc Finzi Max Welling A. Wilson 162 195 0 19 Apr 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 929 29,436 0 26 Feb 2021
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 415 4,953 0 24 Feb 2021
Understanding self-supervised Learning Dynamics without Contrastive Pairs Yuandong Tian Xinlei Chen Surya Ganguli SSL 210 286 0 12 Feb 2021
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 253 4,067 0 20 Nov 2020
Understanding Self-supervised Learning with Dual Deep Networks Yuandong Tian Lantao Yu Xinlei Chen Surya Ganguli SSL 64 80 0 01 Oct 2020
Contrastive learning, multi-view redundancy, and linear models Christopher Tosh A. Krishnamurthy Daniel J. Hsu SSL 77 166 0 24 Aug 2020
What Should Not Be Contrastive in Contrastive Learning Tete Xiao Xiaolong Wang Alexei A. Efros Trevor Darrell SSL DRL 79 303 0 13 Aug 2020
Predicting What You Already Know Helps: Provable Self-Supervised Learning Jason D. Lee Qi Lei Nikunj Saunshi Jiacheng Zhuo SSL 75 188 0 03 Aug 2020
MDP Homomorphic Networks: Group Symmetries in Reinforcement Learning Elise van der Pol Daniel E. Worrall H. V. Hoof F. Oliehoek Max Welling BDL AI4CE 70 162 0 30 Jun 2020
The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization Dan Hendrycks Steven Basart Norman Mu Saurav Kadavath Frank Wang ... Samyak Parajuli Mike Guo Basel Alomair Jacob Steinhardt Justin Gilmer OOD 340 1,740 0 29 Jun 2020
Variational Autoencoder with Learned Latent Structure Marissa Connor Gregory H. Canal Christopher Rozell CML DRL 63 45 0 18 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 371 6,806 0 13 Jun 2020
What Makes for Good Views for Contrastive Learning? Yonglong Tian Chen Sun Ben Poole Dilip Krishnan Cordelia Schmid Phillip Isola SSL 105 1,329 0 20 May 2020
Generalizing Convolutional Neural Networks for Equivariance to Lie Groups on Arbitrary Continuous Data Marc Finzi Samuel Stanton Pavel Izmailov A. Wilson 118 323 0 25 Feb 2020
Learning Robust Representations via Multi-View Information Bottleneck Marco Federici Anjan Dutta Patrick Forré Nate Kushman Zeynep Akata SLR 55 256 0 17 Feb 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 369 18,778 0 13 Feb 2020
General $E(2)$ -Equivariant Steerable CNNs Maurice Weiler Gabriele Cesa 113 524 0 19 Nov 2019
Scale-Equivariant Steerable Networks Li Xiao Michal Szmaja A. Smeulders 120 149 0 14 Oct 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 169 2,403 0 13 Jun 2019
Learning Representations by Maximizing Mutual Information Across Views Philip Bachman R. Devon Hjelm William Buchwalter SSL 189 1,475 0 03 Jun 2019
Putting An End to End-to-End: Gradient-Isolated Learning of Representations Sindy Löwe Peter O'Connor Bastiaan S. Veeling SSL 114 144 0 28 May 2019
Deep Scale-spaces: Equivariance Over Scale Daniel E. Worrall Max Welling BDL 67 167 0 28 May 2019
Making Convolutional Networks Shift-Invariant Again Richard Y. Zhang OOD 91 797 0 25 Apr 2019
A Theoretical Analysis of Contrastive Unsupervised Representation Learning Sanjeev Arora H. Khandeparkar M. Khodak Orestis Plevrakis Nikunj Saunshi SSL 100 779 0 25 Feb 2019
Learning deep representations by mutual information estimation and maximization R. Devon Hjelm A. Fedorov Samuel Lavoie-Marchildon Karan Grewal Phil Bachman Adam Trischler Yoshua Bengio SSL DRL 320 2,662 0 20 Aug 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 320 10,302 0 10 Jul 2018
3D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Data Maurice Weiler Mario Geiger Max Welling Wouter Boomsma Taco S. Cohen 3DPC 110 505 0 06 Jul 2018
Non-Parametric Transformation Networks Dipan K. Pal Marios Savvides 41 7 0 14 Jan 2018
Large Batch Training of Convolutional Networks Yang You Igor Gitman Boris Ginsburg ODL 137 848 0 13 Aug 2017
Dataset Augmentation in Feature Space Terrance Devries Graham W. Taylor 64 428 0 17 Feb 2017
Steerable CNNs Taco S. Cohen Max Welling BDL 140 499 0 27 Dec 2016
Harmonic Networks: Deep Translation and Rotation Equivariance Daniel E. Worrall Stephan J. Garbin Daniyar Turmukhambetov Gabriel J. Brostow 126 710 0 14 Dec 2016
Group Equivariant Convolutional Networks Taco S. Cohen Max Welling BDL 169 1,941 0 24 Feb 2016