Self-supervised contrastive learning performs non-linear system identification

18 October 2024

Rodrigo González Laiz

Papers citing "Self-supervised contrastive learning performs non-linear system identification"

42 / 42 papers shown

Title
InfoNCE: Identifying the Gap Between Theory and Practice E. Rusak Patrik Reizinger Attila Juhos Oliver Bringmann Roland S. Zimmermann Wieland Brendel 92 10 0 28 Jun 2024
Learning and Leveraging World Models in Visual Representation Learning Q. Garrido Mahmoud Assran Nicolas Ballas Adrien Bardes Laurent Najman Yann LeCun SSL 75 28 0 01 Mar 2024
Mamba: Linear-Time Sequence Modeling with Selective State Spaces Albert Gu Tri Dao Mamba 146 2,699 0 01 Dec 2023
Towards a Unified Framework of Contrastive Learning for Disentangled Representations Stefan Matthes Zhiwei Han Hao Shen 67 4 0 08 Nov 2023
ODEFormer: Symbolic Regression of Dynamical Systems with Transformers Stéphane d’Ascoli Soren Becker Alexander Mathis Philippe Schwaller Niki Kilbertus 65 25 0 09 Oct 2023
Beyond Geometry: Comparing the Temporal Structure of Computation in Neural Circuits with Dynamical Similarity Analysis Mitchell Ostrow Adam J. Eisen L. Kozachkov Ila Fiete 61 28 0 16 Jun 2023
On the Identifiability of Switching Dynamical Systems Carles Balsells-Rodas Yixin Wang Yingzhen Li 70 4 0 25 May 2023
Nonlinear Independent Component Analysis for Principled Disentanglement in Unsupervised Deep Learning Aapo Hyvarinen Ilyes Khemakhem H. Morioka CML OOD 89 36 0 29 Mar 2023
Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture Mahmoud Assran Quentin Duval Ishan Misra Piotr Bojanowski Pascal Vincent Michael G. Rabbat Yann LeCun Nicolas Ballas SSL AI4TS MDE 72 352 0 19 Jan 2023
Temporally Disentangled Representation Learning Weiran Yao Guangyi Chen Kun Zhang CML BDL OOD 59 51 0 24 Oct 2022
End-to-end symbolic regression with transformers Pierre-Alexandre Kamienny Stéphane dÁscoli Guillaume Lample Franccois Charton 92 173 0 22 Apr 2022
Learnable latent embeddings for joint behavioral and neural analysis Steffen Schneider Jin Hwa Lee Mackenzie W. Mathis 81 228 0 01 Apr 2022
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language Alexei Baevski Wei-Ning Hsu Qiantong Xu Arun Babu Jiatao Gu Michael Auli SSL VLM ViT 97 858 0 07 Feb 2022
CITRIS: Causal Identifiability from Temporal Intervened Sequences Phillip Lippe Sara Magliacane Sindy Löwe Yuki M. Asano Taco S. Cohen E. Gavves CML 67 109 0 07 Feb 2022
Discovering State Variables Hidden in Experimental Data Boyuan Chen Kuang Huang Sunand Raghupathi I. Chandratreya Qi Du Hod Lipson CML 48 16 0 20 Dec 2021
Reverse engineering recurrent neural networks with Jacobian switching linear dynamical systems Jimmy T.H. Smith Scott W. Linderman David Sussillo 90 30 0 01 Nov 2021
Efficiently Modeling Long Sequences with Structured State Spaces Albert Gu Karan Goel Christopher Ré 215 1,783 0 31 Oct 2021
Learning Temporally Causal Latent Processes from General Temporal Data Weiran Yao Yuewen Sun Alex Ho Changyin Sun Kun Zhang BDL CML 72 87 0 11 Oct 2021
Disentangling Identifiable Features from Noisy Data with Structured Nonlinear ICA Hermanni Hälvä Sylvain Le Corff Luc Lehéricy Jonathan So Yongjie Zhu Elisabeth Gassiat Aapo Hyvarinen CML 60 65 0 17 Jun 2021
Segmenting Hybrid Trajectories using Latent ODEs Ruian Shi Q. Morris BDL 41 6 0 09 May 2021
Contrastive Learning Inverts the Data Generating Process Roland S. Zimmermann Yash Sharma Steffen Schneider Matthias Bethge Wieland Brendel SSL 278 220 0 17 Feb 2021
Building population models for large-scale neural recordings: opportunities and pitfalls C. Hurwitz N. Kudryashova A. Onken Matthias H Hennig 52 39 0 03 Feb 2021
On Linear Identifiability of Learned Representations Geoffrey Roeder Luke Metz Diederik P. Kingma CML 60 81 0 01 Jul 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 774 42,055 0 28 May 2020
Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere Tongzhou Wang Phillip Isola SSL 154 1,840 0 20 May 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 366 18,778 0 13 Feb 2020
Disentanglement by Nonlinear ICA with General Incompressible-flow Networks (GIN) Peter Sorrenson Carsten Rother Ullrich Kothe DRL CML 62 121 0 14 Jan 2020
Collapsed Amortized Variational Inference for Switching Nonlinear Dynamical Systems Zhe Dong Bryan Seybold Kevin Patrick Murphy Hung Bui BDL 72 31 0 21 Oct 2019
Explicit-Duration Markov Switching Models Silvia Chiappa 37 21 0 12 Sep 2019
Variational Autoencoders and Nonlinear ICA: A Unifying Framework Ilyes Khemakhem Diederik P. Kingma Ricardo Pio Monti Aapo Hyvarinen OOD 71 595 0 10 Jul 2019
Data-Efficient Image Recognition with Contrastive Predictive Coding Olivier J. Hénaff A. Srinivas J. Fauw Ali Razavi Carl Doersch S. M. Ali Eslami Aaron van den Oord SSL 128 1,429 0 22 May 2019
Learning interpretable continuous-time models of latent stochastic dynamical systems Lea Duncker G. Bohner Julien Boussard M. Sahani 44 77 0 12 Feb 2019
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 320 10,302 0 10 Jul 2018
Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learning Aapo Hyvarinen Hiroaki Sasaki Richard Turner OOD CML 95 330 0 22 May 2018
World Models David R Ha Jürgen Schmidhuber SyDa 122 1,083 0 27 Mar 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 701 131,652 0 12 Jun 2017
Time-Contrastive Networks: Self-Supervised Learning from Video P. Sermanet Corey Lynch Yevgen Chebotar Jasmine Hsu Eric Jang S. Schaal Sergey Levine SSL 101 826 0 23 Apr 2017
Categorical Reparameterization with Gumbel-Softmax Eric Jang S. Gu Ben Poole BDL 334 5,364 0 03 Nov 2016
Gaussian Error Linear Units (GELUs) Dan Hendrycks Kevin Gimpel 169 5,011 0 27 Jun 2016
Linear dynamical neural population models through nonlinear embeddings Yuanjun Gao Evan Archer Liam Paninski John P. Cunningham 59 155 0 26 May 2016
Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICA Aapo Hyvarinen H. Morioka CML OOD AI4TS 64 409 0 20 May 2016
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.8K 150,115 0 22 Dec 2014