A picture of the space of typical learnable tasks

31 October 2022

Papers citing "A picture of the space of typical learnable tasks"

48 / 48 papers shown

Title
MorphMark: Flexible Adaptive Watermarking for Large Language Models Zongqi Wang Tianle Gu Baoyuan Wu Yujiu Yang WaLM 111 0 0 14 May 2025
An Analytical Characterization of Sloppiness in Neural Networks: Insights from Linear Models Jialin Mao Itay Griniasty Yan Sun Mark K. Transtrum James P. Sethna Pratik Chaudhari 96 0 0 13 May 2025
Many Perception Tasks are Highly Redundant Functions of their Input Data Rahul Ramesh Anthony Bisulco Ronald W. DiTullio Linran Wei Vijay Balasubramanian Kostas Daniilidis Pratik Chaudhari 91 2 0 18 Jul 2024
The Training Process of Many Deep Networks Explores the Same Low-Dimensional Manifold Jialin Mao Itay Griniasty H. Teoh Rahul Ramesh Rubing Yang Mark K. Transtrum James P. Sethna Pratik Chaudhari 3DPC 66 16 0 02 May 2023
A Kernel-Based View of Language Model Fine-Tuning Sadhika Malladi Alexander Wettig Dingli Yu Danqi Chen Sanjeev Arora VLM 112 67 0 11 Oct 2022
Is Self-Supervised Learning More Robust Than Supervised Learning? Yuanyi Zhong Haoran Tang Jun-Kun Chen Jian-wei Peng Yu-Xiong Wang SSL OOD 51 25 0 10 Jun 2022
More Than a Toy: Random Matrix Models Predict How Real-World Neural Representations Generalize Alexander Wei Wei Hu Jacob Steinhardt 94 72 0 11 Mar 2022
Deconstructing Distributions: A Pointwise Framework of Learning Gal Kaplun Nikhil Ghosh Saurabh Garg Boaz Barak Preetum Nakkiran OOD 53 21 0 20 Feb 2022
Datamodels: Predicting Predictions from Training Data Andrew Ilyas Sung Min Park Logan Engstrom Guillaume Leclerc Aleksander Madry TDI 115 140 0 01 Feb 2022
Optimal Representations for Covariate Shift Yangjun Ruan Yann Dubois Chris J. Maddison OOD 94 69 0 31 Dec 2021
Towards the Generalization of Contrastive Self-Supervised Learning Weiran Huang Mingyang Yi Xuyang Zhao Zihao Jiang SSL 73 110 0 01 Nov 2021
Does the Data Induce Capacity Control in Deep Learning? Rubing Yang Jialin Mao Pratik Chaudhari 76 16 0 27 Oct 2021
Model Zoo: A Growing "Brain" That Learns Continually Rahul Ramesh Pratik Chaudhari CLL FedML 60 65 0 06 Jun 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 307 2,347 0 04 Mar 2021
An Information-Geometric Distance on the Space of Tasks Yansong Gao Pratik Chaudhari 47 22 0 01 Nov 2020
A No-Free-Lunch Theorem for MultiTask Learning Steve Hanneke Samory Kpotufe 111 39 0 29 Jun 2020
Un-Mix: Rethinking Image Mixtures for Unsupervised Visual Representation Learning Zhiqiang Shen Zechun Liu Zhuang Liu Marios Savvides Trevor Darrell Eric P. Xing OCL SSL 67 103 0 11 Mar 2020
A Free-Energy Principle for Representation Learning Yansong Gao Pratik Chaudhari DRL 45 9 0 27 Feb 2020
Provable Meta-Learning of Linear Representations Nilesh Tripuraneni Chi Jin Michael I. Jordan OOD 103 191 0 26 Feb 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 369 18,778 0 13 Feb 2020
FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence Kihyuk Sohn David Berthelot Chun-Liang Li Zizhao Zhang Nicholas Carlini E. D. Cubuk Alexey Kurakin Han Zhang Colin Raffel AAML 155 3,554 0 21 Jan 2020
Big Transfer (BiT): General Visual Representation Learning Alexander Kolesnikov Lucas Beyer Xiaohua Zhai J. Puigcerver Jessica Yung Sylvain Gelly N. Houlsby MQ 286 1,205 0 24 Dec 2019
Meta-Q-Learning Rasool Fakoor Pratik Chaudhari Stefano Soatto Alex Smola OffRL 85 144 0 30 Sep 2019
A Baseline for Few-Shot Image Classification Guneet Singh Dhillon Pratik Chaudhari Avinash Ravichandran Stefano Soatto 77 580 0 06 Sep 2019
Benign Overfitting in Linear Regression Peter L. Bartlett Philip M. Long Gábor Lugosi Alexander Tsigler MLT 83 776 0 26 Jun 2019
Understanding Generalization through Visualizations Wenjie Huang Z. Emam Micah Goldblum Liam H. Fowl J. K. Terry Furong Huang Tom Goldstein AI4CE 49 80 0 07 Jun 2019
Learning Representations by Maximizing Mutual Information Across Views Philip Bachman R. Devon Hjelm William Buchwalter SSL 189 1,475 0 03 Jun 2019
MixMatch: A Holistic Approach to Semi-Supervised Learning David Berthelot Nicholas Carlini Ian Goodfellow Nicolas Papernot Avital Oliver Colin Raffel 142 3,029 0 06 May 2019
Making Convolutional Networks Shift-Invariant Again Richard Y. Zhang OOD 91 797 0 25 Apr 2019
Task2Vec: Task Embedding for Meta-Learning Alessandro Achille Michael Lam Rahul Tewari Avinash Ravichandran Subhransu Maji Charless C. Fowlkes Stefano Soatto Pietro Perona SSL 77 315 0 10 Feb 2019
Revisiting Self-Supervised Visual Representation Learning Alexander Kolesnikov Xiaohua Zhai Lucas Beyer SSL 145 716 0 25 Jan 2019
Gradient Descent Happens in a Tiny Subspace Guy Gur-Ari Daniel A. Roberts Ethan Dyer 98 233 0 12 Dec 2018
A mathematical theory of semantic development in deep neural networks Andrew M. Saxe James L. McClelland Surya Ganguli 73 271 0 23 Oct 2018
PCA of high dimensional random walks with comparison to neural network training J. Antognini Jascha Narain Sohl-Dickstein OOD 45 29 0 22 Jun 2018
Large Scale Fine-Grained Categorization and Domain-Specific Transfer Learning Huayu Chen Yang Song Chen Sun Andrew G. Howard Serge J. Belongie 113 479 0 16 Jun 2018
Dynamic Few-Shot Visual Learning without Forgetting Spyros Gidaris N. Komodakis VLM 59 1,130 0 25 Apr 2018
Taskonomy: Disentangling Task Transfer Learning Amir Zamir Alexander Sax Bokui (William) Shen Leonidas Guibas Jitendra Malik Silvio Savarese 120 1,220 0 23 Apr 2018
Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNs T. Garipov Pavel Izmailov Dmitrii Podoprikhin Dmitry Vetrov A. Wilson UQCV 83 751 0 27 Feb 2018
Visualizing the Loss Landscape of Neural Nets Hao Li Zheng Xu Gavin Taylor Christoph Studer Tom Goldstein 243 1,893 0 28 Dec 2017
Stochastic gradient descent performs variational inference, converges to limit cycles for deep networks Pratik Chaudhari Stefano Soatto MLT 70 304 0 30 Oct 2017
Multi-task Self-Supervised Visual Learning Carl Doersch Andrew Zisserman SSL 78 632 0 25 Aug 2017
Prototypical Networks for Few-shot Learning Jake C. Snell Kevin Swersky R. Zemel 300 8,134 0 15 Mar 2017
Topology and Geometry of Half-Rectified Network Optimization C. Freeman Joan Bruna 199 235 0 04 Nov 2016
Matching Networks for One Shot Learning Oriol Vinyals Charles Blundell Timothy Lillicrap Koray Kavukcuoglu Daan Wierstra VLM 370 7,323 0 13 Jun 2016
Wide Residual Networks Sergey Zagoruyko N. Komodakis 340 7,985 0 23 May 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,020 0 10 Dec 2015
Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks Alexey Dosovitskiy Philipp Fischer Jost Tobias Springenberg Martin Riedmiller Thomas Brox OOD SSL 87 1,021 0 26 Jun 2014
A Model of Inductive Bias Learning Jonathan Baxter 109 1,214 0 01 Jun 2011