Does Learning Require Memorization? A Short Tale about a Long Tail

12 June 2019

Papers citing "Does Learning Require Memorization? A Short Tale about a Long Tail"

36 / 336 papers shown

Title
Interpretable Deep Learning: Interpretation, Interpretability, Trustworthiness, and Beyond Xuhong Li Haoyi Xiong Xingjian Li Xuanyu Wu Xiao Zhang Ji Liu Jiang Bian Dejing Dou AAML FaML XAI HAI 23 317 0 19 Mar 2021
Abstraction and Symbolic Execution of Deep Neural Networks with Bayesian Approximation of Hidden Features Nicolas Berthier Amany Alshareef James Sharp S. Schewe Xiaowei Huang 21 10 0 05 Mar 2021
Understanding Instance-Level Label Noise: Disparate Impacts and Treatments Yang Liu NoLa 8 35 0 10 Feb 2021
Clusterability as an Alternative to Anchor Points When Learning with Noisy Labels Zhaowei Zhu Yiwen Song Yang Liu NoLa 18 91 0 10 Feb 2021
Understanding the Interaction of Adversarial Training with Noisy Labels Jianing Zhu Jingfeng Zhang Bo Han Tongliang Liu Gang Niu Hongxia Yang Mohan Kankanhalli Masashi Sugiyama AAML 27 27 0 06 Feb 2021
Fast and Memory Efficient Differentially Private-SGD via JL Projections Zhiqi Bu Sivakanth Gopi Janardhan Kulkarni Y. Lee J. Shen U. Tantipongpipat FedML 34 41 0 05 Feb 2021
Training Data Leakage Analysis in Language Models Huseyin A. Inan Osman Ramadan Lukas Wutschitz Daniel Jones Victor Rühle James Withers Robert Sim MIACV PILM 32 9 0 14 Jan 2021
Extracting Training Data from Large Language Models Nicholas Carlini Florian Tramèr Eric Wallace Matthew Jagielski Ariel Herbert-Voss ... Tom B. Brown D. Song Ulfar Erlingsson Alina Oprea Colin Raffel MLAU SILM 290 1,824 0 14 Dec 2020
When is Memorization of Irrelevant Training Data Necessary for High-Accuracy Learning? Gavin Brown Mark Bun Vitaly Feldman Adam D. Smith Kunal Talwar 253 93 0 11 Dec 2020
Modifying Memories in Transformer Models Chen Zhu A. S. Rawat Manzil Zaheer Srinadh Bhojanapalli Daliang Li Felix X. Yu Sanjiv Kumar KELM 32 192 0 01 Dec 2020
On the Privacy Risks of Algorithmic Fairness Hong Chang Reza Shokri FaML 33 109 0 07 Nov 2020
Failures of model-dependent generalization bounds for least-norm interpolation Peter L. Bartlett Philip M. Long 93 29 0 16 Oct 2020
Chasing Your Long Tails: Differentially Private Prediction in Health Care Settings Vinith Suriyakumar Nicolas Papernot Anna Goldenberg Marzyeh Ghassemi OOD 24 64 0 13 Oct 2020
Characterising Bias in Compressed Models Sara Hooker Nyalleng Moorosi Gregory Clark Samy Bengio Emily L. Denton 11 181 0 06 Oct 2020
Testing Tail Weight of a Distribution Via Hazard Rate Maryam Aliakbarpour Amartya Shankha Biswas Kavya Ravichandran R. Rubinfeld 14 0 0 06 Oct 2020
MACE: A Flexible Framework for Membership Privacy Estimation in Generative Models Yixi Xu Soumendu Sundar Mukherjee Xiyang Liu Shruti Tople Rahul Dodhia J. L. Ferres MIACV 27 11 0 11 Sep 2020
Estimating Example Difficulty Using Variance of Gradients Chirag Agarwal Daniel D'souza Sara Hooker 210 107 0 26 Aug 2020
What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation Vitaly Feldman Chiyuan Zhang TDI 46 440 0 09 Aug 2020
Tempered Sigmoid Activations for Deep Learning with Differential Privacy Nicolas Papernot Abhradeep Thakurta Shuang Song Steve Chien Ulfar Erlingsson AAML 147 178 0 28 Jul 2020
Prediction in latent factor regression: Adaptive PCR and beyond Xin Bing F. Bunea Seth Strimas-Mackey M. Wegkamp 17 2 0 20 Jul 2020
How benign is benign overfitting? Amartya Sanyal P. Dokania Varun Kanade Philip Torr NoLa AAML 23 57 0 08 Jul 2020
Subpopulation Data Poisoning Attacks Matthew Jagielski Giorgio Severi Niklas Pousette Harger Alina Oprea AAML SILM 24 112 0 24 Jun 2020
Class-Weighted Classification: Trade-offs and Robust Approaches Ziyu Xu Chen Dan Justin Khim Pradeep Ravikumar 24 39 0 26 May 2020
Mehler's Formula, Branching Process, and Compositional Kernels of Deep Neural Networks Tengyuan Liang Hai Tran-Bach 20 11 0 09 Apr 2020
Multiclass Classification via Class-Weighted Nearest Neighbors Justin Khim Ziyu Xu Shashank Singh 7 1 0 09 Apr 2020
Learn to Forget: Machine Unlearning via Neuron Masking Yang Liu Zhuo Ma Ximeng Liu Jian-wei Liu Zhongyuan Jiang Jianfeng Ma Philip Yu K. Ren MU 22 61 0 24 Mar 2020
$On the robustness of the minimum $\ell_2$ interpolator$ On the robustness of the minimum $\ell_2$ interpolator Geoffrey Chinot M. Lerasle 36 10 0 12 Mar 2020
Finding online neural update rules by learning to remember Karol Gregor CLL 39 6 0 06 Mar 2020
Diversity sampling is an implicit regularization for kernel methods Michaël Fanuel J. Schreurs Johan A. K. Suykens 21 14 0 20 Feb 2020
Characterizing Structural Regularities of Labeled Data in Overparameterized Models Ziheng Jiang Chiyuan Zhang Kunal Talwar Michael C. Mozer TDI 17 97 0 08 Feb 2020
Interpolating Predictors in High-Dimensional Factor Regression F. Bunea Seth Strimas-Mackey M. Wegkamp 9 12 0 06 Feb 2020
PAC learning with stable and private predictions Y. Dagan Vitaly Feldman 17 12 0 24 Nov 2019
What Do Compressed Deep Neural Networks Forget? Sara Hooker Aaron Courville Gregory Clark Yann N. Dauphin Andrea Frome 19 181 0 13 Nov 2019
Extracting robust and accurate features via a robust information bottleneck Ankit Pensia Varun Jog Po-Ling Loh AAML 18 20 0 15 Oct 2019
Nyström landmark sampling and regularized Christoffel functions Michaël Fanuel J. Schreurs Johan A. K. Suykens 8 10 0 29 May 2019
Identity Crisis: Memorization and Generalization under Extreme Overparameterization Chiyuan Zhang Samy Bengio Moritz Hardt Michael C. Mozer Y. Singer 14 88 0 13 Feb 2019