Fortuitous Forgetting in Connectionist Networks

1 February 2022

Aaron Courville

Papers citing "Fortuitous Forgetting in Connectionist Networks"

33 / 33 papers shown

Title
Sample Selection via Contrastive Fragmentation for Noisy Label Regression C. Kim Sangwoo Moon Jihwan Moon Dongyeon Woo Gunhee Kim NoLa 64 0 0 25 Feb 2025
Adam on Local Time: Addressing Nonstationarity in RL with Relative Adam Timesteps Benjamin Ellis Matthew Jackson Andrei Lupu Alexander David Goldie Mattie Fellows Shimon Whiteson Jakob Foerster 97 1 0 22 Dec 2024
A Complexity-Based Theory of Compositionality Eric Elmoznino Thomas Jiralerspong Yoshua Bengio Guillaume Lajoie CoGe 69 5 0 18 Oct 2024
On the Regularization of Learnable Embeddings for Time Series Forecasting L. Butera G. Felice Andrea Cini Cesare Alippi AI4TS 39 0 0 18 Oct 2024
Co-occurrence is not Factual Association in Language Models Xiao Zhang Miao Li Ji Wu KELM 84 3 0 21 Sep 2024
Forget Sharpness: Perturbed Forgetting of Model Biases Within SAM Dynamics Ankit Vani Frederick Tung Gabriel L. Oliveira Hossein Sharifi-Noghabi AAML 45 0 0 10 Jun 2024
Step Out and Seek Around: On Warm-Start Training with Incremental Data Maying Shen Hongxu Yin Pavlo Molchanov Lei Mao Jose M. Alvarez CLL 66 1 0 06 Jun 2024
Views Can Be Deceiving: Improved SSL Through Feature Space Augmentation Kimia Hamidieh Haoran Zhang Swami Sankaranarayanan Marzyeh Ghassemi 57 0 0 28 May 2024
What Variables Affect Out-Of-Distribution Generalization in Pretrained Models? Md Yousuf Harun Kyungbok Lee Jhair Gallardo Giri Krishnan Christopher Kanan 46 3 0 23 May 2024
Diverse Feature Learning by Self-distillation and Reset Sejik Park CLL 53 1 0 29 Mar 2024
Language Model Alignment with Elastic Reset Michael Noukhovitch Samuel Lavoie Florian Strub Aaron Courville KELM 105 25 0 06 Dec 2023
CRAFT: Contextual Re-Activation of Filters for face recognition Training Aman Bhatta Domingo Mery Haiyu Wu Kevin W. Bowyer CVBM 27 2 0 29 Nov 2023
SoK: Memorisation in machine learning Dmitrii Usynin Moritz Knolle Georgios Kaissis 40 1 0 06 Nov 2023
Improving Compositional Generalization Using Iterated Learning and Simplicial Embeddings Yi Ren Samuel Lavoie Mikhail Galkin Danica J. Sutherland Aaron Courville 46 15 0 28 Oct 2023
Reset It and Forget It: Relearning Last-Layer Weights Improves Continual and Transfer Learning Lapo Frati Neil Traft Jeff Clune Nick Cheney CLL 43 0 0 12 Oct 2023
What do larger image classifiers memorise? Michal Lukasik Vaishnavh Nagarajan A. S. Rawat A. Menon Sanjiv Kumar 38 5 0 09 Oct 2023
Towards More Human-like AI Communication: A Review of Emergent Communication Research Nicolo’ Brandizzi 52 13 0 01 Aug 2023
A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learning Zhenyi Wang Enneng Yang Li Shen Heng-Chiao Huang KELM MU 39 49 0 16 Jul 2023
Improving Language Plasticity via Pretraining with Active Forgetting Yihong Chen Kelly Marchisio Roberta Raileanu David Ifeoluwa Adelani Pontus Stenetorp Sebastian Riedel Mikel Artetx KELM AI4CE CLL 44 24 0 03 Jul 2023
PLASTIC: Improving Input and Label Plasticity for Sample Efficient Reinforcement Learning Hojoon Lee Hanseul Cho Hyunseung Kim Daehoon Gwak Joonkee Kim Jaegul Choo Se-Young Yun Chulhee Yun OffRL 86 27 0 19 Jun 2023
Robust Ante-hoc Graph Explainer using Bilevel Optimization Kha-Dinh Luong Mert Kosan A. Silva Ambuj K. Singh 41 6 0 25 May 2023
Simulated Annealing in Early Layers Leads to Better Generalization Amirm. Sarfi Zahra Karimpour Muawiz Chaudhary N. Khalid Mirco Ravanelli Sudhir Mudur Eugene Belilovsky AI4CE CLL 23 7 0 10 Apr 2023
Adiabatic replay for continual learning Alexander Krawczyk A. Gepperth 45 3 0 23 Mar 2023
Learn, Unlearn and Relearn: An Online Learning Paradigm for Deep Neural Networks V. Ramkumar Elahe Arani Bahram Zonooz MU OnRL CLL 44 5 0 18 Mar 2023
The Dormant Neuron Phenomenon in Deep Reinforcement Learning Ghada Sokar Rishabh Agarwal Pablo Samuel Castro Utku Evci CLL 53 90 0 24 Feb 2023
How to prepare your task head for finetuning Yi Ren Shangmin Guo Wonho Bae Danica J. Sutherland 24 14 0 11 Feb 2023
Towards Robust Low-Resource Fine-Tuning with Multi-View Compressed Representations Linlin Liu Xingxuan Li Megh Thakkar Xin Li Chenyu You Luo Si Lidong Bing 32 2 0 16 Nov 2022
Knowledge Unlearning for Mitigating Privacy Risks in Language Models Joel Jang Dongkeun Yoon Sohee Yang Sungmin Cha Moontae Lee Lajanugen Logeswaran Minjoon Seo KELM PILM MU 149 199 0 04 Oct 2022
Patching open-vocabulary models by interpolating weights Gabriel Ilharco Mitchell Wortsman S. Gadre Shuran Song Hannaneh Hajishirzi Simon Kornblith Ali Farhadi Ludwig Schmidt VLM KELM 37 169 0 10 Aug 2022
Data Redaction from Pre-trained GANs Zhifeng Kong Kamalika Chaudhuri 68 16 0 29 Jun 2022
The Primacy Bias in Deep Reinforcement Learning Evgenii Nikishin Max Schwarzer P. DÓro Pierre-Luc Bacon Rameswar Panda OnRL 96 183 0 16 May 2022
Continual Feature Selection: Spurious Features in Continual Learning Timothée Lesort CLL 43 10 0 02 Mar 2022
Iterated learning for emergent systematicity in VQA Ankit Vani Max Schwarzer Yucheng Lu Eeshan Gunesh Dhekane Rameswar Panda 72 24 0 03 May 2021