Positive-Congruent Training: Towards Regression-Free Model Updates

18 November 2020

Papers citing "Positive-Congruent Training: Towards Regression-Free Model Updates"

37 / 37 papers shown

Title
An Experience Report on Regression-Free Repair of Deep Neural Network Model Takao Nakagawa Susumu Tokumoto Shogo Tokui Fuyuki Ishikawa 56 1 0 10 Mar 2025
Targeting Negative Flips in Active Learning using Validation Sets Ryan Benkert Mohit Prabhushankar Ghassan AlRegib AAML 40 0 0 16 Nov 2024
FlipGuard: Defending Preference Alignment against Update Regression with Constrained Optimization Mingye Zhu Yi Liu Quan Wang Junbo Guo Zhendong Mao 29 1 0 01 Oct 2024
Backward-Compatible Aligned Representations via an Orthogonal Transformation Layer Simone Ricci Niccoló Biondi F. Pernici A. Bimbo VLM 23 0 0 16 Aug 2024
Backward Compatibility in Attributive Explanation and Enhanced Model Training Method Ryuta Matsuno 41 0 0 05 Aug 2024
MUSCLE: A Model Update Strategy for Compatible LLM Evolution Jessica Echterhoff Fartash Faghri Raviteja Vemulapalli Ting-Yao Hu Chun-Liang Li Oncel Tuzel Hadi Pouransari KELM 58 2 0 12 Jul 2024
Towards Cross-modal Backward-compatible Representation Learning for Vision-Language Models Young Kyun Jang Ser-nam Lim VLM 37 1 0 23 May 2024
Meanings and Feelings of Large Language Models: Observability of Latent States in Generative AI Tian Yu Liu Stefano Soatto Matteo Marchi Pratik Chaudhari Paulo Tabuada AI4CE 38 2 0 22 May 2024
Updating Windows Malware Detectors: Balancing Robustness and Regression against Adversarial EXEmples M. Kozák Luca Demetrio Dmitrijs Trizna Fabio Roli AAML 36 0 0 04 May 2024
Robustness-Congruent Adversarial Training for Secure Machine Learning Model Updates Daniele Angioni Luca Demetrio Maura Pintor Luca Oneto Davide Anguita Battista Biggio Fabio Roli AAML 35 2 0 27 Feb 2024
Predictive Churn with the Set of Good Models J. Watson-Daniels Flavio du Pin Calmon Alexander DÁmour Carol Xuan Long David C. Parkes Berk Ustun 83 7 0 12 Feb 2024
Good Teachers Explain: Explanation-Enhanced Knowledge Distillation Amin Parchami-Araghi Moritz Bohle Sukrut Rao Bernt Schiele FAtt 10 3 0 05 Feb 2024
Clinical Trial Active Learning Zoe Fowler Kiran Kokilepersaud Mohit Prabhushankar Ghassan AlRegib 22 6 0 20 Jul 2023
Pseudo-Label Training and Model Inertia in Neural Machine Translation B. Hsu Anna Currey Xing Niu Maria Nuadejde Georgiana Dinu ODL 40 2 0 19 May 2023
Maintaining Stability and Plasticity for Predictive Churn Reduction George Adam B. Haibe-Kains Anna Goldenberg 25 1 0 06 May 2023
AI Model Disgorgement: Methods and Choices Alessandro Achille Michael Kearns Carson Klingenberg Stefano Soatto MU 31 11 0 07 Apr 2023
FastFill: Efficient Compatible Model Update Florian Jaeckle Fartash Faghri Ali Farhadi Oncel Tuzel Hadi Pouransari 33 2 0 08 Mar 2023
Improving Prediction Backward-Compatiblility in NLP Model Upgrade with Gated Fusion Yi-An Lai Elman Mansimov Yuqing Xie Yan Zhang 24 3 0 04 Feb 2023
Backward Compatibility During Data Updates by Weight Interpolation Raphael Schumann Elman Mansimov Yi-An Lai Nikolaos Pappas Xibin Gao Yi Zhang 16 4 0 25 Jan 2023
Darwinian Model Upgrades: Model Evolving with Selective Compatibility Binjie Zhang Shupeng Su Yixiao Ge Xuyuan Xu Yexin Wang Chun Yuan Mike Zheng Shou Ying Shan 19 4 0 13 Oct 2022
Towards Regression-Free Neural Networks for Diverse Compute Platforms Rahul Duggal Hao Zhou Shuo Yang Jun Fang Yuanjun Xiong Wei Xia UQCV 31 1 0 27 Sep 2022
Switchable Representation Learning Framework with Self-compatibility Shengsen Wu Yan Bai Yihang Lou Xiongkun Linghu Jianzhong He Ling-yu Duan 22 1 0 16 Jun 2022
Machine Learning for Microcontroller-Class Hardware: A Review Swapnil Sayan Saha S. Sandha Mani B. Srivastava 27 118 0 29 May 2022
ELODI: Ensemble Logit Difference Inhibition for Positive-Congruent Training Yue Zhao Yantao Shen Yuanjun Xiong Shuo Yang Wei Xia Z. Tu Bernt Shiele Stefano Soatto BDL 46 6 0 12 May 2022
Training Uncertainty-Aware Classifiers with Conformalized Deep Learning Bat-Sheva Einbinder Yaniv Romano Matteo Sesia Yanfei Zhou UQCV 23 48 0 12 May 2022
Monitored Distillation for Positive Congruent Depth Completion Tianlin Liu Parth T. Agrawal Allison Chen Byung-Woo Hong A. Wong 14 38 0 30 Mar 2022
Multi-Modal Learning Using Physicians Diagnostics for Optical Coherence Tomography Classification Yash-yee Logan Kiran Kokilepersaud Gukyeong Kwon Ghassan Al-Regib C. Wykoff Hannah J. Yu 19 8 0 20 Mar 2022
NeuRecover: Regression-Controlled Repair of Deep Neural Networks with Training History Sho Tokui Susumu Tokumoto Akihito Yoshii Fuyuki Ishikawa Takao Nakagawa Kazuki Munakata Shinji Kikuchi KELM 19 25 0 01 Mar 2022
Measuring and Reducing Model Update Regression in Structured Prediction for NLP Deng Cai Elman Mansimov Yi-An Lai Yixuan Su Lei Shu Yi Zhang KELM 67 8 0 07 Feb 2022
Hot-Refresh Model Upgrades with Regression-Alleviating Compatible Training in Image Retrieval Binjie Zhang Yixiao Ge Yantao Shen Yu Li Chun Yuan Xuyuan Xu Yexin Wang Ying Shan VLM 33 7 0 24 Jan 2022
Contrastive Neighborhood Alignment Pengkai Zhu Zhaowei Cai Yuanjun Xiong Z. Tu Luis Goncalves Vijay Mahadevan Stefano Soatto 10 2 0 06 Jan 2022
Distributionally Robust Group Backwards Compatibility Martín Bertrán Natalia Martínez Alexander X. Oesterling Guillermo Sapiro FedML OOD 25 1 0 20 Dec 2021
CoReS: Compatible Representations via Stationarity Niccoló Biondi F. Pernici Matteo Bruni A. Bimbo OOD 21 9 0 15 Nov 2021
Backward-Compatible Prediction Updates: A Probabilistic Approach Frederik Trauble Julius von Kügelgen Matthäus Kleindessner Francesco Locatello Bernhard Schölkopf Peter V. Gehler 27 16 0 02 Jul 2021
Regression Bugs Are In Your Model! Measuring, Reducing and Analyzing Regressions In NLP Model Updates Yuqing Xie Yi-An Lai Yuanjun Xiong Yi Zhang Stefano Soatto UQCV 16 16 0 07 May 2021
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 276 5,675 0 05 Dec 2016
The Loss Surfaces of Multilayer Networks A. Choromańska Mikael Henaff Michaël Mathieu Gerard Ben Arous Yann LeCun ODL 183 1,185 0 30 Nov 2014