Variational Information Bottleneck for Effective Low-Resource
Fine-Tuning

Variational Information Bottleneck for Effective Low-Resource Fine-Tuning

10 June 2021

Rabeeh Karimi Mahabadi

Yonatan Belinkov

James Henderson

Papers citing "Variational Information Bottleneck for Effective Low-Resource Fine-Tuning"

16 / 16 papers shown

Title
Individual and Structural Graph Information Bottlenecks for Out-of-Distribution Generalization Ling Yang Jiayi Zheng Heyuan Wang Zhongyi Liu Zhilin Huang Shenda Hong Wentao Zhang Bin Cui 22 13 0 28 Jun 2023
Bi-Drop: Enhancing Fine-tuning Generalization via Synchronous sub-net Estimation and Optimization Shoujie Tong Heming Xia Damai Dai Runxin Xu Tianyu Liu Binghuai Lin Yunbo Cao Zhifang Sui 20 0 0 24 May 2023
Towards understanding neural collapse in supervised contrastive learning with the information bottleneck method Siwei Wang S. Palmer 32 2 0 19 May 2023
Enhancing Multimodal Entity and Relation Extraction with Variational Information Bottleneck Shiyao Cui Jiangxia Cao Xin Cong Jiawei Sheng Quangang Li Tingwen Liu Jinqiao Shi 17 22 0 05 Apr 2023
Prototypical Fine-tuning: Towards Robust Performance Under Varying Data Sizes Yiqiao Jin Xiting Wang Y. Hao Yizhou Sun Xing Xie 38 11 0 24 Nov 2022
Towards Robust Low-Resource Fine-Tuning with Multi-View Compressed Representations Linlin Liu Xingxuan Li Megh Thakkar Xin Li Shafiq R. Joty Luo Si Lidong Bing 27 2 0 16 Nov 2022
Variational Distillation for Multi-View Learning Xudong Tian Zhizhong Zhang Cong Wang Wensheng Zhang Yanyun Qu Lizhuang Ma Zongze Wu Yuan Xie Dacheng Tao 26 5 0 20 Jun 2022
Don't Blame the Annotator: Bias Already Starts in the Annotation Instructions Mihir Parmar Swaroop Mishra Mor Geva Chitta Baral 28 55 0 01 May 2022
Anti-Spoofing Using Transfer Learning with Variational Information Bottleneck Youngsik Eom Yeonghyeon Lee Ji Sub Um Hoi-Rim Kim 29 25 0 04 Apr 2022
A Differential Entropy Estimator for Training Neural Networks Georg Pichler Pierre Colombo Malik Boudiaf Günther Koliander Pablo Piantanida 25 21 0 14 Feb 2022
Graph Structure Learning with Variational Information Bottleneck Qingyun Sun Jianxin Li Hao Peng Jia Wu Xingcheng Fu Cheng Ji Philip S. Yu 41 153 0 16 Dec 2021
Supervising Model Attention with Human Explanations for Robust Natural Language Inference Joe Stacey Yonatan Belinkov Marek Rei 30 45 0 16 Apr 2021
Mixout: Effective Regularization to Finetune Large-scale Pretrained Language Models Cheolhyoung Lee Kyunghyun Cho Wanmo Kang MoE 249 205 0 25 Sep 2019
The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives Elena Voita Rico Sennrich Ivan Titov 198 181 0 03 Sep 2019
Hypothesis Only Baselines in Natural Language Inference Adam Poliak Jason Naradowsky Aparajita Haldar Rachel Rudinger Benjamin Van Durme 190 576 0 02 May 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 297 6,959 0 20 Apr 2018