IsoBN: Fine-Tuning BERT with Isotropic Batch Normalization

IsoBN: Fine-Tuning BERT with Isotropic Batch Normalization

2 May 2020

Bill Yuchen Lin

Xiang Ren

Papers citing "IsoBN: Fine-Tuning BERT with Isotropic Batch Normalization"

4 / 4 papers shown

Title
Reliable Measures of Spread in High Dimensional Latent Spaces Anna C. Marbut Katy McKinney-Bock Travis J. Wheeler 30 2 0 15 Dec 2022
Addressing Token Uniformity in Transformers via Singular Value Transformation Hanqi Yan Lin Gui Wenjie Li Yulan He 29 14 0 24 Aug 2022
FreeLB: Enhanced Adversarial Training for Natural Language Understanding Chen Zhu Yu Cheng Zhe Gan S. Sun Tom Goldstein Jingjing Liu AAML 232 438 0 25 Sep 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 299 6,984 0 20 Apr 2018