Intelligent Learning Rate Distribution to reduce Catastrophic Forgetting in Transformers

27 March 2024

Barbara Hammer

Papers citing "Intelligent Learning Rate Distribution to reduce Catastrophic Forgetting in Transformers"

2 / 2 papers shown

Title
Faster Convergence for Transformer Fine-tuning with Line Search Methods Philip Kenneweg Leonardo Galli Tristan Kenneweg Barbara Hammer ODL 46 2 0 27 Mar 2024
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 299 6,996 0 20 Apr 2018