LaMDA: Large Model Fine-Tuning via Spectrally Decomposed Low-Dimensional
Adaptation

LaMDA: Large Model Fine-Tuning via Spectrally Decomposed Low-Dimensional Adaptation

18 June 2024

Seyedarmin Azizi

Papers citing "LaMDA: Large Model Fine-Tuning via Spectrally Decomposed Low-Dimensional Adaptation"

7 / 7 papers shown

Title
LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning Rui Pan Xiang Liu Shizhe Diao Renjie Pi Jipeng Zhang Chi Han Tong Zhang 54 42 0 26 Mar 2024
An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning Yun Luo Zhen Yang Fandong Meng Yafu Li Jie Zhou Yue Zhang CLL KELM 87 297 0 17 Aug 2023
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 448 3,952 0 18 Apr 2021
Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning Armen Aghajanyan Luke Zettlemoyer Sonal Gupta 75 549 1 22 Dec 2020
BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions Christopher Clark Kenton Lee Ming-Wei Chang Tom Kwiatkowski Michael Collins Kristina Toutanova 169 1,475 0 24 May 2019
Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization Shashi Narayan Shay B. Cohen Mirella Lapata AILaw 102 1,652 0 27 Aug 2018
Pointer Sentinel Mixture Models Stephen Merity Caiming Xiong James Bradbury R. Socher RALM 161 2,814 0 26 Sep 2016