v1v2 (latest)

Learning on LoRAs: GL-Equivariant Processing of Low-Rank Weight Spaces for Large Finetuned Models

5 October 2024

Theo Putterman

Derek Lim

Papers citing "Learning on LoRAs: GL-Equivariant Processing of Low-Rank Weight Spaces for Large Finetuned Models"

31 / 31 papers shown

Title
A Model Zoo of Vision Transformers Damian Falk Léo Meynent Florence Pfammatter Konstantin Schurholt Damian Borth 252 1 0 14 Apr 2025
Monomial Matrix Group Equivariant Neural Functional Networks Hoang V. Tran Thieu N. Vo Tho H. Tran An T. Nguyen Tan M. Nguyen 131 9 0 18 Sep 2024
Blind Baselines Beat Membership Inference Attacks for Foundation Models Debeshee Das Jie Zhang Florian Tramèr MIALM 166 39 1 23 Jun 2024
PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models Fanxu Meng Zhaohui Wang Muhan Zhang VLM 153 103 0 03 Apr 2024
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey Zeyu Han Chao Gao Jinyang Liu Jeff Zhang Sai Qian Zhang 267 401 0 21 Mar 2024
Equivariant Frames and the Impossibility of Continuous Canonicalization Nadav Dym Hannah Lawrence Jonathan W. Siegel 102 23 0 25 Feb 2024
Improved Generalization of Weight Space Networks via Augmentations Aviv Shamsian Aviv Navon David W. Zhang Yan Zhang Ethan Fetaya Gal Chechik Haggai Maron 102 14 0 06 Feb 2024
Permutation Equivariant Neural Functionals Allan Zhou Kaien Yang Kaylee Burns Adriano Cardace Yiding Jiang Samuel Sokota J. Zico Kolter Chelsea Finn 110 56 0 27 Feb 2023
Editing Models with Task Arithmetic Gabriel Ilharco Marco Tulio Ribeiro Mitchell Wortsman Suchin Gururangan Ludwig Schmidt Hannaneh Hajishirzi Ali Farhadi KELM MoMe MU 203 521 0 08 Dec 2022
VeLO: Training Versatile Learned Optimizers by Scaling Up Luke Metz James Harrison C. Freeman Amil Merchant Lucas Beyer ... Naman Agrawal Ben Poole Igor Mordatch Adam Roberts Jascha Narain Sohl-Dickstein 121 60 0 17 Nov 2022
Learning to Learn with Generative Models of Neural Network Checkpoints William S. Peebles Ilija Radosavovic Tim Brooks Alexei A. Efros Jitendra Malik UQCV 156 69 0 26 Sep 2022
Git Re-Basin: Merging Models modulo Permutation Symmetries Samuel K. Ainsworth J. Hayase S. Srinivasa MoMe 321 344 0 11 Sep 2022
DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation Nataniel Ruiz Yuanzhen Li Varun Jampani Yael Pritch Michael Rubinstein Kfir Aberman 287 2,895 0 25 Aug 2022
Scaling Autoregressive Models for Content-Rich Text-to-Image Generation Jiahui Yu Yuanzhong Xu Jing Yu Koh Thang Luong Gunjan Baid ... Zarana Parekh Xin Li Han Zhang Jason Baldridge Yonghui Wu EGVM 211 1,133 0 22 Jun 2022
Reconstructing Training Data from Trained Neural Networks Niv Haim Gal Vardi Gilad Yehudai Ohad Shamir Michal Irani 114 141 0 15 Jun 2022
High-Resolution Image Synthesis with Latent Diffusion Models Robin Rombach A. Blattmann Dominik Lorenz Patrick Esser Bjorn Ommer 3DV 523 15,809 0 20 Dec 2021
The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networks R. Entezari Hanie Sedghi O. Saukh Behnam Neyshabur MoMe 98 238 0 12 Oct 2021
LoRA: Low-Rank Adaptation of Large Language Models J. E. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang Weizhu Chen OffRL AI4TS AI4CE ALM AIMat 528 10,563 0 17 Jun 2021
Scalars are universal: Equivariant machine learning, structured like classical physics Soledad Villar D. Hogg Kate Storey-Fisher Weichi Yao Ben Blum-Smith PINN AI4CE 75 136 0 11 Jun 2021
A Practical Method for Constructing Equivariant Multilayer Perceptrons for Arbitrary Matrix Groups Marc Finzi Max Welling A. Wilson 167 198 0 19 Apr 2021
CLIPScore: A Reference-free Evaluation Metric for Image Captioning Jack Hessel Ari Holtzman Maxwell Forbes Ronan Le Bras Yejin Choi CLIP 175 1,589 0 18 Apr 2021
Denoising Diffusion Probabilistic Models Jonathan Ho Ajay Jain Pieter Abbeel DiffM 794 18,408 0 19 Jun 2020
Lorentz Group Equivariant Neural Network for Particle Physics A. Bogatskiy Brandon M. Anderson Jan T. Offermann M. Roussi David W. Miller Risi Kondor AI4CE 72 141 0 08 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 917 42,520 0 28 May 2020
Classifying the classifier: dissecting the weight space of neural networks Gabriel Eilertsen Daniel Jonsson Timo Ropinski Jonas Unger Anders Ynnerman 68 54 0 13 Feb 2020
On the Universality of Invariant Networks Haggai Maron Ethan Fetaya Nimrod Segol Y. Lipman OOD 169 240 0 27 Jan 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,324 0 11 Oct 2018
Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point clouds Nathaniel Thomas Tess E. Smidt S. Kearnes Lusann Yang Li Li Kai Kohlhoff Patrick F. Riley 3DPC 105 979 0 22 Feb 2018
Membership Inference Attacks against Machine Learning Models Reza Shokri M. Stronati Congzheng Song Vitaly Shmatikov SLR MIALM MIACV 285 4,168 0 18 Oct 2016
Group Equivariant Convolutional Networks Taco S. Cohen Max Welling BDL 181 1,947 0 24 Feb 2016
Deep Learning Face Attributes in the Wild Ziwei Liu Ping Luo Xiaogang Wang Xiaoou Tang CVBM 268 8,433 0 28 Nov 2014