v1v2 (latest)

Patching open-vocabulary models by interpolating weights

10 August 2022

Shuran Song

Papers citing "Patching open-vocabulary models by interpolating weights"

33 / 133 papers shown

Title
LIV: Language-Image Representations and Rewards for Robotic Control Yecheng Jason Ma William Liang Vaidehi Som Vikash Kumar Amy Zhang Osbert Bastani Dinesh Jayaraman LM&Ro 94 130 0 01 Jun 2023
Transferring Learning Trajectories of Neural Networks Daiki Chijiwa 60 3 0 23 May 2023
Parts of Speech-Grounded Subspaces in Vision-Language Models James Oldfield Christos Tzelepis Yannis Panagakis M. Nicolaou Ioannis Patras 83 9 0 23 May 2023
Task Arithmetic in the Tangent Space: Improved Editing of Pre-Trained Models Guillermo Ortiz-Jiménez Alessandro Favero P. Frossard MoMe 161 125 0 22 May 2023
Collaborative Development of NLP models Fereshte Khani Marco Tulio Ribeiro 78 2 0 20 May 2023
ZipIt! Merging Models from Different Tasks without Training George Stoica Daniel Bolya J. Bjorner Pratik Ramesh Taylor N. Hearn Judy Hoffman VLM MoMe 139 125 0 04 May 2023
Making the Most of What You Have: Adapting Pre-trained Visual Language Models in the Low-data Regime Chuhan Zhang Antoine Miech Jiajun Shen Jean-Baptiste Alayrac Pauline Luc VLM VPVLM 85 2 0 03 May 2023
Defense-Prefix for Preventing Typographic Attacks on CLIP Hiroki Azuma Yusuke Matsui VLM AAML 88 19 0 10 Apr 2023
On Robustness in Multimodal Learning Brandon McKinzie Joseph Cheng Vaishaal Shankar Yinfei Yang Jonathon Shlens Alexander Toshev 59 2 0 10 Apr 2023
Probing Conceptual Understanding of Large Visual-Language Models Madeline Chantry Schiappa Raiyaan Abdullah Shehreen Azad Jared Claypoole Michael Cogswell Ajay Divakaran Yogesh S Rawat 81 16 0 07 Apr 2023
Associating Spatially-Consistent Grouping with Text-supervised Semantic Segmentation Yabo Zhang Zihao Wang Jun Hao Liew Jingjia Huang Manyu Zhu Jiashi Feng W. Zuo VLM 52 4 0 03 Apr 2023
$Δ$ -Patching: A Framework for Rapid Adaptation of Pre-trained Convolutional Networks without Base Performance Loss Chaitanya Devaguptapu Samarth Sinha K. J. Joseph V. Balasubramanian Animesh Garg 111 1 0 26 Mar 2023
MAtch, eXpand and Improve: Unsupervised Finetuning for Zero-Shot Action Recognition with Language Knowledge Wei Lin Leonid Karlinsky Nina Shvetsova Horst Possegger Mateusz Koziñski Yikang Shen Rogerio Feris Hilde Kuehne Horst Bischof VLM 163 39 0 15 Mar 2023
Merging Decision Transformers: Weight Averaging for Forming Multi-Task Policies Daniel Lawson A. H. Qureshi MoMe OffRL 85 13 0 14 Mar 2023
Your representations are in the network: composable and parallel adaptation for large scale models Yonatan Dukler Alessandro Achille Hao Yang Varsha Vivek Luca Zancato Benjamin Bowman Avinash Ravichandran Charless C. Fowlkes A. Swaminathan Stefano Soatto 88 3 0 07 Mar 2023
Edit at your own risk: evaluating the robustness of edited models to distribution shifts Davis Brown Charles Godfrey Cody Nizinski Jonathan Tu Henry Kvinge KELM 85 8 0 28 Feb 2023
Robust Weight Signatures: Gaining Robustness as Easy as Patching Weights? Ruisi Cai Zhenyu Zhang Zhangyang Wang AAML OOD 91 12 0 24 Feb 2023
Seasoning Model Soups for Robustness to Adversarial and Natural Distribution Shifts Francesco Croce Sylvestre-Alvise Rebuffi Evan Shelhamer Sven Gowal AAML 79 18 0 20 Feb 2023
CHiLS: Zero-Shot Image Classification with Hierarchical Label Sets Cheng-i Wang Julian McAuley Zachary Chase Lipton Saurabh Garg VLM 119 88 0 06 Feb 2023
Projected Subnetworks Scale Adaptation Siddhartha Datta N. Shadbolt VLM CLL 90 0 0 27 Jan 2023
Backward Compatibility During Data Updates by Weight Interpolation Raphael Schumann Elman Mansimov Yi-An Lai Nikolaos Pappas Xibin Gao Yi Zhang 41 5 0 25 Jan 2023
Multimodality Helps Unimodality: Cross-Modal Few-Shot Learning with Multimodal Models Zhiqiu Lin Samuel Yu Zhiyi Kuang Deepak Pathak Deva Ramana VLM 152 116 0 16 Jan 2023
Model Ratatouille: Recycling Diverse Models for Out-of-Distribution Generalization Alexandre Ramé Kartik Ahuja Jianyu Zhang Matthieu Cord Léon Bottou David Lopez-Paz MoMe OODD 124 86 0 20 Dec 2022
Reproducible scaling laws for contrastive language-image learning Mehdi Cherti Romain Beaumont Ross Wightman Mitchell Wortsman Gabriel Ilharco Cade Gordon Christoph Schuhmann Ludwig Schmidt J. Jitsev VLM CLIP 139 823 0 14 Dec 2022
Task Bias in Vision-Language Models Sachit Menon I. Chandratreya Carl Vondrick VLM SSL 72 6 0 08 Dec 2022
Editing Models with Task Arithmetic Gabriel Ilharco Marco Tulio Ribeiro Mitchell Wortsman Suchin Gururangan Ludwig Schmidt Hannaneh Hajishirzi Ali Farhadi KELM MoMe MU 213 522 0 08 Dec 2022
Rank-One Editing of Encoder-Decoder Models Vikas Raunak Arul Menezes KELM 83 10 0 23 Nov 2022
REPAIR: REnormalizing Permuted Activations for Interpolation Repair Keller Jordan Hanie Sedghi O. Saukh R. Entezari Behnam Neyshabur MoMe 128 101 0 15 Nov 2022
lo-fi: distributed fine-tuning without communication Mitchell Wortsman Suchin Gururangan Shen Li Ali Farhadi Ludwig Schmidt Michael G. Rabbat Ari S. Morcos 103 24 0 19 Oct 2022
Git Re-Basin: Merging Models modulo Permutation Symmetries Samuel K. Ainsworth J. Hayase S. Srinivasa MoMe 329 344 0 11 Sep 2022
Lottery Pools: Winning More by Interpolating Tickets without Increasing Training or Inference Cost Lu Yin Shiwei Liu Fang Meng Tianjin Huang Vlado Menkovski Mykola Pechenizkiy 54 13 0 23 Aug 2022
Motley: Benchmarking Heterogeneity and Personalization in Federated Learning Shan-shan Wu Tian Li Zachary B. Charles Yu Xiao Ziyu Liu Zheng Xu Virginia Smith FedML 101 45 0 18 Jun 2022
CLIP-Adapter: Better Vision-Language Models with Feature Adapters Peng Gao Shijie Geng Renrui Zhang Teli Ma Rongyao Fang Yongfeng Zhang Hongsheng Li Yu Qiao VLM CLIP 350 1,062 0 09 Oct 2021