ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2109.01903
  4. Cited By
Robust fine-tuning of zero-shot models

Robust fine-tuning of zero-shot models

4 September 2021
Mitchell Wortsman
Gabriel Ilharco
Jong Wook Kim
Mike Li
Simon Kornblith
Rebecca Roelofs
Raphael Gontijo-Lopes
Hannaneh Hajishirzi
Ali Farhadi
Hongseok Namkoong
Ludwig Schmidt
    VLM
ArXivPDFHTML

Papers citing "Robust fine-tuning of zero-shot models"

50 / 514 papers shown
Title
Anytime Continual Learning for Open Vocabulary Classification
Anytime Continual Learning for Open Vocabulary Classification
Zhen Zhu
Yiming Gong
Derek Hoiem
VLM
39
1
0
13 Sep 2024
Rethinking Prompting Strategies for Multi-Label Recognition with Partial
  Annotations
Rethinking Prompting Strategies for Multi-Label Recognition with Partial Annotations
Samyak Rawlekar
Shubhang Bhatnagar
Narendra Ahuja
VLM
31
1
0
12 Sep 2024
Minimizing Embedding Distortion for Robust Out-of-Distribution
  Performance
Minimizing Embedding Distortion for Robust Out-of-Distribution Performance
Tom Shaked
Yuval Goldman
Oran Shayer
OODD
23
0
0
11 Sep 2024
Online Zero-Shot Classification with CLIP
Online Zero-Shot Classification with CLIP
Qi Qian
Juhua Hu
VLM
32
4
0
23 Aug 2024
Improving the Classification Effect of Clinical Images of Diseases for
  Multi-Source Privacy Protection
Improving the Classification Effect of Clinical Images of Diseases for Multi-Source Privacy Protection
Tian Bowen
Xu Zhengyang
Yin Zhihao
Wang Jingying
Yue Yutao
FedML
39
0
0
23 Aug 2024
MePT: Multi-Representation Guided Prompt Tuning for Vision-Language
  Model
MePT: Multi-Representation Guided Prompt Tuning for Vision-Language Model
Xinyang Wang
Yi Yang
Minfeng Zhu
Kecheng Zheng
Shi Liu
Wei Chen
VPVLM
MLLM
VLM
55
1
0
19 Aug 2024
Linking Robustness and Generalization: A k* Distribution Analysis of
  Concept Clustering in Latent Space for Vision Models
Linking Robustness and Generalization: A k* Distribution Analysis of Concept Clustering in Latent Space for Vision Models
Shashank Kotyan
Pin-Yu Chen
Danilo Vasconcellos Vargas
OOD
39
0
0
17 Aug 2024
BadMerging: Backdoor Attacks Against Model Merging
BadMerging: Backdoor Attacks Against Model Merging
Jinghuai Zhang
Jianfeng Chi
Zheng Li
Kunlin Cai
Yang Zhang
Yuan Tian
MoMe
FedML
AAML
44
14
0
14 Aug 2024
Efficient and Versatile Robust Fine-Tuning of Zero-shot Models
Efficient and Versatile Robust Fine-Tuning of Zero-shot Models
Sungyeon Kim
Boseung Jeong
Donghyun Kim
Suha Kwak
VLM
31
2
0
11 Aug 2024
Task Prompt Vectors: Effective Initialization through Multi-Task
  Soft-Prompt Transfer
Task Prompt Vectors: Effective Initialization through Multi-Task Soft-Prompt Transfer
Wei Chen
Long Chen
Ivan Srba
Yu Wu
MoMe
VLM
36
3
0
02 Aug 2024
DECIDER: Leveraging Foundation Model Priors for Improved Model Failure
  Detection and Explanation
DECIDER: Leveraging Foundation Model Priors for Improved Model Failure Detection and Explanation
Rakshith Subramanyam
Kowshik Thopalli
V. Narayanaswamy
Jayaraman J.Thiagarajan
27
2
0
01 Aug 2024
Task-Adapter: Task-specific Adaptation of Image Models for Few-shot
  Action Recognition
Task-Adapter: Task-specific Adaptation of Image Models for Few-shot Action Recognition
Congqi Cao
Guibiao Liao
Yating Yu
Kanglin Liu
Lingtong Min
Yanning Zhang
37
4
0
01 Aug 2024
Machine Unlearning in Generative AI: A Survey
Machine Unlearning in Generative AI: A Survey
Zheyuan Liu
Guangyao Dou
Zhaoxuan Tan
Yijun Tian
Meng Jiang
MU
31
14
0
30 Jul 2024
Effectively Leveraging CLIP for Generating Situational Summaries of Images and Videos
Effectively Leveraging CLIP for Generating Situational Summaries of Images and Videos
Dhruv Verma
Debaditya Roy
Basura Fernando
27
1
0
30 Jul 2024
MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning
MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning
Yupeng Chen
Senmiao Wang
Zhihang Lin
Zhihang Lin
Yushun Zhang
Tian Ding
Ruoyu Sun
Ruoyu Sun
CLL
77
1
0
30 Jul 2024
Ego-VPA: Egocentric Video Understanding with Parameter-efficient Adaptation
Ego-VPA: Egocentric Video Understanding with Parameter-efficient Adaptation
Tz-Ying Wu
Kyle Min
Subarna Tripathi
Nuno Vasconcelos
EgoV
55
0
0
28 Jul 2024
Adversarial Robustification via Text-to-Image Diffusion Models
Adversarial Robustification via Text-to-Image Diffusion Models
Daewon Choi
Jongheon Jeong
Huiwon Jang
Jinwoo Shin
DiffM
44
1
0
26 Jul 2024
LCA-on-the-Line: Benchmarking Out-of-Distribution Generalization with
  Class Taxonomies
LCA-on-the-Line: Benchmarking Out-of-Distribution Generalization with Class Taxonomies
Jia Shi
Gautam Gare
Jinjin Tian
Siqi Chai
Zhiqiu Lin
Arun Vasudevan
Di Feng
Francesco Ferroni
Shu Kong
VLM
OODD
OOD
55
3
0
22 Jul 2024
Test-Time Low Rank Adaptation via Confidence Maximization for Zero-Shot
  Generalization of Vision-Language Models
Test-Time Low Rank Adaptation via Confidence Maximization for Zero-Shot Generalization of Vision-Language Models
Raza Imam
Hanan Gani
Muhammad Huzaifa
Karthik Nandakumar
VLM
40
2
0
22 Jul 2024
Craft: Cross-modal Aligned Features Improve Robustness of Prompt Tuning
Craft: Cross-modal Aligned Features Improve Robustness of Prompt Tuning
Jingchen Sun
Rohan Sharma
Vishnu Suresh Lokhande
Changyou Chen
41
0
0
22 Jul 2024
Learn to Preserve and Diversify: Parameter-Efficient Group with
  Orthogonal Regularization for Domain Generalization
Learn to Preserve and Diversify: Parameter-Efficient Group with Orthogonal Regularization for Domain Generalization
Jiajun Hu
Jian Zhang
Lei Qi
Yinghuan Shi
Yang Gao
OOD
38
4
0
21 Jul 2024
Training-Free Model Merging for Multi-target Domain Adaptation
Training-Free Model Merging for Multi-target Domain Adaptation
Wenyi Li
Huan-ang Gao
Mingju Gao
Beiwen Tian
Rong Zhi
Hao Zhao
MoMe
53
5
0
18 Jul 2024
Robust Calibration of Large Vision-Language Adapters
Robust Calibration of Large Vision-Language Adapters
Balamurali Murugesan
Julio Silva-Rodríguez
Ismail Ben Ayed
Jose Dolz
OODD
VLM
32
6
0
18 Jul 2024
Cross-Modal Augmentation for Few-Shot Multimodal Fake News Detection
Cross-Modal Augmentation for Few-Shot Multimodal Fake News Detection
Ye Jiang
Taihang Wang
Xiaoman Xu
Yimin Wang
Xingyi Song
Diana Maynard
33
2
0
16 Jul 2024
Unconstrained Open Vocabulary Image Classification: Zero-Shot Transfer
  from Text to Image via CLIP Inversion
Unconstrained Open Vocabulary Image Classification: Zero-Shot Transfer from Text to Image via CLIP Inversion
Philipp Allgeuer
Kyra Ahrens
Stefan Wermter
CLIP
VLM
27
3
0
15 Jul 2024
DataDream: Few-shot Guided Dataset Generation
DataDream: Few-shot Guided Dataset Generation
Jae Myung Kim
Jessica Bader
Stephan Alaniz
Cordelia Schmid
Zeynep Akata
39
5
0
15 Jul 2024
Open Vocabulary Multi-Label Video Classification
Open Vocabulary Multi-Label Video Classification
Rohit Gupta
Mamshad Nayeem Rizve
Jayakrishnan Unnikrishnan
Ashish Tawari
Son Tran
Mubarak Shah
Benjamin Z. Yao
Trishul Chilimbi
VLM
67
1
0
12 Jul 2024
Textual Query-Driven Mask Transformer for Domain Generalized
  Segmentation
Textual Query-Driven Mask Transformer for Domain Generalized Segmentation
Byeonghyun Pak
Byeongju Woo
Sunghwan Kim
Dae-Hwan Kim
Hoseong Kim
46
3
0
12 Jul 2024
Real-Time Anomaly Detection and Reactive Planning with Large Language
  Models
Real-Time Anomaly Detection and Reactive Planning with Large Language Models
Rohan Sinha
Amine Elhafsi
Christopher Agia
Matthew Foutter
Edward Schmerling
Marco Pavone
OffRL
LRM
45
26
0
11 Jul 2024
Scaling Up Personalized Aesthetic Assessment via Task Vector
  Customization
Scaling Up Personalized Aesthetic Assessment via Task Vector Customization
Jooyeol Yun
Jaegul Choo
MoMe
25
2
0
09 Jul 2024
MagMax: Leveraging Model Merging for Seamless Continual Learning
MagMax: Leveraging Model Merging for Seamless Continual Learning
Daniel Marczak
Bartłomiej Twardowski
Tomasz Trzciñski
Sebastian Cygert
MoMe
CLL
53
18
0
08 Jul 2024
Mind the Interference: Retaining Pre-trained Knowledge in Parameter
  Efficient Continual Learning of Vision-Language Models
Mind the Interference: Retaining Pre-trained Knowledge in Parameter Efficient Continual Learning of Vision-Language Models
Longxiang Tang
Zhuotao Tian
Kai Li
Chunming He
Hantao Zhou
Hengshuang Zhao
Xiu Li
Jiaya Jia
CLL
VLM
34
20
0
07 Jul 2024
Fully Fine-tuned CLIP Models are Efficient Few-Shot Learners
Fully Fine-tuned CLIP Models are Efficient Few-Shot Learners
Mushui Liu
Bozheng Li
Yunlong Yu
VLM
CLIP
28
3
0
04 Jul 2024
SAFT: Towards Out-of-Distribution Generalization in Fine-Tuning
SAFT: Towards Out-of-Distribution Generalization in Fine-Tuning
Bac Nguyen
Stefan Uhlich
Fabien Cardinaux
Lukas Mauch
Marzieh Edraki
Aaron Courville
OODD
CLL
VLM
54
3
0
03 Jul 2024
Evaluating Model Performance Under Worst-case Subpopulations
Evaluating Model Performance Under Worst-case Subpopulations
Mike Li
Hongseok Namkoong
Shangzhou Xia
45
17
0
01 Jul 2024
Advancing Cross-domain Discriminability in Continual Learning of
  Vison-Language Models
Advancing Cross-domain Discriminability in Continual Learning of Vison-Language Models
Yicheng Xu
Yuxin Chen
Jiahao Nie
Yusong Wang
Huiping Zhuang
Manabu Okumura
VLM
CLL
41
6
0
27 Jun 2024
WARP: On the Benefits of Weight Averaged Rewarded Policies
WARP: On the Benefits of Weight Averaged Rewarded Policies
Alexandre Ramé
Johan Ferret
Nino Vieillard
Robert Dadashi
Léonard Hussenot
Pierre-Louis Cedoz
Pier Giuseppe Sessa
Sertan Girgin
Arthur Douillard
Olivier Bachem
56
14
0
24 Jun 2024
Flat Posterior Does Matter For Bayesian Model Averaging
Flat Posterior Does Matter For Bayesian Model Averaging
Sungjun Lim
Jeyoon Yeom
Sooyon Kim
Hoyoon Byun
Jinho Kang
Yohan Jung
Jiyoung Jung
Kyungwoo Song
AAML
BDL
48
0
0
21 Jun 2024
Reinforcing Pre-trained Models Using Counterfactual Images
Reinforcing Pre-trained Models Using Counterfactual Images
Xiang Li
Ren Togo
Keisuke Maeda
Takahiro Ogawa
Miki Haseyama
33
1
0
19 Jun 2024
Knowledge Fusion By Evolving Weights of Language Models
Knowledge Fusion By Evolving Weights of Language Models
Guodong Du
Jing Li
Hanting Liu
Runhua Jiang
Shuyang Yu
Yifei Guo
S. Goh
Ho-Kin Tang
MoMe
44
8
0
18 Jun 2024
Safety Arithmetic: A Framework for Test-time Safety Alignment of
  Language Models by Steering Parameters and Activations
Safety Arithmetic: A Framework for Test-time Safety Alignment of Language Models by Steering Parameters and Activations
Rima Hazra
Sayan Layek
Somnath Banerjee
Soujanya Poria
KELM
LLMSV
34
6
0
17 Jun 2024
They're All Doctors: Synthesizing Diverse Counterfactuals to Mitigate
  Associative Bias
They're All Doctors: Synthesizing Diverse Counterfactuals to Mitigate Associative Bias
Salma Abdel Magid
Jui-Hsien Wang
Kushal Kafle
Hanspeter Pfister
44
1
0
17 Jun 2024
Uncertainty modeling for fine-tuned implicit functions
Uncertainty modeling for fine-tuned implicit functions
A. Susmelj
Mael Macuglia
Nataša Tagasovska
Reto Sutter
Sebastiano Caprara
Jean-Philippe Thiran
E. Konukoglu
70
1
0
17 Jun 2024
Few-Shot Recognition via Stage-Wise Retrieval-Augmented Finetuning
Few-Shot Recognition via Stage-Wise Retrieval-Augmented Finetuning
Tian Liu
Huixin Zhang
Shubham Parashar
Shu Kong
29
4
0
17 Jun 2024
Exploring the Spectrum of Visio-Linguistic Compositionality and
  Recognition
Exploring the Spectrum of Visio-Linguistic Compositionality and Recognition
Youngtaek Oh
Pyunghwan Ahn
Jinhyung Kim
Gwangmo Song
Soonyoung Lee
In So Kweon
Junmo Kim
CoGe
45
2
0
13 Jun 2024
Dataset Enhancement with Instance-Level Augmentations
Dataset Enhancement with Instance-Level Augmentations
Orest Kupyn
Christian Rupprecht
45
9
0
12 Jun 2024
MAP: Low-compute Model Merging with Amortized Pareto Fronts via Quadratic Approximation
MAP: Low-compute Model Merging with Amortized Pareto Fronts via Quadratic Approximation
Lu Li
T. Zhang
Zhiqi Bu
Suyuchen Wang
Huan He
Jie Fu
Yonghui Wu
Jiang Bian
Yong Chen
Yoshua Bengio
FedML
MoMe
100
3
0
11 Jun 2024
Regularized Training with Generated Datasets for Name-Only Transfer of
  Vision-Language Models
Regularized Training with Generated Datasets for Name-Only Transfer of Vision-Language Models
Minho Park
S. Park
Jooyeol Yun
Jaegul Choo
VLM
35
0
0
08 Jun 2024
Feature contamination: Neural networks learn uncorrelated features and fail to generalize
Feature contamination: Neural networks learn uncorrelated features and fail to generalize
Tianren Zhang
Chujie Zhao
Guanyu Chen
Yizhou Jiang
Feng Chen
OOD
MLT
OODD
77
3
0
05 Jun 2024
Boosting Vision-Language Models with Transduction
Boosting Vision-Language Models with Transduction
Maxime Zanella
Benoît Gérin
Ismail Ben Ayed
VLM
42
5
0
03 Jun 2024
Previous
123456...91011
Next