How to Fine-Tune Vision Models with SGD

How to Fine-Tune Vision Models with SGD

17 November 2022

Sébastien Bubeck

Suriya Gunasekar

Papers citing "How to Fine-Tune Vision Models with SGD"

12 / 12 papers shown

Title
Deconstructing What Makes a Good Optimizer for Language Models Rosie Zhao Depen Morwani David Brandfonbrener Nikhil Vyas Sham Kakade 50 17 0 10 Jul 2024
Fusion Transformer with Object Mask Guidance for Image Forgery Analysis Dimitrios Karageorgiou Giorgos Kordopatis-Zilos Symeon Papadopoulos ViT 28 5 0 18 Mar 2024
PERP: Rethinking the Prune-Retrain Paradigm in the Era of LLMs Max Zimmer Megi Andoni Christoph Spiegel Sebastian Pokutta VLM 52 10 0 23 Dec 2023
Domain adaptation using optimal transport for invariant learning using histopathology datasets Kianoush Falahkheirkhah Alex X. Lu David Alvarez-Melis G. Huynh OOD MedIm 30 4 0 03 Mar 2023
Differentially Private Diffusion Models Generate Useful Synthetic Images Sahra Ghalebikesabi Leonard Berrada Sven Gowal Ira Ktena Robert Stanforth Jamie Hayes Soham De Samuel L. Smith Olivia Wiles Borja Balle DiffM 31 69 0 27 Feb 2023
Improving Reliability of Fine-tuning with Block-wise Optimisation Basel Barakat Qiang Huang 19 1 0 15 Jan 2023
A New Linear Scaling Rule for Private Adaptive Hyperparameter Optimization Ashwinee Panda Xinyu Tang Saeed Mahloujifar Vikash Sehwag Prateek Mittal 43 11 0 08 Dec 2022
Surgical Fine-Tuning Improves Adaptation to Distribution Shifts Yoonho Lee Annie S. Chen Fahim Tajwar Ananya Kumar Huaxiu Yao Percy Liang Chelsea Finn OOD 58 197 0 20 Oct 2022
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 341 5,785 0 29 Apr 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 280 3,848 0 18 Apr 2021
FreeLB: Enhanced Adversarial Training for Natural Language Understanding Chen Zhu Yu Cheng Zhe Gan S. Sun Tom Goldstein Jingjing Liu AAML 232 438 0 25 Sep 2019
Borrowing Treasures from the Wealthy: Deep Transfer Learning through Selective Joint Fine-tuning Weifeng Ge Yizhou Yu 94 233 0 28 Feb 2017