Learning from Offline Foundation Features with Tensor Augmentations

3 October 2024

Emir Konuk

Christos Matsoukas

Moein Sorkhei

Phitchapha Lertsiravaramet

Kevin Smith

OffRL

ArXiv (abs)PDF HTML

Papers citing "Learning from Offline Foundation Features with Tensor Augmentations"

20 / 20 papers shown

Title
APLA: A Simple Adaptation Method for Vision Transformers Moein Sorkhei Emir Konuk Kevin Smith Christos Matsoukas 129 0 0 14 Mar 2025
Dual PatchNorm Manoj Kumar Mostafa Dehghani N. Houlsby UQCV ViT 86 11 0 02 Feb 2023
Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuning Dongze Lian Daquan Zhou Jiashi Feng Xinchao Wang 86 262 0 17 Oct 2022
Image Data Augmentation for Deep Learning: A Survey Suorong Yang Wei-Ting Xiao Mengcheng Zhang Suhan Guo Jian Zhao S. Furao 83 251 0 19 Apr 2022
Visual Prompt Tuning Menglin Jia Luming Tang Bor-Chun Chen Claire Cardie Serge Belongie Bharath Hariharan Ser-Nam Lim VLM VPVLM 159 1,645 0 23 Mar 2022
BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Junnan Li Dongxu Li Caiming Xiong Guosheng Lin MLLM BDL VLM CLIP 557 4,413 0 28 Jan 2022
BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models Elad Ben-Zaken Shauli Ravfogel Yoav Goldberg 199 1,243 0 18 Jun 2021
LoRA: Low-Rank Adaptation of Large Language Models J. E. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang Weizhu Chen OffRL AI4TS AI4CE ALM AIMat 502 10,526 0 17 Jun 2021
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 153 858 0 14 Jun 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 1.0K 29,926 0 26 Feb 2021
Training data-efficient image transformers & distillation through attention Hugo Touvron Matthieu Cord Matthijs Douze Francisco Massa Alexandre Sablayrolles Hervé Jégou ViT 389 6,805 0 23 Dec 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 901 42,463 0 28 May 2020
BCN20000: Dermoscopic Lesions in the Wild Marc Combalia Noel Codella V. Rotemberg Brian Helba Verónica Vilaplana ... Cristina Carrera Alicia Barreiro Allan Halpern S. Puig J. Malvehy 66 446 0 06 Aug 2019
Similarity of Neural Network Representations Revisited Simon Kornblith Mohammad Norouzi Honglak Lee Geoffrey E. Hinton 143 1,435 0 01 May 2019
Do Better ImageNet Models Transfer Better? Simon Kornblith Jonathon Shlens Quoc V. Le OOD MLT 170 1,330 0 23 May 2018
Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC) Noel Codella D. Gutman M. E. Celebi Brian Helba Michael Marchetti ... Aadi Kalloo Konstantinos Liopyris N. Mishra Harald Kittler Allan Halpern 99 2,082 0 13 Oct 2017
Dataset Augmentation in Feature Space Terrance Devries Graham W. Taylor 80 427 0 17 Feb 2017
AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classification Gui-Song Xia Jingwen Hu Fan Hu Baoguang Shi X. Bai Yanfei Zhong Liangpei Zhang 82 1,729 0 18 Aug 2016
Layer Normalization Jimmy Lei Ba J. Kiros Geoffrey E. Hinton 435 10,541 0 21 Jul 2016
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 355 18,654 0 06 Feb 2015