DisCo-CLIP: A Distributed Contrastive Loss for Memory Efficient CLIP
Training

DisCo-CLIP: A Distributed Contrastive Loss for Memory Efficient CLIP Training

17 April 2023

Lei Zhang

ArXiv (abs)PDF HTML Github (58★)

Papers citing "DisCo-CLIP: A Distributed Contrastive Loss for Memory Efficient CLIP Training"

11 / 11 papers shown

Title
AmorLIP: Efficient Language-Image Pretraining via Amortization Haotian Sun Yitong Li Yuchen Zhuang Niao He Hanjun Dai Bo Dai VLM 86 0 0 25 May 2025
Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss Zesen Cheng Hang Zhang Kehan Li Sicong Leng Zhiqiang Hu Fei Wu Deli Zhao Xin Li Lidong Bing 72 2 0 22 Oct 2024
The Russian-focused embedders' exploration: ruMTEB benchmark and Russian embedding model design Artem Snegirev Maria Tikhonova Anna Maksimova Alena Fenogenova Alexander Abramov 217 6 0 22 Aug 2024
FastCLIP: A Suite of Optimization Techniques to Accelerate CLIP Training with Limited Resources Xiyuan Wei Fanjiang Ye Ori Yonay Xingyu Chen Baixi Sun Dingwen Tao Tianbao Yang VLM CLIP 127 2 0 01 Jul 2024
Arctic-Embed: Scalable, Efficient, and Accurate Text Embedding Models Luke Merrick Danmei Xu Gaurav Nuti Daniel Campos 73 27 0 08 May 2024
Sparse Concept Bottleneck Models: Gumbel Tricks in Contrastive Learning Andrei Semenov Vladimir Ivanov Aleksandr Beznosikov Alexander Gasnikov 66 6 0 04 Apr 2024
$A$^{3}$lign-DFER: Pioneering Comprehensive Dynamic Affective Alignment for Dynamic Facial Expression Recognition with CLIP$ A $^{3}$ lign-DFER: Pioneering Comprehensive Dynamic Affective Alignment for Dynamic Facial Expression Recognition with CLIP Zeng Tao Yan Wang Junxiong Lin Haoran Wang Xinji Mai ... Ziheng Zhou Shaoqi Yan Qing Zhao Liyuan Han Wenqiang Zhang 72 13 0 07 Mar 2024
Spurious Feature Eraser: Stabilizing Test-Time Adaptation for Vision-Language Foundation Model Huan Ma Yan Zhu Changqing Zhang Peilin Zhao Baoyuan Wu Long-Kai Huang Qinghua Hu Bing Wu VLM 146 2 0 01 Mar 2024
CARZero: Cross-Attention Alignment for Radiology Zero-Shot Classification Zihang Jiang Qingsong Yao Zihang Jiang Rongsheng Wang Zhiyang He Xiaodong Tao S. Kevin Zhou MedIm 96 16 0 27 Feb 2024
Taiyi-Diffusion-XL: Advancing Bilingual Text-to-Image Generation with Large Vision-Language Model Support Xiaojun Wu Di Zhang Ruyi Gan Junyu Lu Ziwei Wu Renliang Sun Jiaxing Zhang Pingjian Zhang Yan Song VLM 77 7 0 26 Jan 2024
iDesigner: A High-Resolution and Complex-Prompt Following Text-to-Image Diffusion Model for Interior Design Ruyi Gan Xiaojun Wu Junyu Lu Yuanhe Tian Di Zhang ... Renliang Sun Chang Liu Jiaxing Zhang Pingjian Zhang Yan Song 240 4 0 07 Dec 2023