Selfie: Self-supervised Pretraining for Image Embedding

7 June 2019

Papers citing "Selfie: Self-supervised Pretraining for Image Embedding"

40 / 40 papers shown

Title
DynaMo: In-Domain Dynamics Pretraining for Visuo-Motor Control Zichen Jeff Cui Hengkai Pan Aadhithya Iyer Siddhant Haldar Lerrel Pinto VGen 46 11 0 18 Sep 2024
Text-to-Code Generation with Modality-relative Pre-training Fenia Christopoulou Guchun Zhang Gerasimos Lampouras AI4TS 31 1 0 08 Feb 2024
Towards a Foundation Purchasing Model: Pretrained Generative Autoregression on Transaction Sequences Piotr Skalski David Sutton Stuart Burrell Iker Perez Jason Wong AI4TS 50 2 0 03 Jan 2024
The Counterattack of CNNs in Self-Supervised Learning: Larger Kernel Size might be All You Need Tianjin Huang Tianlong Chen Zhangyang Wang Shiwei Liu 39 1 0 09 Dec 2023
Initializing Models with Larger Ones Zhiqiu Xu Yanjie Chen Kirill Vishniakov Yida Yin Zhiqiang Shen Trevor Darrell Lingjie Liu Zhuang Liu 48 18 0 30 Nov 2023
Contrastive Multi-Level Graph Neural Networks for Session-based Recommendation F. Wang Xingyu Gao Zhenyu Chen Lei Lyu 28 12 0 06 Nov 2023
Evaluating The Robustness of Self-Supervised Representations to Background/Foreground Removal Xavier F. Cadet Ranya Aloufi A. Miranville S. Ahmadi-Abhari Hamed Haddadi 49 0 0 02 Jun 2023
CrysGNN : Distilling pre-trained knowledge to enhance property prediction for crystalline materials Kishalay Das Bidisha Samanta Pawan Goyal Seung-Cheol Lee S. Bhattacharjee Niloy Ganguly 26 17 0 14 Jan 2023
Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning? Runpei Dong Zekun Qi Linfeng Zhang Junbo Zhang Jian‐Yuan Sun Zheng Ge Li Yi Kaisheng Ma ViT 3DPC 34 85 0 16 Dec 2022
SPCXR: Self-supervised Pretraining using Chest X-rays Towards a Domain Specific Foundation Model Syed Muhammad Anwar Abhijeet Parida Sara Atito Muhammad Awais G. Nino Josef Kitler M. Linguraru ViT SSL OOD 41 6 0 23 Nov 2022
Self-Supervised Pretraining of Graph Neural Network for the Retrieval of Related Mathematical Expressions in Scientific Articles Lukas Pfahler K. Morik SSL 24 4 0 22 Aug 2022
PanGu-Coder: Program Synthesis with Function-Level Language Modeling Fenia Christopoulou Gerasimos Lampouras Milan Gritta Guchun Zhang Yinpeng Guo ... Guangtai Liang Jia Wei Xin Jiang Qianxiang Wang Qun Liu ELM SyDa ALM 50 74 0 22 Jul 2022
Semantic-Based Few-Shot Learning by Interactive Psychometric Testing Lu Yin Vlado Menkovski Yulong Pei Mykola Pechenizkiy 32 1 0 16 Dec 2021
Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modeling Xumin Yu Lulu Tang Yongming Rao Tiejun Huang Jie Zhou Jiwen Lu 3DPC 68 657 0 29 Nov 2021
SimMIM: A Simple Framework for Masked Image Modeling Zhenda Xie Zheng Zhang Yue Cao Yutong Lin Jianmin Bao Zhuliang Yao Qi Dai Han Hu 90 1,323 0 18 Nov 2021
When Does Contrastive Learning Preserve Adversarial Robustness from Pretraining to Finetuning? Lijie Fan Sijia Liu Pin-Yu Chen Gaoyuan Zhang Chuang Gan AAML VLM 32 121 0 01 Nov 2021
SSAST: Self-Supervised Audio Spectrogram Transformer Yuan Gong Cheng-I Jeff Lai Yu-An Chung James R. Glass ViT 48 270 0 19 Oct 2021
Rethinking Supervised Pre-training for Better Downstream Transferring Yutong Feng Jianwen Jiang Mingqian Tang Rong Jin Yue Gao SSL 64 39 0 12 Oct 2021
Geographical Knowledge-driven Representation Learning for Remote Sensing Images Wenyuan Li Keyan Chen Hao Chen Zhenwei Shi SSL 40 66 0 12 Jul 2021
Efficient Self-supervised Vision Transformers for Representation Learning Chunyuan Li Jianwei Yang Pengchuan Zhang Mei Gao Bin Xiao Xiyang Dai Lu Yuan Jianfeng Gao ViT 47 212 0 17 Jun 2021
BEiT: BERT Pre-Training of Image Transformers Hangbo Bao Li Dong Songhao Piao Furu Wei ViT 78 2,763 0 15 Jun 2021
InfoBehavior: Self-supervised Representation Learning for Ultra-long Behavior Sequence via Hierarchical Grouping Runshi Liu Pengda Qin Yuhong Li Weigao Wen Dong Li Kefeng Deng Qiang Wu AI4TS 20 0 0 13 Jun 2021
Vision Transformers are Robust Learners Sayak Paul Pin-Yu Chen ViT 28 310 0 17 May 2021
Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learning Zhenda Xie Yutong Lin Zheng Zhang Yue Cao Stephen Lin Han Hu SSL 42 411 0 19 Nov 2020
Towards Domain-Agnostic Contrastive Learning Vikas Verma Minh-Thang Luong Kenji Kawaguchi Hieu H. Pham Quoc V. Le SSL 20 117 0 09 Nov 2020
A Survey on Contrastive Self-supervised Learning Ashish Jaiswal Ashwin Ramesh Babu Mohammad Zaki Zadeh Debapriya Banerjee F. Makedon SSL 62 1,368 0 31 Oct 2020
Robust Pre-Training by Adversarial Contrastive Learning Ziyu Jiang Tianlong Chen Ting-Li Chen Zhangyang Wang 35 229 0 26 Oct 2020
Self-Supervised Contrastive Learning for Efficient User Satisfaction Prediction in Conversational Agents Mohammad Kachuee Hao Yuan Young-Bum Kim Sungjin Lee 27 25 0 21 Oct 2020
X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers Jaemin Cho Jiasen Lu Dustin Schwenk Hannaneh Hajishirzi Aniruddha Kembhavi VLM MLLM 35 102 0 23 Sep 2020
Self-PU: Self Boosted and Calibrated Positive-Unlabeled Training Xuxi Chen Wuyang Chen Tianlong Chen Ye Yuan Chen Gong Kewei Chen Zhangyang Wang 36 77 0 22 Jun 2020
Rethinking the Value of Labels for Improving Class-Imbalanced Learning Yuzhe Yang Zhi Xu SSL 25 402 0 13 Jun 2020
VirTex: Learning Visual Representations from Textual Annotations Karan Desai Justin Johnson SSL VLM 35 433 0 11 Jun 2020
FashionBERT: Text and Image Matching with Adaptive Loss for Cross-modal Retrieval D. Gao Linbo Jin Ben Chen Minghui Qiu Peng Li Yi Wei Yitao Hu Haozhe Jasper Wang OOD 25 133 0 20 May 2020
Label-Efficient Learning on Point Clouds using Approximate Convex Decompositions Matheus Gadelha Aruni RoyChowdhury Gopal Sharma E. Kalogerakis Liangliang Cao Erik Learned-Miller Rui Wang Subhransu Maji 3DPC 33 45 0 30 Mar 2020
Adversarial Robustness: From Self-Supervised Pre-Training to Fine-Tuning Tianlong Chen Sijia Liu Shiyu Chang Yu Cheng Lisa Amini Zhangyang Wang AAML 18 246 0 28 Mar 2020
Learning Representations by Predicting Bags of Visual Words Spyros Gidaris Andrei Bursuc N. Komodakis P. Pérez Matthieu Cord SSL 38 117 0 27 Feb 2020
Pre-Training of Deep Bidirectional Protein Sequence Representations with Structural Information Seonwoo Min Seunghyun Park Siwon Kim Hyun-Soo Choi Byunghan Lee Sungroh Yoon SSL 22 62 0 25 Nov 2019
When Does Self-supervision Improve Few-shot Learning? Jong-Chyi Su Subhransu Maji B. Hariharan 33 168 0 08 Oct 2019
TabNet: Attentive Interpretable Tabular Learning Sercan O. Arik Tomas Pfister LMTD 60 1,302 0 20 Aug 2019
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Zhiwen Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 718 6,755 0 26 Sep 2016