data2vec: A General Framework for Self-supervised Learning in Speech,
Vision and Language

v1v2v3 (latest)

data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language

7 February 2022

ArXiv (abs)PDF HTML

Papers citing "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language"

7 / 557 papers shown

Title
Adversarial Masking for Self-Supervised Learning Yuge Shi N. Siddharth Philip Torr Adam R. Kosiorek SSL 145 87 0 31 Jan 2022
PeCo: Perceptual Codebook for BERT Pre-training of Vision Transformers Xiaoyi Dong Jianmin Bao Ting Zhang Dongdong Chen Weiming Zhang Lu Yuan Dong Chen Fang Wen Nenghai Yu Baining Guo ViT 150 246 0 24 Nov 2021
A Survey of Visual Transformers Yang Liu Yao Zhang Yixin Wang Feng Hou Jin Yuan Jiang Tian Yang Zhang Zhongchao Shi Jianping Fan Zhiqiang He 3DGS ViT 193 356 0 11 Nov 2021
GenURL: A General Framework for Unsupervised Representation Learning Siyuan Li Zicheng Liu Z. Zang Di Wu Zhiyuan Chen Stan Z. Li OOD 3DGS OffRL 136 9 0 27 Oct 2021
Wav2vec-S: Semi-Supervised Pre-Training for Low-Resource ASR Hanjing Zhu Li Wang Jindong Wang Gaofeng Cheng Pengyuan Zhang Yonghong Yan SSL VLM 106 9 0 09 Oct 2021
Using Self-Supervised Auxiliary Tasks to Improve Fine-Grained Facial Representation Mahdi Pourmirzaei G. Montazer Farzaneh Esmaili CVBM 69 28 0 13 May 2021
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 352 4,110 0 17 Jun 2020