Self-supervised Learning by View Synthesis

22 April 2023

Xiangyu Zhang

Papers citing "Self-supervised Learning by View Synthesis"

50 / 58 papers shown

Title
Context Autoencoder for Self-Supervised Representation Learning Xiaokang Chen Mingyu Ding Xiaodi Wang Ying Xin Shentong Mo Yunhao Wang Shumin Han Ping Luo Gang Zeng Jingdong Wang SSL 93 395 0 07 Feb 2022
Masked Feature Prediction for Self-Supervised Visual Pre-Training Chen Wei Haoqi Fan Saining Xie Chaoxia Wu Alan Yuille Christoph Feichtenhofer ViT 143 668 0 16 Dec 2021
Masked-attention Mask Transformer for Universal Image Segmentation Bowen Cheng Ishan Misra Alex Schwing Alexander Kirillov Rohit Girdhar ISeg 236 2,358 0 02 Dec 2021
SimMIM: A Simple Framework for Masked Image Modeling Zhenda Xie Zheng Zhang Yue Cao Yutong Lin Jianmin Bao Zhuliang Yao Qi Dai Han Hu 185 1,352 0 18 Nov 2021
iBOT: Image BERT Pre-Training with Online Tokenizer Jinghao Zhou Chen Wei Huiyu Wang Wei Shen Cihang Xie Alan Yuille Tao Kong 81 734 0 15 Nov 2021
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 460 7,739 0 11 Nov 2021
Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstruction Jeremy Reizenstein Roman Shapovalov Philipp Henzler L. Sbordone Patrick Labatut David Novotny 3DPC 3DV 127 465 0 01 Sep 2021
BEiT: BERT Pre-Training of Image Transformers Hangbo Bao Li Dong Songhao Piao Furu Wei ViT 260 2,824 0 15 Jun 2021
SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers Enze Xie Wenhai Wang Zhiding Yu Anima Anandkumar J. Álvarez Ping Luo ViT 277 5,025 0 31 May 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 685 6,066 0 29 Apr 2021
Pri3D: Can 3D Priors Help 2D Representation Learning? Ji Hou Saining Xie Benjamin Graham Angela Dai Matthias Nießner SSL 3DPC MDE 118 80 0 22 Apr 2021
An Empirical Study of Training Self-Supervised Vision Transformers Xinlei Chen Saining Xie Kaiming He ViT 154 1,862 0 05 Apr 2021
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng Zhang Stephen Lin B. Guo ViT 447 21,418 0 25 Mar 2021
Transformer in Transformer Kai Han An Xiao Enhua Wu Jianyuan Guo Chunjing Xu Yunhe Wang ViT 386 1,564 0 27 Feb 2021
How to represent part-whole hierarchies in a neural network Geoffrey E. Hinton OCL MoE 76 203 0 25 Feb 2021
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions Wenhai Wang Enze Xie Xiang Li Deng-Ping Fan Kaitao Song Ding Liang Tong Lu Ping Luo Ling Shao ViT 527 3,722 0 24 Feb 2021
ShaRF: Shape-conditioned Radiance Fields from a Single View Konstantinos Rematas Ricardo Martín Brualla V. Ferrari 82 111 0 17 Feb 2021
Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers Sixiao Zheng Jiachen Lu Hengshuang Zhao Xiatian Zhu Zekun Luo ... Yanwei Fu Jianfeng Feng Tao Xiang Philip Torr Li Zhang ViT 194 2,897 0 31 Dec 2020
Training data-efficient image transformers & distillation through attention Hugo Touvron Matthieu Cord Matthijs Douze Francisco Massa Alexandre Sablayrolles Hervé Jégou ViT 384 6,762 0 23 Dec 2020
Pre-Trained Image Processing Transformer Hanting Chen Yunhe Wang Tianyu Guo Chang Xu Yiping Deng Zhenhua Liu Siwei Ma Chunjing Xu Chao Xu Wen Gao VLM ViT 134 1,676 0 01 Dec 2020
MVTN: Multi-View Transformation Network for 3D Shape Recognition Abdullah Hamdi Silvio Giancola Guohao Li 3DV 3DPC 87 203 0 26 Nov 2020
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 253 4,052 0 20 Nov 2020
Point Transformer Nico Engel Vasileios Belagiannis Klaus C. J. Dietmayer 3DPC 173 1,990 0 02 Nov 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 637 41,003 0 22 Oct 2020
Deformable DETR: Deformable Transformers for End-to-End Object Detection Xizhou Zhu Weijie Su Lewei Lu Bin Li Xiaogang Wang Jifeng Dai ViT 216 5,073 0 08 Oct 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 366 6,797 0 13 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 755 41,932 0 28 May 2020
End-to-End Object Detection with Transformers Nicolas Carion Francisco Massa Gabriel Synnaeve Nicolas Usunier Alexander Kirillov Sergey Zagoruyko ViT 3DV PINN 385 13,035 0 26 May 2020
From Image Collections to Point Clouds with Self-supervised Shape and Pose Networks K. L. Navaneet Ansu Mathew Shashank Kashyap Wei-Chih Hung Varun Jampani R. Venkatesh Babu 3DPC 42 36 0 05 May 2020
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis B. Mildenhall Pratul P. Srinivasan Matthew Tancik Jonathan T. Barron R. Ramamoorthi Ren Ng 129 2,595 0 19 Mar 2020
Self-supervised Single-view 3D Reconstruction via Semantic Consistency Xueting Li Sifei Liu Kihwan Kim Shalini De Mello Varun Jampani Ming-Hsuan Yang Jan Kautz 3DV 65 148 0 13 Mar 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 364 18,752 0 13 Feb 2020
Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervision Michael Niemeyer L. Mescheder Michael Oechsle Andreas Geiger 3DH 3DV 69 995 0 16 Dec 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 199 12,074 0 13 Nov 2019
RandAugment: Practical automated data augmentation with a reduced search space E. D. Cubuk Barret Zoph Jonathon Shlens Quoc V. Le MQ 221 3,485 0 30 Sep 2019
Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Data Mikaela Angelina Uy Quang Pham Binh-Son Hua D. Nguyen Sai-Kit Yeung 3DV 3DPC 88 778 0 13 Aug 2019
Learning to Predict 3D Objects with an Interpolation-based Differentiable Renderer Wenzheng Chen Jun Gao Huan Ling Edward James Smith J. Lehtinen Alec Jacobson Sanja Fidler 3DH 3DV 80 362 0 03 Aug 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 166 2,399 0 13 Jun 2019
What Do Single-view 3D Reconstruction Networks Learn? Maxim Tatarchenko Stephan R. Richter René Ranftl Zhuwen Li V. Koltun Thomas Brox 3DV 50 427 0 09 May 2019
Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoning Shichen Liu Tianye Li Weikai Chen Hao Li 3DV 85 694 0 03 Apr 2019
Occupancy Networks: Learning 3D Reconstruction in Function Space L. Mescheder Michael Oechsle Michael Niemeyer Sebastian Nowozin Andreas Geiger 3DV 236 2,897 0 10 Dec 2018
Unsupervised Learning of Shape and Pose with Differentiable Point Clouds Eldar Insafutdinov Alexey Dosovitskiy 3DPC 66 244 0 22 Oct 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.7K 94,770 0 11 Oct 2018
VERAM: View-Enhanced Recurrent Attention Model for 3D Shape Classification Song-Le Chen Lintao Zheng Yan Zhang Zhixin Sun Kai Xu 3DPC 3DV 67 74 0 20 Aug 2018
Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination Zhirong Wu Yuanjun Xiong Stella X. Yu Dahua Lin SSL 173 3,452 0 05 May 2018
Pixel2Mesh: Generating 3D Mesh Models from Single RGB Images Nanyang Wang Yinda Zhang Zhuwen Li Yanwei Fu Wen Liu Yu-Gang Jiang 3DV 113 1,328 0 05 Apr 2018
$PointCNN: Convolution On $\mathcal{X}$-Transformed Points$ PointCNN: Convolution On $\mathcal{X}$ -Transformed Points Yangyan Li Rui Bu Mingchao Sun Wei Wu Xinhan Di Baoquan Chen 3DPC 228 2,443 0 23 Jan 2018
Neural 3D Mesh Renderer Hiroharu Kato Yoshitaka Ushiku Tatsuya Harada 3DV 73 1,045 0 20 Nov 2017
Neural Discrete Representation Learning Aaron van den Oord Oriol Vinyals Koray Kavukcuoglu BDL SSL OCL 226 5,008 0 02 Nov 2017
Large Batch Training of Convolutional Networks Yang You Igor Gitman Boris Ginsburg ODL 128 848 0 13 Aug 2017