SVL: Spike-based Vision-language Pretraining for Efficient 3D Open-world Understanding

23 May 2025

Papers citing "SVL: Spike-based Vision-language Pretraining for Efficient 3D Open-world Understanding"

40 / 40 papers shown

Title
Efficient 3D Recognition with Event-driven Spike Sparse Convolution Xuerui Qiu Man Yao Jieyuan Zhang Yuhong Chou Ning Qiao Shibo Zhou Bo Xu Guoqi Li 3DPC 138 5 0 10 Dec 2024
Scaling Spike-driven Transformer with Efficient Spike Firing Approximation Training Man Yao Xuerui Qiu Tianxiang Hu J. Hu Yuhong Chou Keyu Tian Jianxing Liao Luziwei Leng Bo Xu Guoqi Li 138 15 0 25 Nov 2024
High-Performance Temporal Reversible Spiking Neural Networks with $O(L)$ Training Memory and $O(1)$ Inference Cost Jiakui Hu Man Yao Xuerui Qiu Yuhong Chou Yuxuan Cai Ning Qiao Yonghong Tian Boxing Xu Guoqi Li AI4CE 61 13 0 26 May 2024
EgoLifter: Open-world 3D Segmentation for Egocentric Perception Qiao Gu Zhaoyang Lv Duncan Frost Simon Green Julian Straub Chris Sweeney 3DGS EgoV 68 27 0 26 Mar 2024
Spikformer V2: Join the High Accuracy Club on ImageNet with an SNN Ticket Zhaokun Zhou Kaiwei Che Wei Fang Keyu Tian Yuesheng Zhu Shuicheng Yan Yonghong Tian Liuliang Yuan ViT 112 33 0 04 Jan 2024
Towards Open World Active Learning for 3D Object Detection Zhuoxiao Chen Yadan Luo Zixin Wang Zijian Wang Xin Yu Zi Huang 68 0 0 16 Oct 2023
Spiking PointNet: Spiking Neural Networks for Point Clouds Dayong Ren Zhe Ma Y. Chen Weihang Peng Xiaode Liu Yuhan Zhang Yu-Zhu Guo 3DH 3DPC 62 29 0 10 Oct 2023
SpikeCLIP: A Contrastive Language-Image Pretrained Spiking Neural Network Changze Lv Tianlong Li Changze Lv Yufei Gu Jianhan Xu Cenyuan Zhang Muling Wu Xiaoqing Zheng Xuanjing Huang CLIP VLM 136 3 0 10 Oct 2023
Point-Bind & Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction Following Ziyu Guo Renrui Zhang Xiangyang Zhu Yiwen Tang Xianzheng Ma ... Ke Chen Peng Gao Xianzhi Li Hongsheng Li Pheng-Ann Heng MLLM 96 144 0 01 Sep 2023
PointLLM: Empowering Large Language Models to Understand Point Clouds Runsen Xu Xiaolong Wang Tai Wang Yilun Chen Jiangmiao Pang Dahua Lin MLLM 123 184 0 31 Aug 2023
SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiation Malyaban Bal Abhronil Sengupta 51 43 0 21 Aug 2023
Gated Attention Coding for Training High-performance and Efficient Spiking Neural Networks Xuerui Qiu Rui-Jie Zhu Yuhong Chou Zhaorui Wang Liang-Jian Deng Guoqi Li 74 37 0 12 Aug 2023
OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understanding Minghua Liu Ruoxi Shi Kaiming Kuang Yinhao Zhu Xuanlin Li Shizhong Han H. Cai Fatih Porikli Hao Su 3DPC 108 124 0 18 May 2023
ULIP-2: Towards Scalable Multimodal Pre-training for 3D Understanding Le Xue Ning Yu Shu Zhen Zhang Artemis Panagopoulou Junnan Li ... Jiajun Wu Caiming Xiong Ran Xu Juan Carlos Niebles Silvio Savarese 117 128 0 14 May 2023
InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning Wenliang Dai Junnan Li Dongxu Li A. M. H. Tiong Junqi Zhao Weisheng Wang Boyang Albert Li Pascale Fung Steven C. H. Hoi MLLM VLM 150 2,098 0 11 May 2023
Visual Instruction Tuning Haotian Liu Chunyuan Li Qingyang Wu Yong Jae Lee SyDa VLM MLLM 571 4,925 0 17 Apr 2023
Speck: A Smart event-based Vision Sensor with a low latency 327K Neuron Convolutional Neuronal Network Processing Pipeline Ole Richter Y. Xing M. D. Marchi Carsten Nielsen M. Katsimpris ... SynSense Bio-Inspired Circuits Sadique Sheik T. Demirci Groningen Cognitive Systems 79 60 0 13 Apr 2023
Masked Scene Contrast: A Scalable Framework for Unsupervised 3D Representation Learning Xiaoyang Wu Xin Wen Xihui Liu Hengshuang Zhao 3DPC 169 45 0 24 Mar 2023
CLIP $^2$ : Contrastive Language-Image-Point Pretraining from Real-World Point Cloud Data Yi Zeng Chenhan Jiang Jiageng Mao Jianhua Han Chao Ye Qingqiu Huang Dit-Yan Yeung Zhen Yang Xiaodan Liang Hang Xu 3DPC VLM CLIP 58 73 0 22 Mar 2023
Objaverse: A Universe of Annotated 3D Objects Matt Deitke Dustin Schwenk Jordi Salvador Luca Weihs Oscar Michel Eli VanderBilt Ludwig Schmidt Kiana Ehsani Aniruddha Kembhavi Ali Farhadi 114 972 0 15 Dec 2022
PointCLIP V2: Prompting CLIP and GPT for Powerful 3D Open-world Learning Xiangyang Zhu Renrui Zhang Bowei He Ziyu Guo Ziyao Zeng Zipeng Qin Shanghang Zhang Peng Gao VLM 101 145 0 21 Nov 2022
Online Training Through Time for Spiking Neural Networks Mingqing Xiao Qingyan Meng Zongpeng Zhang D.K. He Zhouchen Lin 90 67 0 09 Oct 2022
Spikformer: When Spiking Neural Network Meets Transformer Zhaokun Zhou Yuesheng Zhu Chao He Yaowei Wang Shuicheng Yan Yonghong Tian Liuliang Yuan 225 261 0 29 Sep 2022
Attention Spiking Neural Networks Man Yao Guangshe Zhao Hengyu Zhang Yifan Hu Lei Deng Yonghong Tian Bo Xu Guoqi Li 96 173 0 28 Sep 2022
PointCLIP: Point Cloud Understanding by CLIP Renrui Zhang Ziyu Guo Wei Zhang Kunchang Li Xupeng Miao Tengjiao Wang Yu Qiao Peng Gao Hongsheng Li VLM 3DPC 262 452 0 04 Dec 2021
Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modeling Xumin Yu Lulu Tang Yongming Rao Tiejun Huang Jie Zhou Jiwen Lu 3DPC 144 685 0 29 Nov 2021
A Free Lunch From ANN: Towards Efficient, Accurate Spiking Neural Networks Calibration Yuhang Li Shi-Wee Deng Xin Dong Ruihao Gong Shi Gu 68 195 0 13 Jun 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 1.0K 29,926 0 26 Feb 2021
Point Transformer Nico Engel Vasileios Belagiannis Klaus C. J. Dietmayer 3DPC 186 2,008 0 02 Nov 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 684 41,563 0 22 Oct 2020
Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Data Mikaela Angelina Uy Quang Pham Binh-Son Hua D. Nguyen Sai-Kit Yeung 3DV 3DPC 131 785 0 13 Aug 2019
4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks Chris Choy JunYoung Gwak Silvio Savarese 3DPC 176 1,796 0 18 Apr 2019
Direct Training for Spiking Neural Networks: Faster, Larger, Better Yujie Wu Lei Deng Guoqi Li Jun Zhu Luping Shi 80 662 0 16 Sep 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 356 10,369 0 10 Jul 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 811 132,725 0 12 Jun 2017
Spatio-Temporal Backpropagation for Training High-performance Spiking Neural Networks Yujie Wu Lei Deng Guoqi Li Jun Zhu Luping Shi 64 1,030 0 08 Jun 2017
Submanifold Sparse Convolutional Networks Benjamin Graham Laurens van der Maaten 79 468 0 05 Jun 2017
ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes Angela Dai Angel X. Chang Manolis Savva Maciej Halber Thomas Funkhouser Matthias Nießner 3DPC 3DV 513 4,088 0 14 Feb 2017
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation C. Qi Hao Su Kaichun Mo Leonidas Guibas 3DH 3DPC 3DV PINN 500 14,384 0 02 Dec 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.3K 194,641 0 10 Dec 2015