AllSpark: A Multimodal Spatio-Temporal General Intelligence Model with Ten Modalities via Language as a Reference Framework

8 January 2025

Papers citing "AllSpark: A Multimodal Spatio-Temporal General Intelligence Model with Ten Modalities via Language as a Reference Framework"

25 / 25 papers shown

Title
OneLLM: One Framework to Align All Modalities with Language Jiaming Han Kaixiong Gong Yiyuan Zhang Jiaqi Wang Kaipeng Zhang Dahua Lin Yu Qiao Peng Gao Xiangyu Yue MLLM 203 126 0 10 Jan 2025
Rethinking Video ViTs: Sparse Video Tubes for Joint Image and Video Learning A. Piergiovanni Weicheng Kuo A. Angelova ViT 64 57 0 06 Dec 2022
Advancing Plain Vision Transformer Towards Remote Sensing Foundation Model Di Wang Qiming Zhang Yufei Xu Jing Zhang Bo Du Dacheng Tao Lefei Zhang 66 255 0 08 Aug 2022
Flamingo: a Visual Language Model for Few-Shot Learning Jean-Baptiste Alayrac Jeff Donahue Pauline Luc Antoine Miech Iain Barr ... Mikolaj Binkowski Ricardo Barreira Oriol Vinyals Andrew Zisserman Karen Simonyan MLLM VLM 382 3,542 0 29 Apr 2022
Vision Models Are More Robust And Fair When Pretrained On Uncurated Images Without Supervision Priya Goyal Quentin Duval Isaac Seessel Mathilde Caron Ishan Misra Levent Sagun Armand Joulin Piotr Bojanowski VLM SSL 80 111 0 16 Feb 2022
BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Junnan Li Dongxu Li Caiming Xiong Guosheng Lin MLLM BDL VLM CLIP 532 4,360 0 28 Jan 2022
Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modeling Xumin Yu Lulu Tang Yongming Rao Tiejun Huang Jie Zhou Jiwen Lu 3DPC 126 675 0 29 Nov 2021
Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Data Oscar Manas Alexandre Lacoste Xavier Giró-i-Nieto David Vazquez Pau Rodríguez López 69 264 0 30 Mar 2021
ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision Wonjae Kim Bokyung Son Ildoo Kim VLM CLIP 119 1,749 0 05 Feb 2021
ERNIE-Doc: A Retrospective Long-Document Modeling Transformer Siyu Ding Junyuan Shang Shuohuan Wang Yu Sun Hao Tian Hua Wu Haifeng Wang 105 54 0 31 Dec 2020
GraphCodeBERT: Pre-training Code Representations with Data Flow Daya Guo Shuo Ren Shuai Lu Zhangyin Feng Duyu Tang ... Dawn Drain Neel Sundaresan Jian Yin Daxin Jiang M. Zhou 142 1,134 0 17 Sep 2020
Revisiting LSTM Networks for Semi-Supervised Text Classification via Mixed Objective Function Devendra Singh Sachan Manzil Zaheer Ruslan Salakhutdinov 42 132 0 08 Sep 2020
Dynamic Dual-Attentive Aggregation Learning for Visible-Infrared Person Re-Identification Mang Ye Jianbing Shen David J. Crandall Ling Shao Jiebo Luo 72 318 0 18 Jul 2020
Longformer: The Long-Document Transformer Iz Beltagy Matthew E. Peters Arman Cohan RALM VLM 171 4,071 0 10 Apr 2020
CodeBERT: A Pre-Trained Model for Programming and Natural Languages Zhangyin Feng Daya Guo Duyu Tang Nan Duan Xiaocheng Feng ... Linjun Shou Bing Qin Ting Liu Daxin Jiang Ming Zhou 162 2,637 0 19 Feb 2020
Spherical Kernel for Efficient Graph Convolution on 3D Point Clouds Huan Lei Naveed Akhtar Ajmal Mian 3DPC 72 167 0 20 Sep 2019
TabNet: Attentive Interpretable Tabular Learning Sercan O. Arik Tomas Pfister LMTD 188 1,353 0 20 Aug 2019
ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks Jiasen Lu Dhruv Batra Devi Parikh Stefan Lee SSL VLM 229 3,684 0 06 Aug 2019
Unsupervised Data Augmentation for Consistency Training Qizhe Xie Zihang Dai Eduard H. Hovy Minh-Thang Luong Quoc V. Le 135 2,316 0 29 Apr 2019
PointConv: Deep Convolutional Networks on 3D Point Clouds Wenxuan Wu Zhongang Qi Fuxin Li 3DPC 128 1,562 0 17 Nov 2018
DenseFuse: A Fusion Approach to Infrared and Visible Images Hui Li Xiaojun Wu 147 1,266 0 23 Apr 2018
MVSNet: Depth Inference for Unstructured Multi-view Stereo Yao Yao Zixin Luo Shiwei Li Tian Fang Long Quan MDE 3DV 114 1,221 0 07 Apr 2018
EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification P. Helber B. Bischke Andreas Dengel Damian Borth 133 1,820 0 31 Aug 2017
Remote Sensing Image Scene Classification: Benchmark and State of the Art Gong Cheng Junwei Han Xiaoqiang Lu 103 2,255 0 01 Mar 2017
UCF101: A Dataset of 101 Human Actions Classes From Videos in The Wild K. Soomro Amir Zamir M. Shah CLIP VGen 150 6,148 0 03 Dec 2012