Sequential Modeling Enables Scalable Learning for Large Vision Models

1 December 2023

Yutong Bai

Papers citing "Sequential Modeling Enables Scalable Learning for Large Vision Models"

29 / 129 papers shown

Title
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey Zeyu Han Chao Gao Jinyang Liu Jeff Zhang Sai Qian Zhang 347 410 0 21 Mar 2024
When Do We Not Need Larger Vision Models? Baifeng Shi Ziyang Wu Maolin Mao Xin Wang Trevor Darrell VLM LRM 121 47 0 19 Mar 2024
UniCode: Learning a Unified Codebook for Multimodal Large Language Models Sipeng Zheng Bohan Zhou Yicheng Feng Ye Wang Zongqing Lu VLM MLLM 86 9 0 14 Mar 2024
Multi-modal Auto-regressive Modeling via Visual Words Tianshuo Peng Zuchao Li Lefei Zhang Hai Zhao Ping Wang Bo Du OffRL 59 5 0 12 Mar 2024
Physics-informed generative real-time lens-free imaging Ronald B. Liu Zhe Liu Max G.A. Wolf Krishna P. Purohit Gregor Fritz Yi Feng C. G. Hansen Pierre Bagnaninchi X. C. I. Solvas Yunjie Yang MedIm 106 0 0 12 Mar 2024
ShapeLLM: Universal 3D Object Understanding for Embodied Interaction Zekun Qi Runpei Dong Shaochen Zhang Haoran Geng Chunrui Han Zheng Ge Li Yi Kaisheng Ma 216 63 0 27 Feb 2024
Wisdom of Committee: Distilling from Foundation Model to Specialized Application Model Zichang Liu Qingyun Liu Yuening Li Liang Liu Anshumali Shrivastava Shuchao Bi Lichan Hong Ed H. Chi Zhe Zhao VLM 73 5 0 21 Feb 2024
UnlearnCanvas: Stylized Image Dataset for Enhanced Machine Unlearning Evaluation in Diffusion Models Yihua Zhang Chongyu Fan Yimeng Zhang Yuguang Yao Jinghan Jia ... Gaoyuan Zhang Gaowen Liu Ramana Rao Kompella Xiaoming Liu Sijia Liu DiffM 140 8 0 19 Feb 2024
UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Prediction Yuan Yuan Jingtao Ding J. Feng Depeng Jin Yong Li AI4TS 107 71 0 19 Feb 2024
Vision Superalignment: Weak-to-Strong Generalization for Vision Foundation Models Jianyuan Guo Hanting Chen Chengcheng Wang Kai Han Chang Xu Yunhe Wang VLM 87 23 0 06 Feb 2024
Neural networks for abstraction and reasoning: Towards broad generalization in machines Mikel Bober-Irizar Soumya Banerjee AI4CE LRM NAI 98 10 0 05 Feb 2024
Delving into Multi-modal Multi-task Foundation Models for Road Scene Understanding: From Learning Paradigm Perspectives Sheng Luo Wei Chen Wanxin Tian Rui Liu Luanxuan Hou ... Ling Shao Yi Yang Bojun Gao Qun Li Guobin Wu 141 17 0 05 Feb 2024
A Survey on Transformer Compression Yehui Tang Yunhe Wang Jianyuan Guo Zhijun Tu Kai Han Hailin Hu Dacheng Tao 160 35 0 05 Feb 2024
Position: Graph Foundation Models are Already Here Haitao Mao Zhikai Chen Wenzhuo Tang Jianan Zhao Yao Ma Tong Zhao Neil Shah Mikhail Galkin Jiliang Tang AI4CE 155 44 0 03 Feb 2024
Can MLLMs Perform Text-to-Image In-Context Learning? Yuchen Zeng Wonjun Kang Yicong Chen Hyung Il Koo Kangwook Lee MLLM 100 11 0 02 Feb 2024
Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Models Weijiao Zhang Jindong Han Zhao Xu Hang Ni Hao Liu Hui Xiong Hui Xiong AI4CE 252 18 0 30 Jan 2024
A Survey on Visual Anomaly Detection: Challenge, Approach, and Prospect Yunkang Cao Xiaohao Xu Jiangning Zhang Yuqi Cheng Xiaonan Huang Guansong Pang Nong Sang 145 46 0 29 Jan 2024
OMG-Seg: Is One Model Good Enough For All Segmentation? Xiangtai Li Haobo Yuan Wei Li Henghui Ding Size Wu Wenwei Zhang Yining Li Kai Chen Chen Change Loy VLM MLLM ViT 150 65 0 18 Jan 2024
Scalable Pre-training of Large Autoregressive Image Models Alaaeldin El-Nouby Michal Klein Shuangfei Zhai Miguel Angel Bautista Alexander Toshev Vaishaal Shankar J. Susskind Armand Joulin VLM 107 80 0 16 Jan 2024
PDE Generalization of In-Context Operator Networks: A Study on 1D Scalar Nonlinear Conservation Laws Liu Yang Stanley J. Osher AI4CE 127 21 0 14 Jan 2024
Masked Modeling for Self-supervised Representation Learning on Vision and Beyond Siyuan Li Luyuan Zhang Zedong Wang Di Wu Lirong Wu ... Jun Xia Cheng Tan Yang Liu Baigui Sun Stan Z. Li SSL 123 15 0 31 Dec 2023
Self-supervised Pretraining for Decision Foundation Model: Formulation, Pipeline and Challenges Xiaoqian Liu Jianbin Jiao Junge Zhang OffRL LRM 121 2 0 29 Dec 2023
Prospective Role of Foundation Models in Advancing Autonomous Vehicles Jianhua Wu B. Gao Jincheng Gao Jianhao Yu Hongqing Chu ... Xun Gong Yi Chang H. E. Tseng Hong Chen Jie Chen 103 5 0 08 Dec 2023
Free3D: Consistent Novel View Synthesis without 3D Representation Chuanxia Zheng Andrea Vedaldi 3DV 138 50 0 07 Dec 2023
MoSA: Mixture of Sparse Adapters for Visual Efficient Tuning Qizhe Zhang Bocheng Zou Ruichuan An Jiaming Liu Shanghang Zhang MoE 120 3 0 05 Dec 2023
Hulk: A Universal Knowledge Translator for Human-Centric Tasks Yizhou Wang YiXuan Wu Shixiang Tang Weizhen He Xun Guo ... Lei Bai Rui Zhao Jian Wu Tong He Wanli Ouyang VLM 212 14 0 04 Dec 2023
SPOT: Self-Training with Patch-Order Permutation for Object-Centric Learning with Autoregressive Transformers Ioannis Kakogeorgiou Spyros Gidaris Konstantinos Karantzalos N. Komodakis ViT OCL 135 16 0 01 Dec 2023
SEGIC: Unleashing the Emergent Correspondence for In-Context Segmentation Lingchen Meng Shiyi Lan Hengduo Li Jose M. Alvarez Zuxuan Wu Yu-Gang Jiang VLM ISeg MLLM 79 9 0 24 Nov 2023
Multi-Moments in Time: Learning and Interpreting Models for Multi-Action Video Understanding Mathew Monfort Bowen Pan K. Ramakrishnan A. Andonian Barry A. McNamara A. Lascelles Quanfu Fan Dan Gutfreund Rogerio Feris A. Oliva VLM 155 68 0 01 Nov 2019