Efficiently Modeling Long Sequences with Structured State Spaces

31 October 2021

Papers citing "Efficiently Modeling Long Sequences with Structured State Spaces"

50 / 1,145 papers shown

Title
Towards Dynamic Message Passing on Graphs Junshu Sun Chenxue Yang Xiangyang Ji Qingming Huang Shuhui Wang 45 1 0 31 Oct 2024
Advancing Efficient Brain Tumor Multi-Class Classification -- New Insights from the Vision Mamba Model in Transfer Learning Yinyi Lai Anbo Cao Yuan Gao Jiaqi Shang Zongyu Li Jia Guo Mamba 39 1 0 29 Oct 2024
Exploring contextual modeling with linear complexity for point cloud segmentation Yong Xien Chng Xuchong Qiu Yizeng Han Yifan Pu Jiewei Cao Gao Huang Mamba 44 1 0 28 Oct 2024
SepMamba: State-space models for speaker separation using Mamba Thor Højhus Avenstrup Boldizsár Elek István László Mádi András Bence Schin Morten Mørup Bjørn Sand Jensen Kenny Falkær Olsen Mamba 38 0 0 28 Oct 2024
FACTS: A Factored State-Space Framework For World Modelling Li Nanbo Firas Laakom Yucheng Xu Wenyi Wang Jürgen Schmidhuber AI4TS 253 0 0 28 Oct 2024
Wavelet-based Mamba with Fourier Adjustment for Low-light Image Enhancement Junhao Tan Songwen Pei Wei Qin Bo Fu Ximing Li Libo Huang Mamba 38 3 0 27 Oct 2024
Utilizing Image Transforms and Diffusion Models for Generative Modeling of Short and Long Time Series Ilan Naiman Nimrod Berman Itai Pemper Idan Arbiv Gal Fadlon Omri Azencot 37 12 0 25 Oct 2024
Multi-Agent Reinforcement Learning with Selective State-Space Models Jemma Daniel Ruan de Kock Louay Ben Nessir Sasha Abramowitz Omayma Mahjoub Wiem Khlifi Claude Formanek Arnu Pretorius Mamba 41 0 0 25 Oct 2024
Citywide Electric Vehicle Charging Demand Prediction Approach Considering Urban Region and Dynamic Influences Haoxuan Kuang Kunxiang Deng Linlin You Jun Li 35 0 0 24 Oct 2024
Taipan: Efficient and Expressive State Space Language Models with Selective Attention Chien Van Nguyen Huy Huu Nguyen Thang M. Pham Ruiyi Zhang Hanieh Deilamsalehy ... Ryan A. Rossi Trung Bui Viet Dac Lai Franck Dernoncourt Thien Huu Nguyen Mamba RALM 37 1 0 24 Oct 2024
Bio2Token: All-atom tokenization of any biomolecular structure with Mamba Andrew Liu Axel Elaldi Nathan Russell Olivia Viessmann Mamba 68 3 0 24 Oct 2024
SpikMamba: When SNN meets Mamba in Event-based Human Action Recognition Jiaqi Chen Yan Yang Shizhuo Deng Da Teng Liyuan Pan Mamba 39 1 0 22 Oct 2024
LLM-TS Integrator: Integrating LLM for Enhanced Time Series Modeling Can Chen Gabriel Oliveira Hossein Sharifi-Noghabi Tristan Sylvain AI4TS 26 1 0 21 Oct 2024
LMHaze: Intensity-aware Image Dehazing with a Large-scale Multi-intensity Real Haze Dataset Ruikun Zhang Hao Yang Yan Yang Ying Fu Liyuan Pan 48 3 0 21 Oct 2024
TimeMixer++: A General Time Series Pattern Machine for Universal Predictive Analysis Shiyu Wang Jiawei Li Xiaoming Shi Zhou Ye Baichuan Mo Wenze Lin Shengtong Ju Zhixuan Chu Ming Jin AI4TS 51 11 0 21 Oct 2024
Taming Mambas for Voxel Level 3D Medical Image Segmentation Luca Lumetti Vittorio Pipoli Kevin Marchesini Elisa Ficarra C. Grana Federico Bolelli MedIm Mamba 29 0 0 20 Oct 2024
MambaSOD: Dual Mamba-Driven Cross-Modal Fusion Network for RGB-D Salient Object Detection Yue Zhan Zhihong Zeng Haijun Liu Xiaoheng Tan Yinli Tian Mamba 40 4 0 19 Oct 2024
HiPPO-KAN: Efficient KAN Model for Time Series Analysis SangJong Lee Jin-Kwang Kim JunHo Kim TaeHan Kim James Lee AI4TS 33 2 0 19 Oct 2024
Spatial-Mamba: Effective Visual State Space Models via Structure-aware State Fusion Chaodong Xiao Minghan Li Zhengqiang Zhang Deyu Meng Lei Zhang Mamba 72 5 0 19 Oct 2024
Self-supervised contrastive learning performs non-linear system identification Rodrigo González Laiz Tobias Schmidt Steffen Schneider SSL 44 0 0 18 Oct 2024
Variable Aperture Bokeh Rendering via Customized Focal Plane Guidance Kang Chen Shijun Yan Aiwen Jiang Han Li Zhifeng Wang 52 0 0 18 Oct 2024
Rethinking Transformer for Long Contextual Histopathology Whole Slide Image Analysis Honglin Li Yunlong Zhang Pingyi Chen Zhongyi Shui Chenglu Zhu Lin Yang MedIm 62 4 0 18 Oct 2024
DiffImp: Efficient Diffusion Model for Probabilistic Time Series Imputation with Bidirectional Mamba Backbone Hongfan Gao Wangmeng Shen Xiangfei Qiu Ronghui Xu Jilin Hu Bin Yang 35 5 0 17 Oct 2024
Flash Inference: Near Linear Time Inference for Long Convolution Sequence Models and Beyond Costin-Andrei Oncescu Sanket Purandare Stratos Idreos Sham Kakade VLM AI4TS 3DV 31 0 0 16 Oct 2024
UMambaAdj: Advancing GTV Segmentation for Head and Neck Cancer in MRI-Guided RT with UMamba and nnU-Net ResEnc Planner Jintao Ren Kim Hochreuter Jesper Folsted Kallehauge Stine Korreman Mamba 31 1 0 16 Oct 2024
Long-LRM: Long-sequence Large Reconstruction Model for Wide-coverage Gaussian Splats Chen Ziwen Hao Tan Kai Zhang Sai Bi Fujun Luan Yicong Hong Li Fuxin Zexiang Xu 3DGS 3DV 46 16 0 16 Oct 2024
Rethinking Token Reduction for State Space Models Zheng Zhan Yushu Wu Zhenglun Kong Changdi Yang Yifan Gong Xuan Shen Xue Lin Pu Zhao Yanzhi Wang Mamba 45 4 0 16 Oct 2024
Towards Neural Scaling Laws for Time Series Foundation Models Qingren Yao Chao-Han Huck Yang Renhe Jiang Keli Zhang Ming Jin Shirui Pan AI4TS AI4CE 53 8 0 16 Oct 2024
AI-Aided Kalman Filters Nir Shlezinger Guy Revach Anubhab Ghosh S. Chatterjee Shuo Tang Tales Imbiriba J. Duník O. Straka Pau Closas Yonina C. Eldar 82 3 0 16 Oct 2024
Online learning in motion modeling for intra-interventional image sequences N. Gunnarsson Jens Sjölund Peter Kimstrand Thomas B. Schon 30 0 0 15 Oct 2024
UmambaTSF: A U-shaped Multi-Scale Long-Term Time Series Forecasting Method Using Mamba Li Wu Wenbin Pei Jiulong Jiao Qiang Zhang Mamba AI4TS 43 2 0 15 Oct 2024
State-space models can learn in-context by gradient descent Neeraj Mohan Sushma Yudou Tian Harshvardhan Mestha Nicolo Colombo David Kappel Anand Subramoney 53 3 0 15 Oct 2024
Mimetic Initialization Helps State Space Models Learn to Recall Asher Trockman Hrayr Harutyunyan J. Zico Kolter Sanjiv Kumar Srinadh Bhojanapalli Mamba 31 4 0 14 Oct 2024
V2M: Visual 2-Dimensional Mamba for Image Representation Learning Chengkun Wang Wenzhao Zheng Yuanhui Huang Jie Zhou Jiwen Lu Mamba 33 0 0 14 Oct 2024
GlobalMamba: Global Image Serialization for Vision Mamba Chengkun Wang Wenzhao Zheng Jie Zhou Jiwen Lu Mamba 51 0 0 14 Oct 2024
Towards Better Multi-head Attention via Channel-wise Sample Permutation Shen Yuan Hongteng Xu 32 1 0 14 Oct 2024
CleanUMamba: A Compact Mamba Network for Speech Denoising using Channel Pruning Sjoerd Groot Qinyu Chen Jan C. van Gemert Chang Gao Mamba 230 0 0 14 Oct 2024
Lambda-Skip Connections: the architectural component that prevents Rank Collapse Federico Arangath Joseph Jerome Sieber Melanie Zeilinger Carmen Amo Alonso 37 0 0 14 Oct 2024
Improving Generalization on the ProcGen Benchmark with Simple Architectural Changes and Scale Andrew Jesson Yiding Jiang OffRL 34 2 0 13 Oct 2024
Variational Diffusion Posterior Sampling with Midpoint Guidance Badr Moufad Yazid Janati Lisa Bedin Alain Durmus Randal Douc Eric Moulines Jimmy Olsson DiffM 37 2 0 13 Oct 2024
HASN: Hybrid Attention Separable Network for Efficient Image Super-resolution Weifeng Cao Xiaoyan Lei Jun Shi Wanyong Liang Jie Liu Zongfei Bai SupR 39 0 0 13 Oct 2024
Efficiently Scanning and Resampling Spatio-Temporal Tasks with Irregular Observations Bryce Ferenczi Michael G. Burke Tom Drummond 35 0 0 11 Oct 2024
Drama: Mamba-Enabled Model-Based Reinforcement Learning Is Sample and Parameter Efficient Wenlong Wang Ivana Dusparic Yucheng Shi Ke Zhang Vinny Cahill Mamba 248 0 0 11 Oct 2024
Parameter-Efficient Fine-Tuning of State Space Models Kevin Galim Wonjun Kang Yuchen Zeng H. Koo Kangwook Lee 36 4 0 11 Oct 2024
CountMamba: Exploring Multi-directional Selective State-Space Models for Plant Counting Hulingxiao He Yaqi Zhang Jinglin Xu Yuxin Peng Mamba 38 0 0 10 Oct 2024
QuadMamba: Learning Quadtree-based Selective Scan for Visual State Space Model Fei Xie Weijia Zhang Zhongdao Wang Chao Ma Mamba 34 4 0 09 Oct 2024
Toward Physics-guided Time Series Embedding Jiaxi Hu Bowen Zhang Qingsong Wen Fugee Tsung Yuxuan Liang AI4TS AI4CE 39 3 0 09 Oct 2024
Rodimus*: Breaking the Accuracy-Efficiency Trade-Off with Efficient Attentions Zhihao He Hang Yu Zi Gong Shizhan Liu Jia-Nan Li Weiyao Lin VLM 38 1 0 09 Oct 2024
Joint Fine-tuning and Conversion of Pretrained Speech and Language Models towards Linear Complexity Mutian He Philip N. Garner 92 0 0 09 Oct 2024
Stochastic Sparse Sampling: A Framework for Variable-Length Medical Time Series Classification Xavier Mootoo Alan A. Díaz-Montiel Milad Lankarany Hina Tabassum AI4TS 30 0 0 08 Oct 2024