Efficiently Modeling Long Sequences with Structured State Spaces

31 October 2021

Papers citing "Efficiently Modeling Long Sequences with Structured State Spaces"

50 / 1,145 papers shown

Title
NowYouSee Me: Context-Aware Automatic Audio Description Seon-Ho Lee Jue Wang D. Fan Zhikang Zhang Linda Liu Xiang Hao Vimal Bhat Xinyu Li 100 0 0 13 Dec 2024
LinGen: Towards High-Resolution Minute-Length Text-to-Video Generation with Linear Computational Complexity Hongjie Wang Chih-Yao Ma Yen-Cheng Liu Ji Hou Tao Xu ... Peizhao Zhang Tingbo Hou Peter Vajda N. Jha Xiaoliang Dai LMTD DiffM VGen VLM 91 5 0 13 Dec 2024
XYScanNet: A State Space Model for Single Image Deblurring Hanzhou Liu Chengkai Liu Jiacong Xu Peng Jiang Mi Lu Mamba 94 0 0 13 Dec 2024
Selective Visual Prompting in Vision Mamba Yifeng Yao Zichen Liu Zhenyu Cui Yuxin Peng Jiahuan Zhou VLM Mamba 103 1 0 12 Dec 2024
Context Clues: Evaluating Long Context Models for Clinical Prediction Tasks on EHRs Michael Wornow Suhana Bedi Miguel Angel Fuentes Hernandez E. Steinberg Jason Alan Fries Christopher Ré Sanmi Koyejo N. Shah 111 4 0 09 Dec 2024
MDiFF: Exploiting Multimodal Score-based Diffusion Models for New Fashion Product Performance Forecasting Andrea Avogaro Luigi Capogrosso Franco Fummi Marco Cristani DiffM 114 0 0 07 Dec 2024
emg2pose: A Large and Diverse Benchmark for Surface Electromyographic Hand Pose Estimation Sasha Salter Richard Warren Collin Schlager Adrian Spurr Shangchen Han ... Robert Y. Wang Nathan Danielson Josh Merel Eftychios Pnevmatikakis Jesse Marshall 65 2 0 02 Dec 2024
MamKPD: A Simple Mamba Baseline for Real-Time 2D Keypoint Detection Yonghao Dang Liyuan Liu Hui Kang Ping Ye Jianqin Yin Mamba 89 0 0 02 Dec 2024
Decision Transformer vs. Decision Mamba: Analysing the Complexity of Sequential Decision Making in Atari Games Ke Yan 80 0 0 01 Dec 2024
MambaNUT: Nighttime UAV Tracking via Mamba-based Adaptive Curriculum Learning You Wu Xiangyang Yang Xucheng Wang Hengzhou Ye Dan Zeng Shuiwang Li Mamba 98 0 0 01 Dec 2024
HSLiNets: Hyperspectral Image and LiDAR Data Fusion Using Efficient Dual Non-Linear Feature Learning Networks Judy X Yang Jing Wang Chen Hong Sui Zekun Long Jun Zhou 59 0 0 30 Nov 2024
SkelMamba: A State Space Model for Efficient Skeleton Action Recognition of Neurological Disorders N. Martinel Mariano Serrao C. Micheloni 78 1 0 29 Nov 2024
Puzzle: Distillation-Based NAS for Inference-Optimized LLMs Akhiad Bercovich Tomer Ronen Talor Abramovich Nir Ailon Nave Assaf ... Ido Shahaf Oren Tropp Omer Ullman Argov Ran Zilberstein Ran El-Yaniv 91 1 0 28 Nov 2024
RS-vHeat: Heat Conduction Guided Efficient Remote Sensing Foundation Model Huiyang Hu Peijin Wang Hanbo Bi Boyuan Tong Zehua Wang ... Ziqi Zhang QiXiang Ye Kun Fu Xian Sun Xian Sun 108 0 0 27 Nov 2024
TinyViM: Frequency Decoupling for Tiny Hybrid Vision Mamba Xiaowen Ma Zhenliang Ni Xinghao Chen Mamba 93 2 0 26 Nov 2024
On the Efficiency of NLP-Inspired Methods for Tabular Deep Learning Anton Thielmann Soheila Samiee LMTD 81 1 0 26 Nov 2024
MobileMamba: Lightweight Multi-Receptive Visual Mamba Network Haoyang He Jingyang Zhang Yuxuan Cai Hongxu Chen Xiaobin Hu Zhenye Gan Yuran Wang Chengjie Wang Yunsheng Wu Lei Xie Mamba 96 3 0 24 Nov 2024
State-Space Large Audio Language Models Saurabhchand Bhati Yuan Gong Leonid Karlinsky Hilde Kuehne Rogerio Feris James Glass 104 0 0 24 Nov 2024
Best of Both Worlds: Advantages of Hybrid Graph Sequence Models Ali Behrouz Ali Parviz Mahdi Karami Clayton Sanford Bryan Perozzi Vahab Mirrokni 89 2 0 23 Nov 2024
$Applications of fractional calculus in learned optimization$ Applications of fractional calculus in learned optimization Teodor Alexandru Szente James Harrison M. Zanfir C. Sminchisescu 78 0 0 22 Nov 2024
Fast convolution algorithm for state space models Gregory Beylkin 87 1 0 22 Nov 2024
EfficientViM: Efficient Vision Mamba with Hidden State Mixer based State Space Duality Sanghyeok Lee Joonmyung Choi Hyunwoo J. Kim 118 3 0 22 Nov 2024
Parameter Efficient Mamba Tuning via Projector-targeted Diagonal-centric Linear Transformation Seokil Ham H. Kim Sangmin Woo Changick Kim Mamba 294 0 0 21 Nov 2024
Hymba: A Hybrid-head Architecture for Small Language Models Xin Dong Y. Fu Shizhe Diao Wonmin Byeon Zijia Chen ... Min-Hung Chen Yoshi Suhara Y. Lin Jan Kautz Pavlo Molchanov Mamba 107 21 0 20 Nov 2024
Unlocking State-Tracking in Linear RNNs Through Negative Eigenvalues Riccardo Grazzi Julien N. Siems Jörg Franke Arber Zela Frank Hutter Massimiliano Pontil 99 11 0 19 Nov 2024
Bi-Mamba: Towards Accurate 1-Bit State Space Models Shengkun Tang Liqun Ma Haoyang Li Mingjie Sun Zhiqiang Shen Mamba 81 3 0 18 Nov 2024
RAWMamba: Unified sRGB-to-RAW De-rendering With State Space Model Hongjun Chen Wencheng Han Huan Zheng Jianbing Shen Mamba 89 0 0 18 Nov 2024
MetaLA: Unified Optimal Linear Approximation to Softmax Attention Map Yuhong Chou Man Yao Kexin Wang Yuqi Pan Ruijie Zhu Yiran Zhong Yu Qiao Jian Wu Bo Xu Guoqi Li 54 4 0 16 Nov 2024
Deep Loss Convexification for Learning Iterative Models Ziming Zhang Yuping Shao Yiqing Zhang Fangzhou Lin Haichong K. Zhang Elke Rundensteiner 3DPC 46 0 0 16 Nov 2024
XLSR-Mamba: A Dual-Column Bidirectional State Space Model for Spoofing Attack Detection Yang Xiao Rohan Kumar Das Mamba 42 3 0 15 Nov 2024
Multimodal Instruction Tuning with Hybrid State Space Models Jianing Zhou Han Li Shuai Zhang Ning Xie Ruijie Wang Xiaohan Nie Sheng Liu Lingyun Wang 46 0 0 13 Nov 2024
Mamba-based Decoder-Only Approach with Bidirectional Speech Modeling for Speech Recognition Yoshiki Masuyama Koichi Miyazaki Masato Murata Mamba 48 0 0 11 Nov 2024
LFSamba: Marry SAM with Mamba for Light Field Salient Object Detection Zhengyi Liu Longzhen Wang Xianyong Fang Zhengzheng Tu Linbo Wang Mamba 45 2 0 11 Nov 2024
SEM-Net: Efficient Pixel Modelling for image inpainting with Spatially Enhanced SSM Shuang Chen Haozheng Zhang Amir Atapour-Abarghouei Hubert P. H. Shum 41 0 0 10 Nov 2024
Bio-xLSTM: Generative modeling, representation and in-context learning of biological and chemical sequences Niklas Schmidinger Lisa Schneckenreiter Philipp Seidl Johannes Schimunek Pieter-Jan Hoedt Johannes Brandstetter Andreas Mayr Sohvi Luukkonen Sepp Hochreiter Günter Klambauer MedIm 78 4 0 06 Nov 2024
Multivariate Data Augmentation for Predictive Maintenance using Diffusion Andrew Thompson Alexander Sommers Alicia Russell-Gilbert Logan Cummins Sudip Mittal Shahram Rahimi Maria Seale Joseph Jaboure Thomas Arnold Joshua Church DiffM 47 0 0 06 Nov 2024
DiMSUM: Diffusion Mamba -- A Scalable and Unified Spatial-Frequency Method for Image Generation Hao Phung Quan Dao T. Dao Hoang Phan Dimitris Metaxas Anh Tran Mamba 70 4 0 06 Nov 2024
MambaPEFT: Exploring Parameter-Efficient Fine-Tuning for Mamba Masakazu Yoshimura Teruaki Hayashi Yota Maeda Mamba 100 2 0 06 Nov 2024
A Mamba Foundation Model for Time Series Forecasting Haoyu Ma Yushu Chen Wenlai Zhao Jinzhe Yang Yingsheng Ji Xinghua Xu Xiaozhu Liu Hao Jing Shengzhuo Liu Guangwen Yang AI4TS Mamba 55 2 0 05 Nov 2024
Layer-Adaptive State Pruning for Deep State Space Models Minseon Gwak Seongrok Moon Joohwan Ko PooGyeon Park 30 0 0 05 Nov 2024
The Evolution of RWKV: Advancements in Efficient Language Modeling Akul Datta VLM 50 1 0 05 Nov 2024
ShadowMamba: State-Space Model with Boundary-Region Selective Scan for Shadow Removal Xiujin Zhu Chee-Onn Chow Joon Huang Chuah Mamba 50 0 0 05 Nov 2024
Modulating State Space Model with SlowFast Framework for Compute-Efficient Ultra Low-Latency Speech Enhancement Longbiao Cheng Ashutosh Pandey Buye Xu T. Delbruck V. Ithapu Shih-Chii Liu 50 0 0 04 Nov 2024
N-Gram Induction Heads for In-Context RL: Improving Stability and Reducing Data Needs Ilya Zisman Alexander Nikulin Andrei Polubarov Nikita Lyubaykin Vladislav Kurenkov Andrei Polubarov Igor Kiselev Vladislav Kurenkov OffRL 61 2 0 04 Nov 2024
Optical Flow Representation Alignment Mamba Diffusion Model for Medical Video Generation Zhenbin Wang Lei Zhang Lituan Wang Minjuan Zhu Zhenwei Zhang VGen MedIm 67 1 0 03 Nov 2024
MambaReg: Mamba-Based Disentangled Convolutional Sparse Coding for Unsupervised Deformable Multi-Modal Image Registration Kaiang Wen Bin Xie Bin Duan Yan Yan Mamba 26 0 0 03 Nov 2024
Provable Length Generalization in Sequence Prediction via Spectral Filtering Annie Marsden Evan Dogariu Naman Agarwal Xinyi Chen Daniel Suo Elad Hazan 49 1 0 01 Nov 2024
SambaMixer: State of Health Prediction of Li-ion Batteries using Mamba State Space Models José Ignacio Olalde-Verano Sascha Kirch Clara Pérez-Molina Sergio Martin Mamba 37 0 0 31 Oct 2024
NIMBA: Towards Robust and Principled Processing of Point Clouds With SSMs Nursena Köprücü Destiny Okpekpe Antonio Orvieto Mamba 48 1 0 31 Oct 2024
Video Token Merging for Long-form Video Understanding Seon-Ho Lee Jue Wang Zhikang Zhang D. Fan Xinyu Li 48 5 0 31 Oct 2024