ResearchTrend.AI
MLP-Mixer: An all-MLP Architecture for Vision
v1v2v3v4 (latest)

MLP-Mixer: An all-MLP Architecture for Vision

Ilya O. Tolstikhin
N. Houlsby
Alexander Kolesnikov
Lucas Beyer
Xiaohua Zhai
Thomas Unterthiner
Jessica Yung
Andreas Steiner
Daniel Keysers
Jakob Uszkoreit
Mario Lucic
Alexey Dosovitskiy
ArXiv (abs)PDFHTML

Papers citing "MLP-Mixer: An all-MLP Architecture for Vision"

50 / 1,144 papers shown
Title
An Organism Starts with a Single Pix-Cell: A Neural Cellular Diffusion for High-Resolution Image Synthesis
An Organism Starts with a Single Pix-Cell: A Neural Cellular Diffusion for High-Resolution Image Synthesis
Marawan Elbatel
Konstantinos Kamnitsas
Xuelong Li
MedImDiffM
77
0
0
03 Jul 2024
PosMLP-Video: Spatial and Temporal Relative Position Encoding for Efficient Video Recognition
PosMLP-Video: Spatial and Temporal Relative Position Encoding for Efficient Video Recognition
Y. Hao
Diansong Zhou
Zhicai Wang
Chong-Wah Ngo
Meng Wang
ViT
69
5
0
03 Jul 2024
Learning Positional Attention for Sequential Recommendation
Learning Positional Attention for Sequential Recommendation
Fan Luo
Juan Zhang
Shenghui Xu
37
2
0
03 Jul 2024
On the Anatomy of Attention
On the Anatomy of Attention
Nikhil Khatri
Tuomas Laakkonen
Jonathon Liu
Vincent Wang-Ma'scianica
3DV
117
1
0
02 Jul 2024
Rethinking Data Augmentation for Robust LiDAR Semantic Segmentation in Adverse Weather
Rethinking Data Augmentation for Robust LiDAR Semantic Segmentation in Adverse Weather
Junsung Park
Kyungmin Kim
Hyunjung Shim
95
7
0
02 Jul 2024
Sign Gradient Descent-based Neuronal Dynamics: ANN-to-SNN Conversion Beyond ReLU Network
Sign Gradient Descent-based Neuronal Dynamics: ANN-to-SNN Conversion Beyond ReLU Network
Hyunseok Oh
Youngki Lee
107
2
0
01 Jul 2024
WV-Net: A foundation model for SAR WV-mode satellite imagery trained using contrastive self-supervised learning on 10 million images
WV-Net: A foundation model for SAR WV-mode satellite imagery trained using contrastive self-supervised learning on 10 million images
Yannik Glaser
J. Stopa
Linnea M. Wolniewicz
Ralph Foster
Doug Vandemark
A. Mouche
Bertrand Chapron
Peter Sadowski
68
1
0
26 Jun 2024
Efficient Document Ranking with Learnable Late Interactions
Efficient Document Ranking with Learnable Late Interactions
Ziwei Ji
Himanshu Jain
Andreas Veit
Sashank J. Reddi
Sadeep Jayasumana
A. S. Rawat
A. Menon
Felix X. Yu
Sanjiv Kumar
65
1
0
25 Jun 2024
Reducing Fine-Tuning Memory Overhead by Approximate and Memory-Sharing Backpropagation
Reducing Fine-Tuning Memory Overhead by Approximate and Memory-Sharing Backpropagation
Yuchen Yang
Yingdong Shi
Cheems Wang
Xiantong Zhen
Yuxuan Shi
Jun Xu
72
3
0
24 Jun 2024
RepNeXt: A Fast Multi-Scale CNN using Structural Reparameterization
RepNeXt: A Fast Multi-Scale CNN using Structural Reparameterization
Mingshu Zhao
Yi Luo
Yong Ouyang
114
3
0
23 Jun 2024
How to Learn More? Exploring Kolmogorov-Arnold Networks for Hyperspectral Image Classification
How to Learn More? Exploring Kolmogorov-Arnold Networks for Hyperspectral Image Classification
Ali Jamali
Swalpa Kumar Roy
Danfeng Hong
Bing Lu
Pedram Ghamisi
73
29
0
22 Jun 2024
Deciphering the Definition of Adversarial Robustness for post-hoc OOD Detectors
Deciphering the Definition of Adversarial Robustness for post-hoc OOD Detectors
Peter Lorenz
Mario Fernandez
Jens Müller
Ullrich Kothe
AAML
240
1
0
21 Jun 2024
Demonstrating the Efficacy of Kolmogorov-Arnold Networks in Vision Tasks
Demonstrating the Efficacy of Kolmogorov-Arnold Networks in Vision Tasks
Minjong Cheon
90
40
0
21 Jun 2024
Pathformer: Recursive Path Query Encoding for Complex Logical Query Answering
Pathformer: Recursive Path Query Encoding for Complex Logical Query Answering
Chongzhi Zhang
Zhiping Peng
Junhao Zheng
Linghao Wang
Ruifeng Shi
Qianli Ma
75
1
0
21 Jun 2024
Older and Wiser: The Marriage of Device Aging and Intellectual Property Protection of Deep Neural Networks
Older and Wiser: The Marriage of Device Aging and Intellectual Property Protection of Deep Neural Networks
Ning Lin
Shaocong Wang
Yue Zhang
Yangu He
Kwunhang Wong
Arindam Basu
Dashan Shang
Xiaoming Chen
Zhongrui Wang
AAML
41
1
0
21 Jun 2024
Hierarchical Associative Memory, Parallelized MLP-Mixer, and Symmetry Breaking
Hierarchical Associative Memory, Parallelized MLP-Mixer, and Symmetry Breaking
Ryo Karakida
Toshihiro Ota
Masato Taki
83
2
0
18 Jun 2024
A Scalable and Effective Alternative to Graph Transformers
A Scalable and Effective Alternative to Graph Transformers
Kaan Sancak
Zhigang Hua
Jin Fang
Yan Xie
Andrey Malevich
Bo Long
M. F. Balin
Ümit V. Çatalyürek
90
1
0
17 Jun 2024
A Unified View of Abstract Visual Reasoning Problems
A Unified View of Abstract Visual Reasoning Problems
Mikołaj Małkiński
Jacek Mańdziuk
70
0
0
16 Jun 2024
Occam's Razor for Self Supervised Learning: What is Sufficient to Learn Good Representations?
Occam's Razor for Self Supervised Learning: What is Sufficient to Learn Good Representations?
Mark Ibrahim
David Klindt
Randall Balestriero
SSL
122
5
1
15 Jun 2024
WindowMixer: Intra-Window and Inter-Window Modeling for Time Series Forecasting
WindowMixer: Intra-Window and Inter-Window Modeling for Time Series Forecasting
Quangao Liu
Ruiqi Li
Maowei Jiang
Wei Yang
Chen Liang
Longlong Pang
Zhuozhang Zou
AI4TS
62
0
0
14 Jun 2024
Hybrid Spatial-spectral Neural Network for Hyperspectral Image Denoising
Hybrid Spatial-spectral Neural Network for Hyperspectral Image Denoising
Hao Liang
Chengjie
Kun Li
Xin Tian
67
1
0
13 Jun 2024
Transferring Knowledge from Large Foundation Models to Small Downstream Models
Transferring Knowledge from Large Foundation Models to Small Downstream Models
Shikai Qiu
Boran Han
Danielle C. Maddix
Shuai Zhang
Yuyang Wang
Andrew Gordon Wilson
47
4
0
11 Jun 2024
Minimizing Energy Costs in Deep Learning Model Training: The Gaussian Sampling Approach
Minimizing Energy Costs in Deep Learning Model Training: The Gaussian Sampling Approach
Challapalli Phanindra Revanth
Sumohana S. Channappayya
C Krishna Mohan
122
23
0
11 Jun 2024
Compute Better Spent: Replacing Dense Layers with Structured Matrices
Compute Better Spent: Replacing Dense Layers with Structured Matrices
Shikai Qiu
Andres Potapczynski
Marc Finzi
Micah Goldblum
Andrew Gordon Wilson
86
18
0
10 Jun 2024
MakeSinger: A Semi-Supervised Training Method for Data-Efficient Singing Voice Synthesis via Classifier-free Diffusion Guidance
MakeSinger: A Semi-Supervised Training Method for Data-Efficient Singing Voice Synthesis via Classifier-free Diffusion Guidance
Semin Kim
Myeonghun Jeong
Hyeonseung Lee
Minchan Kim
Byoung Jin Choi
Nam Soo Kim
VLMDiffM
106
1
0
10 Jun 2024
Convolution and Attention-Free Mamba-based Cardiac Image Segmentation
Convolution and Attention-Free Mamba-based Cardiac Image Segmentation
Abbas Khan
Muhammad Asad
Martin Benning
C. Roney
Gregory Slabaugh
Mamba
71
3
0
09 Jun 2024
Adapting Physics-Informed Neural Networks to Improve ODE Optimization in Mosquito Population Dynamics
Adapting Physics-Informed Neural Networks to Improve ODE Optimization in Mosquito Population Dynamics
D. V. Cuong
Branislava Lalić
Mina Petrić
Binh Nguyen
M. Roantree
PINNAI4CE
119
0
0
07 Jun 2024
Provably Better Explanations with Optimized Aggregation of Feature Attributions
Provably Better Explanations with Optimized Aggregation of Feature Attributions
Thomas Decker
Ananta R. Bhattarai
Jindong Gu
Volker Tresp
Florian Buettner
77
3
0
07 Jun 2024
FPN-fusion: Enhanced Linear Complexity Time Series Forecasting Model
FPN-fusion: Enhanced Linear Complexity Time Series Forecasting Model
Chu Li
Pingjia Xiao
Q. Yuan
AI4TS
51
0
0
06 Jun 2024
Audio Mamba: Selective State Spaces for Self-Supervised Audio Representations
Audio Mamba: Selective State Spaces for Self-Supervised Audio Representations
Sarthak Yadav
Zheng-Hua Tan
Mamba
81
17
0
04 Jun 2024
CAFO: Feature-Centric Explanation on Time Series Classification
CAFO: Feature-Centric Explanation on Time Series Classification
Jaeho Kim
S. Hahn
Yoontae Hwang
Junghye Lee
Seulki Lee
AI4TS
53
1
0
03 Jun 2024
FuRL: Visual-Language Models as Fuzzy Rewards for Reinforcement Learning
FuRL: Visual-Language Models as Fuzzy Rewards for Reinforcement Learning
Yuwei Fu
Haichao Zhang
Di Wu
Wei Xu
Benoit Boulet
VLM
116
15
0
02 Jun 2024
Correlation-aware Coarse-to-fine MLPs for Deformable Medical Image Registration
Correlation-aware Coarse-to-fine MLPs for Deformable Medical Image Registration
Mingyuan Meng
Da-wei Feng
Lei Bi
Jinman Kim
ViTMedIm
83
20
0
31 May 2024
einspace: Searching for Neural Architectures from Fundamental Operations
einspace: Searching for Neural Architectures from Fundamental Operations
Linus Ericsson
Miguel Espinosa
Chenhongyi Yang
Antreas Antoniou
Amos Storkey
Shay B. Cohen
Jingyu Sun
Elliot J. Crowley
71
1
0
31 May 2024
Scaling White-Box Transformers for Vision
Scaling White-Box Transformers for Vision
Jinrui Yang
Xianhang Li
Druv Pai
Yuyin Zhou
Yi-An Ma
Yaodong Yu
Cihang Xie
ViT
104
9
0
30 May 2024
SIG: Efficient Self-Interpretable Graph Neural Network for Continuous-time Dynamic Graphs
SIG: Efficient Self-Interpretable Graph Neural Network for Continuous-time Dynamic Graphs
Lanting Fang
Yulian Yang
Kai Wang
Shanshan Feng
Kaiyu Feng
Jie Gui
Shuliang Wang
Yew-Soon Ong
102
1
0
29 May 2024
SFANet: Spatial-Frequency Attention Network for Weather Forecasting
SFANet: Spatial-Frequency Attention Network for Weather Forecasting
Jiaze Wang
Hao Chen
Hongcan Xu
Jinpeng Li
Bo-Lan Wang
Kun Shao
Furui Liu
Huaxi Chen
Guangyong Chen
Pheng-Ann Heng
83
0
0
29 May 2024
Aligning in a Compact Space: Contrastive Knowledge Distillation between Heterogeneous Architectures
Aligning in a Compact Space: Contrastive Knowledge Distillation between Heterogeneous Architectures
Hongjun Wu
Li Xiao
Xingkuo Zhang
Yining Miao
103
1
0
28 May 2024
PanoTree: Autonomous Photo-Spot Explorer in Virtual Reality Scenes
PanoTree: Autonomous Photo-Spot Explorer in Virtual Reality Scenes
Tomohiro Hayase
Braun Sacha
Hikari Yanagawa
Itsuki Orito
Yuichi Hiroi
3DPC
68
0
0
27 May 2024
$\text{Di}^2\text{Pose}$: Discrete Diffusion Model for Occluded 3D Human Pose Estimation
Di2Pose\text{Di}^2\text{Pose}: Discrete Diffusion Model for Occluded 3D Human Pose Estimation
Weiquan Wang
Jun Xiao
Chunping Wang
Wei Liu
Zhao Wang
Long Chen
DiffM
100
1
0
27 May 2024
GTA: Generative Trajectory Augmentation with Guidance for Offline Reinforcement Learning
GTA: Generative Trajectory Augmentation with Guidance for Offline Reinforcement Learning
Jaewoo Lee
Sujin Yun
Taeyoung Yun
Jinkyoo Park
102
11
0
27 May 2024
Enhancing Adversarial Transferability Through Neighborhood Conditional Sampling
Enhancing Adversarial Transferability Through Neighborhood Conditional Sampling
Chunlin Qiu
Yiheng Duan
Lingchen Zhao
Qian Wang
AAML
79
3
0
25 May 2024
Lateralization MLP: A Simple Brain-inspired Architecture for Diffusion
Lateralization MLP: A Simple Brain-inspired Architecture for Diffusion
Zizhao Hu
Mohammad Rostami
74
0
0
25 May 2024
Activator: GLU Activation Function as the Core Component of a Vision Transformer
Activator: GLU Activation Function as the Core Component of a Vision Transformer
Abdullah Nazhat Abdullah
Tarkan Aydin
ViT
65
0
0
24 May 2024
Transformer-based Federated Learning for Multi-Label Remote Sensing Image Classification
Transformer-based Federated Learning for Multi-Label Remote Sensing Image Classification
Baris Büyüktas
Kenneth Weitzel
Sebastian Völkers
Felix Zailskas
Begüm Demir
90
6
0
24 May 2024
Repeat-Aware Neighbor Sampling for Dynamic Graph Learning
Repeat-Aware Neighbor Sampling for Dynamic Graph Learning
Tao Zou
Yuhao Mao
Junchen Ye
Bo Du
75
6
0
24 May 2024
TimeMixer: Decomposable Multiscale Mixing for Time Series Forecasting
TimeMixer: Decomposable Multiscale Mixing for Time Series Forecasting
Shiyu Wang
Haixu Wu
Xiaoming Shi
Tengge Hu
Huakun Luo
Lintao Ma
James Y. Zhang
Jun-ping Zhou
AI4TS
132
153
0
23 May 2024
I2I-Mamba: Multi-modal medical image synthesis via selective state space modeling
I2I-Mamba: Multi-modal medical image synthesis via selective state space modeling
Omer F. Atli
Bilal Kabas
Fuat Arslan
Arda C. Demirtas
Mahmut Yurt
Onat Dalmaz
Tolga Çukur
Mamba
134
16
0
22 May 2024
Like Humans to Few-Shot Learning through Knowledge Permeation of Vision and Text
Like Humans to Few-Shot Learning through Knowledge Permeation of Vision and Text
Yuyu Jia
Qing Zhou
Wei Huang
Junyu Gao
Qi. Wang
VLM
78
1
0
21 May 2024
Emphasizing Crucial Features for Efficient Image Restoration
Emphasizing Crucial Features for Efficient Image Restoration
Huiyu Gao
Bowen Ma
Ying Zhang
Jing Yang
Jing Yang
Depeng Dang
62
0
0
19 May 2024