v1v2v3 (latest)

Improving Vision Transformers by Revisiting High-frequency Components

3 April 2022

ArXiv (abs)PDF HTML Github (50★)

Papers citing "Improving Vision Transformers by Revisiting High-frequency Components"

50 / 59 papers shown

Title
NeuGen: Amplifying the Ñeural' in Neural Radiance Fields for Domain Generalization Ahmed Qazi Abdul Basit Asim Iqbal AI4CE 70 0 0 11 May 2025
DG-DETR: Toward Domain Generalized Detection Transformer Seongmin Hwang Daeyoung Han Moongu Jeon ViT 107 0 0 28 Apr 2025
Mamba-Sea: A Mamba-based Framework with Global-to-Local Sequence Augmentation for Generalizable Medical Image Segmentation Zihan Cheng Jintao Guo Junxuan Zhang Lei Qi Luping Zhou Yinghuan Shi Yang Gao Mamba 108 1 0 24 Apr 2025
Frequency-Compensated Network for Daily Arctic Sea Ice Concentration Prediction Jialiang Zhang Feng Gao Yanhai Gan Junyu Dong Q. Du 50 0 0 23 Apr 2025
Spectral-Adaptive Modulation Networks for Visual Perception Guhnoo Yun J. Yoo Kijung Kim Jeongho Lee Paul Hongsuck Seo Dong Hwan Kim 129 0 0 31 Mar 2025
WaveFormer: A 3D Transformer with Wavelet-Driven Feature Representation for Efficient Medical Image Segmentation Md. Mahfuz Al Hasan Mahdi Zaman Abdul Jawad Alberto Santamaria-Pang Ho Hin Lee ... Md Shah Imran Antika Roy Y. P. Fallah Navid Asadizanjani Reza Forghani MedIm 71 0 0 31 Mar 2025
GmNet: Revisiting Gating Mechanisms From A Frequency View Yifan Wang Xu Ma Yitian Zhang Zhongruo Wang Sung-Cheol Kim Vahid Mirjalili Vidya Renganathan Y. Fu 87 0 0 28 Mar 2025
Exposure Bias Reduction for Enhancing Diffusion Transformer Feature Caching Zhen Zou Hu Yu Jie Xiao Feng Zhao 103 0 0 10 Mar 2025
ViFOR: A Fourier-Enhanced Vision Transformer for Multi-Image Super-Resolution in Earth System Ehsan Zeraatkar Salah A Faroughi Jelena Tešić 79 0 0 18 Feb 2025
ViSIR: Vision Transformer Single Image Reconstruction Method for Earth System Models Ehsan Zeraatkar Salah A Faroughi Jelena Tešić 245 0 0 10 Feb 2025
Vision Transformer Neural Architecture Search for Out-of-Distribution Generalization: Benchmark and Insights Sy-Tuyen Ho Tuan Van Vo Somayeh Ebrahimkhani Ngai-Man Cheung 90 0 0 08 Jan 2025
START: A Generalized State Space Model with Saliency-Driven Token-Aware Transformation Jintao Guo Lei Qi Yinghuan Shi Yang Gao 100 2 0 08 Jan 2025
Enhancing Parameter-Efficient Fine-Tuning of Vision Transformers through Frequency-Based Adaptation S. Ly Hien Nguyen 131 1 0 28 Nov 2024
Content-Aware Preserving Image Generation Giang H. Le Anh Q. Nguyen Byeongkeun Kang Yeejin Lee DiffM 138 0 0 15 Nov 2024
All-in-one Weather-degraded Image Restoration via Adaptive Degradation-aware Self-prompting Model Yuanbo Wen Tao Gao Ziqi Li Jing Zhang Kaihao Zhang Ting Chen VLM DiffM 108 1 0 12 Nov 2024
Down-Sampling Inter-Layer Adapter for Parameter and Computation Efficient Ultra-Fine-Grained Image Recognition Edwin Arkel Rios Femiloye Oyerinde Min-Chun Hu Bo-Cheng Lai 79 0 0 17 Sep 2024
Generalization Boosted Adapter for Open-Vocabulary Segmentation Wenhao Xu Changwei Wang Xuxiang Feng Rongtao Xu Longzhao Huang Zherui Zhang Li Guo Shibiao Xu VLM 104 3 0 13 Sep 2024
Exploring the Adversarial Robustness of CLIP for AI-generated Image Detection Vincenzo De Rosa Fabrizio Guillaro Giovanni Poggi D. Cozzolino L. Verdoliva AAML 108 9 0 28 Jul 2024
Improving Representation of High-frequency Components for Medical Visual Foundation Models Yuetan Chu Yilan Zhang Zhongyi Han Changchun Yang Longxi Zhou Gongning Luo Chao Huang Xin Gao MedIm 154 1 0 19 Jul 2024
Adaptive Parametric Activation Konstantinos Panagiotis Alexandridis Jiankang Deng Anh Nguyen Shan Luo 89 5 0 11 Jul 2024
Parameter-Efficient and Memory-Efficient Tuning for Vision Transformer: A Disentangled Approach Taolin Zhang Jiawang Bai Zhihe Lu Dongze Lian Genping Wang Xinchao Wang Shu-Tao Xia 97 5 0 09 Jul 2024
Mitigating Low-Frequency Bias: Feature Recalibration and Frequency Attention Regularization for Adversarial Robustness Kejia Zhang Juanjuan Weng Yuanzheng Cai Shaozi Li Shaozi Li AAML 189 0 0 04 Jul 2024
Adapting Pretrained ViTs with Convolution Injector for Visuo-Motor Control Dongyoon Hwang ByungKun Lee Hojoon Lee Hyunseung Kim Jaegul Choo 120 0 0 10 Jun 2024
Not All Prompts Are Secure: A Switchable Backdoor Attack Against Pre-trained Vision Transformers Shengyuan Yang Jiawang Bai Kuofeng Gao Yong-Liang Yang Yiming Li Shu-Tao Xia AAML SILM 119 5 0 17 May 2024
MLP Can Be A Good Transformer Learner Sihao Lin Pumeng Lyu Dongrui Liu Tao Tang Xiaodan Liang Andy Song Xiaojun Chang ViT 110 12 0 08 Apr 2024
SETA: Semantic-Aware Token Augmentation for Domain Generalization Jintao Guo Lei Qi Yinghuan Shi Yang Gao ViT 103 4 0 18 Mar 2024
Navigating Beyond Dropout: An Intriguing Solution Towards Generalizable Image Super Resolution Hongjun Wang Jiyuan Chen Yinqiang Zheng Tieyong Zeng OOD 88 2 0 29 Feb 2024
Dual-Path Coupled Image Deraining Network via Spatial-Frequency Interaction Yuhong He Aiwen Jiang Lingfang Jiang Zhifeng Wang Lu Wang 68 3 0 07 Feb 2024
Inducing High Energy-Latency of Large Vision-Language Models with Verbose Images Kuofeng Gao Yang Bai Jindong Gu Shu-Tao Xia Philip Torr Zhifeng Li Wei Liu VLM 98 47 0 20 Jan 2024
Learning Generalizable Models via Disentangling Spurious and Enhancing Potential Correlations Na Wang Lei Qi Jintao Guo Yinghuan Shi Yang Gao OOD 98 4 0 11 Jan 2024
Setting the Record Straight on Transformer Oversmoothing G. Dovonon M. Bronstein Matt J. Kusner 88 6 0 09 Jan 2024
Towards Robust Semantic Segmentation against Patch-based Attack via Attention Refinement Zheng Yuan Jie Zhang Yude Wang Shiguang Shan Xilin Chen AAML 140 1 0 03 Jan 2024
Universal Pyramid Adversarial Training for Improved ViT Performance Ping Yeh-Chiang Yipin Zhou Omid Poursaeed S. Narayan Shukla Tom Goldstein Ser-Nam Lim AAML ViT 51 0 0 26 Dec 2023
Graph Convolutions Enrich the Self-Attention in Transformers! Jeongwhan Choi Hyowon Wi Jayoung Kim Yehjin Shin Kookjin Lee Nathaniel Trask Noseong Park 120 5 0 07 Dec 2023
BadCLIP: Trigger-Aware Prompt Learning for Backdoor Attacks on CLIP Jiawang Bai Kuofeng Gao Shaobo Min Shu-Tao Xia Zhifeng Li Wei Liu VLM 124 45 0 26 Nov 2023
Laplacian-Former: Overcoming the Limitations of Vision Transformers in Local Texture Detection Reza Azad Amirhossein Kazerouni Babak Azad Ehsan Khodapanah Aghdam Yury Velichko Ulas Bagci Dorit Merhof ViT MedIm 106 18 0 31 Aug 2023
Illumination Distillation Framework for Nighttime Person Re-Identification and A New Benchmark Andong Lu Zhang Zhang Yan Huang Yifan Zhang Chenglong Li Jin Tang Liang Wang 68 13 0 31 Aug 2023
SPANet: Frequency-balancing Token Mixer using Spectral Pooling Aggregation Modulation Guhnoo Yun J. Yoo Kijung Kim Jeongho Lee Dong Hwan Kim MoE 70 9 0 22 Aug 2023
Improving Adversarial Robustness of Masked Autoencoders via Test-time Frequency-domain Prompting Qidong Huang Xiaoyi Dong DongDong Chen Yinpeng Chen Lu Yuan Gang Hua Weiming Zhang Neng H. Yu AAML 116 9 0 20 Aug 2023
Revisiting Vision Transformer from the View of Path Ensemble Shuning Chang Pichao Wang Haowen Luo Fan Wang Mike Zheng Shou ViT 66 3 0 12 Aug 2023
Multiscale Memory Comparator Transformer for Few-Shot Video Segmentation Mennatullah Siam R. Karim Henghui Zhao Richard P. Wildes VOS 70 2 0 15 Jul 2023
FoPro-KD: Fourier Prompted Effective Knowledge Distillation for Long-Tailed Medical Image Recognition Marawan Elbatel Robert Martí Xuelong Li AAML 118 11 0 27 May 2023
Tied-Augment: Controlling Representation Similarity Improves Data Augmentation Emirhan Kurtuluş Zichao Li Yann N. Dauphin E. D. Cubuk 77 3 0 22 May 2023
ScatterFormer: Locally-Invariant Scattering Transformer for Patient-Independent Multispectral Detection of Epileptiform Discharges Rui-Hua Zheng Jun Yu Li Yi Wang Tian Luo Yuguo Yu MedIm 81 5 0 26 Apr 2023
Img2Vec: A Teacher of High Token-Diversity Helps Masked AutoEncoders Heng Pan Chenyang Liu Wenxiao Wang Liejie Yuan Hongfa Wang Zhifeng Li Wen Liu VLM 66 3 0 25 Apr 2023
Towards an Effective and Efficient Transformer for Rain-by-snow Weather Removal Tao Gao Yuanbo Wen Kaihao Zhang Peng Cheng Ting Chen ViT 99 5 0 06 Apr 2023
Backdoor Defense via Adaptively Splitting Poisoned Dataset Kuofeng Gao Yang Bai Jindong Gu Yong-Liang Yang Shutao Xia AAML 91 53 0 23 Mar 2023
Reliable and Efficient Evaluation of Adversarial Robustness for Deep Hashing-Based Retrieval Xunguang Wang Jiawang Bai Xin-Chao Xu Xuelong Li AAML 70 1 0 22 Mar 2023
ALOFT: A Lightweight MLP-like Architecture with Dynamic Low-frequency Transform for Domain Generalization Jintao Guo Na Wang Lei Qi Yinghuan Shi 109 38 0 21 Mar 2023
Efficiency 360: Efficient Vision Transformers Badri N. Patro Vijay Srinivas Agneeswaran 168 6 0 16 Feb 2023