LSAS: Lightweight Sub-attention Strategy for Alleviating Attention Bias Problem

9 May 2023

Papers citing "LSAS: Lightweight Sub-attention Strategy for Alleviating Attention Bias Problem"

6 / 6 papers shown

Title
RouterEval: A Comprehensive Benchmark for Routing LLMs to Explore Model-level Scaling Up in LLMs Zhongzhan Huang Guoming Ling Vincent S. Liang Yupei Lin Yandong Chen Shanshan Zhong Hefeng Wu LRM 54 2 0 08 Mar 2025
MoExtend: Tuning New Experts for Modality and Task Extension Shanshan Zhong Shanghua Gao Zhongzhan Huang Wushao Wen Marinka Zitnik Pan Zhou VLM MLLM MoE 61 6 0 07 Aug 2024
Attention-guided Feature Distillation for Semantic Segmentation Amir M. Mansourian Arya Jalali Rozhan Ahmadi S. Kasaei 36 0 0 08 Mar 2024
ASR: Attention-alike Structural Re-parameterization Shan Zhong Zhongzhan Huang Wushao Wen Jinghui Qin Liang Lin 41 6 0 13 Apr 2023
A Generic Shared Attention Mechanism for Various Backbone Neural Networks Zhongzhan Huang Senwei Liang Mingfu Liang Liang Lin 39 6 0 27 Oct 2022
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 298 39,238 0 01 Sep 2014