Auto-Prox: Training-Free Vision Transformer Architecture Search via
Automatic Proxy Discovery

Auto-Prox: Training-Free Vision Transformer Architecture Search via Automatic Proxy Discovery

14 December 2023

Papers citing "Auto-Prox: Training-Free Vision Transformer Architecture Search via Automatic Proxy Discovery"

10 / 10 papers shown

Title
Vision Transformer Neural Architecture Search for Out-of-Distribution Generalization: Benchmark and Insights Sy-Tuyen Ho Tuan Van Vo Somayeh Ebrahimkhani Ngai-man Cheung 42 0 0 08 Jan 2025
LPZero: Language Model Zero-cost Proxy Search from Zero Peijie Dong Lujun Li Xiang Liu Zhenheng Tang Xuebo Liu Qiang Wang Xiaowen Chu 119 2 0 07 Oct 2024
NoRA: Nested Low-Rank Adaptation for Efficient Fine-Tuning Large Models Cheng Lin Lujun Li Dezhi Li Jie Zou Wei Xue Yike Guo AI4TS 40 4 0 18 Aug 2024
STBLLM: Breaking the 1-Bit Barrier with Structured Binary LLMs Peijie Dong Lujun Li Dayou Du Yuhan Chen Zhenheng Tang ... Wei Xue Wenhan Luo Qi-fei Liu Yi-Ting Guo Xiaowen Chu MQ 47 4 0 03 Aug 2024
Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for Large Language Models Peijie Dong Lujun Li Zhenheng Tang Xiang Liu Xinglin Pan Qiang-qiang Wang Xiaowen Chu 58 23 0 05 Jun 2024
TVT: Training-Free Vision Transformer Search on Tiny Datasets Zimian Wei H. Pan Lujun Li Peijie Dong Zhiliang Tian Xin-Yi Niu Dongsheng Li ViT 39 7 0 24 Nov 2023
NORM: Knowledge Distillation via N-to-One Representation Matching Xiaolong Liu Lujun Li Chao Li Anbang Yao 49 68 0 23 May 2023
EZNAS: Evolving Zero Cost Proxies For Neural Architecture Scoring Yash Akhauri J. P. Muñoz Nilesh Jain Ravi Iyer 46 13 0 15 Sep 2022
Transformer in Transformer Kai Han An Xiao Enhua Wu Jianyuan Guo Chunjing Xu Yunhe Wang ViT 284 1,524 0 27 Feb 2021
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions Wenhai Wang Enze Xie Xiang Li Deng-Ping Fan Kaitao Song Ding Liang Tong Lu Ping Luo Ling Shao ViT 277 3,623 0 24 Feb 2021