Efficient High-Resolution Deep Learning: A Survey

26 July 2022

Arian Bakhtiarnia

Papers citing "Efficient High-Resolution Deep Learning: A Survey"

50 / 105 papers shown

Title
HRScene: How Far Are VLMs from Effective High-Resolution Image Understanding? Yusen Zhang Wenliang Zheng Aashrith Madasu Peng Shi Ryo Kamoi ... Ranran Haoran Zhang Avitej Iyer Renze Lou Wenpeng Yin Rui Zhang 268 0 0 25 Apr 2025
Faster Causal Attention Over Large Sequences Through Sparse Flash Attention Matteo Pagliardini Daniele Paliotta Martin Jaggi Franccois Fleuret LRM 59 25 0 01 Jun 2023
Distributed Deep Learning Inference Acceleration using Seamless Collaboration in Edge Computing Nana Li Alexandros Iosifidis Qi Zhang 20 6 0 22 Jul 2022
Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learning Richard J. Chen Chengkuan Chen Yicong Li Tiffany Y. Chen A. Trister Rahul G. Krishnan Faisal Mahmood ViT MedIm 94 424 0 06 Jun 2022
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness Tri Dao Daniel Y. Fu Stefano Ermon Atri Rudra Christopher Ré VLM 226 2,233 0 27 May 2022
Dynamic Split Computing for Efficient Deep Edge Intelligence Arian Bakhtiarnia Nemanja Milošević Qi Zhang Dragana Bajović Alexandros Iosifidis 50 27 0 23 May 2022
MiniViT: Compressing Vision Transformers with Weight Multiplexing Jinnian Zhang Houwen Peng Kan Wu Mengchen Liu Bin Xiao Jianlong Fu Lu Yuan ViT 70 125 0 14 Apr 2022
Continual Inference: A Library for Efficient Online Inference with Deep Neural Networks in PyTorch Lukas Hedegaard Alexandros Iosifidis BDL 3DV CLL 37 6 0 07 Apr 2022
SALISA: Saliency-based Input Sampling for Efficient Video Object Detection B. Bejnordi A. Habibian Fatih Porikli Amir Ghodrati 67 12 0 05 Apr 2022
Continual Transformers: Redundancy-Free Attention for Online Inference Lukas Hedegaard Arian Bakhtiarnia Alexandros Iosifidis CLL 67 12 0 17 Jan 2022
Multi-Scale High-Resolution Vision Transformer for Semantic Segmentation Jiaqi Gu Hyoukjun Kwon Dilin Wang Wei Ye Meng Li Yu-Hsin Chen Liangzhen Lai Vikas Chandra David Z. Pan ViT 57 187 0 01 Nov 2021
FOVEA: Foveated Image Magnification for Autonomous Navigation Chittesh Thavamani Mengtian Li N. Cebron Deva Ramanan 59 32 0 27 Aug 2021
PonderNet: Learning to Ponder Andrea Banino Jan Balaguer Charles Blundell PINN AIMat 133 81 0 12 Jul 2021
CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows Xiaoyi Dong Jianmin Bao Dongdong Chen Weiming Zhang Nenghai Yu Lu Yuan Dong Chen B. Guo ViT 145 982 0 01 Jul 2021
Looking Outside the Window: Wide-Context Transformer for the Semantic Segmentation of High-Resolution Remote Sensing Images L. Ding Dong Lin Shaofu Lin Jing Zhang Xiaojie Cui Yuebin Wang Hao Tang Lorenzo Bruzzone ViT 61 101 0 29 Jun 2021
Multi-Exit Vision Transformer for Dynamic Inference Arian Bakhtiarnia Qi Zhang Alexandros Iosifidis 88 27 0 29 Jun 2021
HR-NAS: Searching Efficient High-Resolution Neural Architectures with Lightweight Transformers Mingyu Ding Xiaochen Lian Linjie Yang Peng Wang Xiaojie Jin Zhiwu Lu Ping Luo ViT 71 61 0 11 Jun 2021
Glance-and-Gaze Vision Transformer Qihang Yu Yingda Xia Yutong Bai Yongyi Lu Alan Yuille Wei Shen ViT 54 76 0 04 Jun 2021
Continual 3D Convolutional Neural Networks for Real-time Processing of Videos Lukas Hedegaard Alexandros Iosifidis 3DPC 52 14 0 31 May 2021
Can Attention Enable MLPs To Catch Up With CNNs? Meng-Hao Guo Zheng-Ning Liu Tai-Jiang Mu Dun Liang Ralph Robert Martin Shimin Hu AAML 61 17 0 31 May 2021
Single-Layer Vision Transformers for More Accurate Early Exits with Less Overhead Arian Bakhtiarnia Qi Zhang Alexandros Iosifidis 61 35 0 19 May 2021
Improving the Accuracy of Early Exits in Multi-Exit Architectures via Curriculum Learning Arian Bakhtiarnia Qi Zhang Alexandros Iosifidis 85 13 0 21 Apr 2021
Slimmable Compressive Autoencoders for Practical Neural Image Compression Feiyu Yang Luis Herranz Yongmei Cheng M. Mozerov 46 65 0 29 Mar 2021
Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding Pengchuan Zhang Xiyang Dai Jianwei Yang Bin Xiao Lu Yuan Lei Zhang Jianfeng Gao ViT 85 335 0 29 Mar 2021
FAIR1M: A Benchmark Dataset for Fine-grained Object Recognition in High-Resolution Remote Sensing Imagery Xian Sun Peijin Wang Zhiyuan Yan F. Xu Ruiping Wang ... Tao Xu M. Weinmann Stefan Hinz Cheng Wang Kun Fu ObjD AI4TS 58 364 0 09 Mar 2021
Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challenges Yoshitomo Matsubara Marco Levorato Francesco Restuccia 82 207 0 08 Mar 2021
Dynamic Neural Networks: A Survey Yizeng Han Gao Huang Shiji Song Le Yang Honghui Wang Yulin Wang 3DH AI4TS AI4CE 115 649 0 09 Feb 2021
Pruning and Quantization for Deep Neural Network Acceleration: A Survey Tailin Liang C. Glossner Lei Wang Shaobo Shi Xiaotong Zhang MQ 208 697 0 24 Jan 2021
Real-Time High-Resolution Background Matting Shanchuan Lin Andrey Ryabtsev Soumyadip Sengupta Brian L. Curless S. M. Seitz Ira Kemelmacher-Shlizerman 3DH 99 222 0 14 Dec 2020
Single Image Human Proxemics Estimation for Visual Social Distancing Maya Aghaei Matteo Bustreo Yiming Wang Gianluca Bailo Pietro Morerio Alessio Del Bue 88 29 0 03 Nov 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 654 41,103 0 22 Oct 2020
Efficient Transformers: A Survey Yi Tay Mostafa Dehghani Dara Bahri Donald Metzler VLM 154 1,123 0 14 Sep 2020
Knowledge Distillation: A Survey Jianping Gou B. Yu Stephen J. Maybank Dacheng Tao VLM 76 2,960 0 09 Jun 2020
Ambient Sound Helps: Audiovisual Crowd Counting in Extreme Conditions Di Hu Lichao Mou Qingzhong Wang Junyu Gao Yuansheng Hua Dejing Dou Xiaoxiang Zhu 46 31 0 14 May 2020
Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities Gong Cheng Xingxing Xie Junwei Han Lei Guo Guisong Xia VLM 98 635 0 03 May 2020
Why should we add early exits to neural networks? Simone Scardapane M. Scarpiniti E. Baccarelli A. Uncini 62 123 0 27 Apr 2020
A Survey of Single-Scene Video Anomaly Detection B. Ramachandra Michael J. Jones Ranga Raju Vatsavai AI4TS 76 178 0 13 Apr 2020
Longformer: The Long-Document Transformer Iz Beltagy Matthew E. Peters Arman Cohan RALM VLM 171 4,071 0 10 Apr 2020
JHU-CROWD++: Large-Scale Crowd Counting Dataset and A Benchmark Method Vishwanath A. Sindagi R. Yasarla Vishal M. Patel 65 227 0 07 Apr 2020
CNN-based Density Estimation and Crowd Counting: A Survey Guangshuai Gao Junyu Gao Qingjie Liu Qi. Wang Yunhong Wang 67 155 0 28 Mar 2020
PANDA: A Gigapixel-level Human-centric Video Dataset Xueyan Wang Xiya Zhang Yinheng Zhu Yuchen Guo Xiaoyun Yuan ... Zerun Wang Guiguang Ding D. Brady Qionghai Dai Lu Fang VGen 72 81 0 10 Mar 2020
Learning When and Where to Zoom with Deep Reinforcement Learning Burak Uzkent Stefano Ermon 80 69 0 01 Mar 2020
Learning in the Frequency Domain Kai Xu Minghai Qin Fei Sun Yuhao Wang Yen-kuang Chen Fengbo Ren 88 404 0 27 Feb 2020
ZoomCount: A Zooming Mechanism for Crowd Counting in Static Images Usman Sajid Hasan Sajid Hongcheng Wang Guanghui Wang 89 45 0 27 Feb 2020
Decision-Making with Auto-Encoding Variational Bayes Romain Lopez Pierre Boyeau Nir Yosef Michael I. Jordan Jeffrey Regier BDL 396 10,591 0 17 Feb 2020
NWPU-Crowd: A Large-Scale Benchmark for Crowd Counting and Localization Qi. Wang Junyu Gao Wei Lin Xuelong Li 94 390 0 10 Jan 2020
Deep neural network models for computational histopathology: A survey C. Srinidhi Ozan Ciga Anne L. Martel AI4CE 121 580 0 28 Dec 2019
Zoom in to where it matters: a hierarchical graph based model for mammogram analysis Hao Du Jiashi Feng Mengling Feng 139 13 0 16 Dec 2019
Scalability in Perception for Autonomous Driving: Waymo Open Dataset Pei Sun Henrik Kretzschmar Xerxes Dotiwalla Aurelien Chouard Vijaysai Patnaik ... Shuyang Cheng Yu Zhang Jonathon Shlens Zhifeng Chen Dragomir Anguelov 134 2,885 0 10 Dec 2019
Deep Multi-Magnification Networks for Multi-Class Breast Cancer Image Segmentation D. J. Ho D. V. K. Yarlagadda Timothy D’alfonso M. Hanna Anne Grabenstetter Peter Ntiamoah E. Brogi L. Tan Thomas J. Fuchs 52 107 0 29 Oct 2019