v1v2v3v4v5 (latest)

Cosine Normalization: Using Cosine Similarity Instead of Dot Product in Neural Networks

20 February 2017

Lei Wang

Papers citing "Cosine Normalization: Using Cosine Similarity Instead of Dot Product in Neural Networks"

50 / 84 papers shown

Title
Enhancing Expressivity of Quantum Neural Networks Based on the SWAP test Sebastian Nagies Emiliano Tolotti D. Pastorello Enrico Blanzieri 28 0 0 20 Jun 2025
Exploring Magnitude Preservation and Rotation Modulation in Diffusion Transformers Eric Tillman Bill Cristian Perez Jensen Sotiris Anagnostidis Dimitri von Rutte DiffM 41 0 0 25 May 2025
GIF: Generative Inspiration for Face Recognition at Scale Saeed Ebrahimi Sahar Rahimi Ali Dabouei Srinjoy Das Jeremy M. Dawson Nasser M. Nasrabadi CVBM 554 0 0 05 May 2025
Inclusive Training Separation and Implicit Knowledge Interaction for Balanced Online Class-Incremental Learning Shunjie Wen Thomas Heinis Dong-Wan Choi CLL 91 0 0 29 Apr 2025
Cottention: Linear Transformers With Cosine Attention Gabriel Mongaras Trevor Dohm Eric C. Larson 78 0 0 27 Sep 2024
Prior-free Balanced Replay: Uncertainty-guided Reservoir Sampling for Long-Tailed Continual Learning Lei Liu Li Liu Yawen Cui CLL 57 0 0 27 Aug 2024
Surpassing Cosine Similarity for Multidimensional Comparisons: Dimension Insensitive Euclidean Metric F. Tessari Neville Hogan Neville Hogan 159 3 0 11 Jul 2024
Dynamic Feature Learning and Matching for Class-Incremental Learning Sunyuan Qiang Yanyan Liang Jun Wan Du Zhang CLL 105 3 0 14 May 2024
A Universal Metric of Dataset Similarity for Cross-silo Federated Learning Ahmed Elhussein Gamze Gursoy FedML OOD 70 2 0 29 Apr 2024
Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length Xuezhe Ma Xiaomeng Yang Wenhan Xiong Beidi Chen Lili Yu Hao Zhang Jonathan May Luke Zettlemoyer Omer Levy Chunting Zhou 90 33 0 12 Apr 2024
Analyzing and Improving the Training Dynamics of Diffusion Models Tero Karras M. Aittala J. Lehtinen Janne Hellsten Timo Aila S. Laine 153 203 0 05 Dec 2023
SARA: Controllable Makeup Transfer with Spatial Alignment and Region-Adaptive Normalization Xiaojing Zhong Xinyi Huang Zhonghua Wu Guosheng Lin Qingyao Wu DiffM 88 2 0 28 Nov 2023
DI-Net : Decomposed Implicit Garment Transfer Network for Digital Clothed 3D Human Xiaojing Zhong Yukun Su Zhonghua Wu Guosheng Lin Qingyao Wu 3DH 52 1 0 28 Nov 2023
Unified Batch Normalization: Identifying and Alleviating the Feature Condensation in Batch Normalization and a Unified Framework Shaobo Wang Xiangdong Zhang Dongrui Liu Junchi Yan 114 0 0 27 Nov 2023
Health Disparities through Generative AI Models: A Comparison Study Using A Domain Specific large language model Yohn Jairo Parra Bautista Vinicious Lima Carlos Theran Richard A. Aló LM&MA 14 4 0 23 Oct 2023
Exploring the Sharpened Cosine Similarity Skyler Wu Fred Lu Edward Raff James Holt 127 2 0 25 Jul 2023
Single Domain Generalization via Normalised Cross-correlation Based Convolutions Weiqin Chuah Ruwan Tennakoon R. Hoseinnezhad David Suter A. Bab-Hadiashar OOD 84 3 0 12 Jul 2023
ESGCN: Edge Squeeze Attention Graph Convolutional Network for Traffic Flow Forecasting Sangrok Lee Ha Young Kim AI4TS 48 0 0 03 Jul 2023
Single-Stage Heavy-Tailed Food Classification Jiangpeng He Fengqing Zhu 117 10 0 01 Jul 2023
Higher-order Graph Attention Network for Stock Selection with Joint Analysis Yang Qiao Yiping Xia Xiang Li Zheng Li Yan Ge AIFin 27 2 0 27 Jun 2023
B-cos Alignment for Inherently Interpretable CNNs and Vision Transformers Moritz D Boehle Navdeeppal Singh Mario Fritz Bernt Schiele 163 27 0 19 Jun 2023
YONA: You Only Need One Adjacent Reference-frame for Accurate and Fast Video Polyp Detection Yuncheng Jiang Zixun Zhang Ruimao Zhang Guanbin Li Shuguang Cui Zerui Li 43 3 0 06 Jun 2023
Cross-Shaped Windows Transformer with Self-supervised Pretraining for Clinically Significant Prostate Cancer Detection in Bi-parametric MRI Yuheng Li Jacob F. Wynne Jing Wang Richard L. J. Qiu J. Roper ... A. Jani Tian Liu P. Patel H. Mao Xiaofeng Yang OOD ViT MedIm 89 11 0 30 Apr 2023
Large-scale Pre-trained Models are Surprisingly Strong in Incremental Novel Class Discovery Mingxuan Liu Subhankar Roy Zhun Zhong N. Sebe Elisa Ricci CLL SSL 86 10 0 28 Mar 2023
Continual Causal Inference with Incremental Observational Data Zhixuan Chu Ruopeng Li S. Rathbun Sheng Li CML 82 15 0 03 Mar 2023
Taylor TD-learning Michele Garibbo Maxime Robeyns Laurence Aitchison OffRL 58 1 0 27 Feb 2023
Task-Aware Information Routing from Common Representation Space in Lifelong Learning Prashant Shivaram Bhat Bahram Zonooz Elahe Arani CLL 36 26 0 14 Feb 2023
Enhancing Few-shot Image Classification with Cosine Transformer Quang-Huy Nguyen Cuong Q. Nguyen Dung D. Le Hieu H. Pham ViT 87 13 0 13 Nov 2022
D3Former: Debiased Dual Distilled Transformer for Incremental Learning Abdel-rahman Mohamed Rushali Grandhe KJ Joseph Salman Khan Fahad Shahbaz Khan CLL 76 9 0 25 Jul 2022
A Hybrid Convolutional Neural Network with Meta Feature Learning for Abnormality Detection in Wireless Capsule Endoscopy Images Samir Jain Ayan Seal A. Ojha MedIm 25 5 0 20 Jul 2022
SHELS: Exclusive Feature Sets for Novelty Detection and Continual Learning Without Class Boundaries Meghna Gummadi Cassandra Kent Jorge Armando Mendez Mendez Eric Eaton CLL 83 11 0 28 Jun 2022
Continual Learning for Visual Search with Backward Consistent Feature Embedding Timmy S. T. Wan Jun-Cheng Chen Tzer-Yi Wu Chu-Song Chen CLL VLM 85 19 0 26 May 2022
B-cos Networks: Alignment is All We Need for Interpretability Moritz D Boehle Mario Fritz Bernt Schiele 112 87 0 20 May 2022
GPS: A Policy-driven Sampling Approach for Graph Representation Learning Tiehua Zhang Yuze Liu Xin Chen Xiaowei Huang Feng Zhu Xi Zheng 62 6 0 29 Dec 2021
FPPN: Future Pseudo-LiDAR Frame Prediction for Autonomous Driving Xudong Huang Chunyu Lin Haojie Liu Lang Nie Yao Zhao 3DPC 145 4 0 08 Dec 2021
Enabling Fast Deep Learning on Tiny Energy-Harvesting IoT Devices Sahidul Islam Jieren Deng Shangli Zhou Chen Pan Caiwen Ding Mimi Xie 63 19 0 28 Nov 2021
Feature Generation for Long-tail Classification Rahul Vigneswaran M. Law V. Balasubramanian Makarand Tapaswi VLM 74 16 0 10 Nov 2021
MNet-Sim: A Multi-layered Semantic Similarity Network to Evaluate Sentence Similarity Manuela Nayantara Jeyaraj D. Kasthurirathna 119 3 0 09 Nov 2021
R4: A Framework for Route Representation and Route Recommendation Ran Cheng Chao Chen Longfei Xu Shen Li Lei Wang Hengbin Cui Kaikui Liu Xiaolong Li AI4TS 52 2 0 20 Oct 2021
A Unified Framework for Generalized Low-Shot Medical Image Segmentation with Scarce Data H. Cui Dong Wei Kai Ma Shi Gu Yefeng Zheng 62 39 0 18 Oct 2021
An EM Framework for Online Incremental Learning of Semantic Segmentation Shipeng Yan Jiale Zhou Jiangwei Xie Songyang Zhang Xuming He CLL 64 41 0 08 Aug 2021
Tackling Catastrophic Forgetting and Background Shift in Continual Semantic Segmentation Arthur Douillard Yifu Chen Arnaud Dapogny Matthieu Cord CLL 61 21 0 29 Jun 2021
Detecting Anomalies in Semantic Segmentation with Prototypes Dario Fontanel Fabio Cermelli Massimiliano Mancini Barbara Caputo UQCV 83 14 0 01 Jun 2021
Class-Balanced Distillation for Long-Tailed Visual Recognition Ahmet Iscen A. Araújo Boqing Gong Cordelia Schmid 128 36 0 12 Apr 2021
Goal-Oriented Gaze Estimation for Zero-Shot Learning Yang Liu Lei Zhou Xiao Bai Yifei Huang Lin Gu Jun Zhou Tatsuya Harada 100 119 0 05 Mar 2021
Essentials for Class Incremental Learning Sudhanshu Mittal Silvio Galesso Thomas Brox CLL 67 98 0 18 Feb 2021
Association: Remind Your GAN not to Forget Yi Gu Jie Li Yuting Gao Ruoxin Chen Chentao Wu Feiyang Cai Chao Wang Zirui Zhang CLL 48 1 0 27 Nov 2020
What do CNN neurons learn: Visualization & Clustering Haoyue Dai SSL 30 0 0 18 Oct 2020
Query-Key Normalization for Transformers Alex Henry Prudhvi Raj Dachapally S. Pawar Yuxuan Chen 59 91 0 08 Oct 2020
Normalization Techniques in Training DNNs: Methodology, Analysis and Application Lei Huang Jie Qin Yi Zhou Fan Zhu Li Liu Ling Shao AI4CE 176 275 0 27 Sep 2020