Similarity of Neural Network Representations Revisited

1 May 2019

Papers citing "Similarity of Neural Network Representations Revisited"

50 / 835 papers shown

Title
Forward Compatible Training for Large-Scale Embedding Retrieval Systems Vivek Ramanujan Pavan Kumar Anasosalu Vasu Ali Farhadi Oncel Tuzel Hadi Pouransari VLM 32 16 0 06 Dec 2021
The Augmented Image Prior: Distilling 1000 Classes by Extrapolating from a Single Image Yuki M. Asano Aaqib Saeed 43 7 0 01 Dec 2021
Compare Where It Matters: Using Layer-Wise Regularization To Improve Federated Learning on Heterogeneous Data Ha Min Son M. Kim T. Chung FedML 19 9 0 01 Dec 2021
Task2Sim : Towards Effective Pre-training and Transfer from Synthetic Data Samarth Mishra Yikang Shen Cheng Perng Phoo Chun-Fu Chen Leonid Karlinsky Kate Saenko Venkatesh Saligrama Rogerio Feris 26 35 0 30 Nov 2021
Do Invariances in Deep Neural Networks Align with Human Perception? Vedant Nanda Ayan Majumdar Camila Kolling John P. Dickerson Krishna P. Gummadi Bradley C. Love Adrian Weller AAML 11 4 0 29 Nov 2021
Improved Knowledge Distillation via Adversarial Collaboration Zhiqiang Liu Chengkai Huang Yanxia Liu 29 2 0 29 Nov 2021
NomMer: Nominate Synergistic Context in Vision Transformer for Visual Recognition Hao Liu Xinghua Jiang Xin Li Zhimin Bao Deqiang Jiang Bo Ren ViT 32 16 0 25 Nov 2021
Self-Distilled Self-Supervised Representation Learning J. Jang Seonhoon Kim Kiyoon Yoo Chaerin Kong Jang-Hyun Kim Nojun Kwak SSL 28 14 0 25 Nov 2021
Self-slimmed Vision Transformer Zhuofan Zong Kunchang Li Guanglu Song Yali Wang Yu Qiao B. Leng Yu Liu ViT 21 30 0 24 Nov 2021
Understanding the Dynamics of DNNs Using Graph Modularity Yao Lu Wen Yang Yunzhe Zhang Zuohui Chen Jinyin Chen Qi Xuan Zhen Wang Xiaoniu Yang 42 9 0 24 Nov 2021
Self-Supervised Pre-Training for Transformer-Based Person Re-Identification Haowen Luo Pichao Wang Yi Tian Xu Feng Ding Yanxin Zhou Fan Wang Hao Li Rong Jin ViT 37 59 0 23 Nov 2021
Semi-Online Knowledge Distillation Zhiqiang Liu Yanxia Liu Chengkai Huang 19 5 0 23 Nov 2021
On Representation Knowledge Distillation for Graph Neural Networks Chaitanya K. Joshi Fayao Liu Xu Xun Jie Lin Chuan-Sheng Foo 27 54 0 09 Nov 2021
Exploiting a Zoo of Checkpoints for Unseen Tasks Jiaji Huang Qiang Qiu Kenneth Church 27 4 0 05 Nov 2021
When Neural Networks Using Different Sensors Create Similar Features Hugues Moreau A. Vassilev Liming Chen 25 0 0 04 Nov 2021
Meta-Learning to Improve Pre-Training Aniruddh Raghu Jonathan Lorraine Simon Kornblith Matthew B. A. McDermott David Duvenaud 27 30 0 02 Nov 2021
Evaluating deep transfer learning for whole-brain cognitive decoding A. Thomas U. Lindenberger Wojciech Samek K. Müller AI4CE 27 12 0 01 Nov 2021
Context Meta-Reinforcement Learning via Neuromodulation Eseoghene Ben-Iwhiwhu Jeffery Dick Nicholas A. Ketz Praveen K. Pilly Andrea Soltoggio OffRL 40 12 0 30 Oct 2021
On Cross-Layer Alignment for Model Fusion of Heterogeneous Neural Networks Dang Nguyen T. Nguyen Khai Nguyen D.Q. Phung Hung Bui Nhat Ho MoMe 24 9 0 29 Oct 2021
Hyper-Representations: Self-Supervised Representation Learning on Neural Network Weights for Model Characteristic Prediction Konstantin Schurholt Dimche Kostadinov Damian Borth SSL 41 14 0 28 Oct 2021
Intermediate Layers Matter in Momentum Contrastive Self Supervised Learning Aakash Kaku Sahana Upadhya N. Razavian SSL 21 29 0 27 Oct 2021
Generalized Shape Metrics on Neural Representations Alex H. Williams Erin M Kunz Simon Kornblith Scott W. Linderman MedIm 6 93 0 27 Oct 2021
Similarity and Matching of Neural Network Representations Adrián Csiszárik Péter Korösi-Szabó Á. Matszangosz Gergely Papp D. Varga 19 64 0 27 Oct 2021
When to Prune? A Policy towards Early Structural Pruning Maying Shen Pavlo Molchanov Hongxu Yin J. Álvarez VLM 28 53 0 22 Oct 2021
Contextual Gradient Scaling for Few-Shot Learning Sang Hyuk Lee Seunghyun Lee B. Song 14 6 0 20 Oct 2021
Layer-wise Adaptive Model Aggregation for Scalable Federated Learning Sunwoo Lee Tuo Zhang Chaoyang He Salman Avestimehr FedML 6 48 0 19 Oct 2021
Comparing Deep Neural Nets with UMAP Tour Mingwei Li C. Scheidegger FAtt 13 1 0 18 Oct 2021
DECAR: Deep Clustering for learning general-purpose Audio Representations Sreyan Ghosh Sandesh V Katta Ashish Seth S. Umesh SSL 36 12 0 17 Oct 2021
Representational Continuity for Unsupervised Continual Learning Divyam Madaan Jaehong Yoon Yuanchun Li Yunxin Liu Sung Ju Hwang CLL SSL 66 112 0 13 Oct 2021
Trivial or impossible -- dichotomous data difficulty masks model differences (on ImageNet and beyond) Kristof Meding Luca M. Schulze Buschoff Robert Geirhos Felix Wichmann 36 40 0 12 Oct 2021
Universal Paralinguistic Speech Representations Using Self-Supervised Conformers Joel Shor A. Jansen Wei Han Daniel S. Park Yu Zhang SSL AI4TS 43 54 0 09 Oct 2021
Learning Compact Representations of Neural Networks using DiscriminAtive Masking (DAM) Jie Bu Arka Daw M. Maruf Anuj Karpatne 43 5 0 01 Oct 2021
Low Frequency Names Exhibit Bias and Overfitting in Contextualizing Language Models Robert Wolfe Aylin Caliskan 89 51 0 01 Oct 2021
Do Self-Supervised and Supervised Methods Learn Similar Visual Representations? Tom George Grigg Dan Busbridge Jason Ramapuram Russ Webb SSL DRL 27 27 0 01 Oct 2021
MUTEN: Boosting Gradient-Based Adversarial Attacks via Mutant-Based Ensembles Yuejun Guo Qiang Hu Maxime Cordy Michail Papadakis Yves Le Traon AAML 26 2 0 27 Sep 2021
How Familiar Does That Sound? Cross-Lingual Representational Similarity Analysis of Acoustic Word Embeddings Badr M. Abdullah Iuliia Zaitova T. Avgustinova Bernd Möbius Dietrich Klakow 37 10 0 21 Sep 2021
Multilingual Molecular Representation Learning via Contrastive Pre-training Zhihui Guo P. Sharma Andy Martinez Liang Du Robin Abraham 38 29 0 18 Sep 2021
Fine-Tuned Transformers Show Clusters of Similar Representations Across Layers Jason Phang Haokun Liu Samuel R. Bowman 30 25 0 17 Sep 2021
OMPQ: Orthogonal Mixed Precision Quantization Yuexiao Ma Taisong Jin Xiawu Zheng Yan Wang Huixia Li Yongjian Wu Guannan Jiang Wei Zhang Rongrong Ji MQ 19 33 0 16 Sep 2021
Robust fine-tuning of zero-shot models Mitchell Wortsman Gabriel Ilharco Jong Wook Kim Mike Li Simon Kornblith ... Raphael Gontijo-Lopes Hannaneh Hajishirzi Ali Farhadi Hongseok Namkoong Ludwig Schmidt VLM 64 691 0 04 Sep 2021
On robustness of generative representations against catastrophic forgetting Wojciech Masarczyk Kamil Deja Tomasz Trzciñski 6 3 0 04 Sep 2021
Similarity of Sentence Representations in Multilingual LMs: Resolving Conflicting Literature and Case Study of Baltic Languages Maksym Del Mark Fishel 16 4 0 02 Sep 2021
Do Vision Transformers See Like Convolutional Neural Networks? M. Raghu Thomas Unterthiner Simon Kornblith Chiyuan Zhang Alexey Dosovitskiy ViT 67 925 0 19 Aug 2021
An Information Theory-inspired Strategy for Automatic Network Pruning Xiawu Zheng Yuexiao Ma Teng Xi Gang Zhang Errui Ding Yuchao Li Jie Chen Yonghong Tian Rongrong Ji 40 13 0 19 Aug 2021
Multi-granularity for knowledge distillation Baitan Shao Ying Chen 22 3 0 15 Aug 2021
SoK: How Robust is Image Classification Deep Neural Network Watermarking? (Extended Version) Nils Lukas Edward Jiang Xinda Li Florian Kerschbaum AAML 36 87 0 11 Aug 2021
Basis Scaling and Double Pruning for Efficient Inference in Network-Based Transfer Learning Ken C. L. Wong Satyananda Kashyap Mehdi Moradi 27 2 0 06 Aug 2021
Modular Meta-Learning for Power Control via Random Edge Graph Neural Networks I. Nikoloska Osvaldo Simeone 33 22 0 04 Aug 2021
Grounding Representation Similarity with Statistical Testing Frances Ding Jean-Stanislas Denain Jacob Steinhardt 22 30 0 03 Aug 2021
Evo-ViT: Slow-Fast Token Evolution for Dynamic Vision Transformer Yifan Xu Zhijie Zhang Mengdan Zhang Kekai Sheng Ke Li Weiming Dong Liqing Zhang Changsheng Xu Xing Sun ViT 32 202 0 03 Aug 2021