Hadamard product in deep learning: Introduction, Advances and Challenges

17 April 2025

Papers citing "Hadamard product in deep learning: Introduction, Advances and Challenges"

50 / 67 papers shown

Title
Towards Interpretability Without Sacrifice: Faithful Dense Layer Decomposition with Mixture of Decoders James Oldfield Shawn Im Yixuan Li M. Nicolaou Ioannis Patras Grigorios G. Chrysos MoE 28 0 0 27 May 2025
Hadamax Encoding: Elevating Performance in Model-Free Atari Jacob E. Kooi Zhao Yang Vincent François-Lavet 39 1 0 21 May 2025
VideoDistill: Language-aware Vision Distillation for Video Question Answering Bo Zou Chao Yang Yu Qiao Chengbin Quan Youjian Zhao VGen 60 1 0 01 Apr 2024
Rewrite the Stars Xu Ma Xiyang Dai Yue Bai Yizhou Wang Yun Fu 55 102 0 29 Mar 2024
LayoutFlow: Flow Matching for Layout Generation Julian Jorge Andrade Guerreiro Naoto Inoue Kento Masui Mayu Otani Hideki Nakayama DiffM 53 7 0 27 Mar 2024
Vision-RWKV: Efficient and Scalable Visual Perception with RWKV-Like Architectures Yuchen Duan Weiyun Wang Zhe Chen Xizhou Zhu Lewei Lu Tong Lu Yu Qiao Hongsheng Li Jifeng Dai Wenhai Wang ViT 52 44 0 04 Mar 2024
Point Transformer V2: Grouped Vector Attention and Partition-based Pooling Xiaoyang Wu Yixing Lao Li Jiang Xihui Liu Hengshuang Zhao 3DPC ViT 83 375 0 11 Oct 2022
Extrapolation and Spectral Bias of Neural Nets with Hadamard Product: a Polynomial Net Study Yongtao Wu Zhenyu Zhu Fanghui Liu Grigorios G. Chrysos Volkan Cevher 39 10 0 16 Sep 2022
Branchformer: Parallel MLP-Attention Architectures to Capture Local and Global Context for Speech Recognition and Understanding Yifan Peng Siddharth Dalmia Ian Lane Shinji Watanabe 56 145 0 06 Jul 2022
A Multi-modal Fusion Framework Based on Multi-task Correlation Learning for Cancer Prognosis Prediction Kaiwen Tan Weixian Huang Xiaofeng Liu Jinlong Hu Shoubin Dong 26 42 0 22 Jan 2022
BACON: Band-limited Coordinate Networks for Multiscale Scene Representation David B. Lindell Dave Van Veen Jeong Joon Park Gordon Wetzstein 48 148 0 09 Dec 2021
Primer: Searching for Efficient Transformers for Language Modeling David R. So Wojciech Mañke Hanxiao Liu Zihang Dai Noam M. Shazeer Quoc V. Le VLM 188 154 0 17 Sep 2021
Fastformer: Additive Attention Can Be All You Need Chuhan Wu Fangzhao Wu Tao Qi Yongfeng Huang Xing Xie 55 119 0 20 Aug 2021
FedPara: Low-Rank Hadamard Product for Communication-Efficient Federated Learning Nam Hyeon-Woo Moon Ye-Bin Tae-Hyun Oh FedML 38 119 0 13 Aug 2021
Tensor Methods in Computer Vision and Deep Learning Yannis Panagakis Jean Kossaifi Grigorios G. Chrysos James Oldfield M. Nicolaou Anima Anandkumar Stefanos Zafeiriou 38 121 0 07 Jul 2021
Variational Relational Point Completion Network Liang Pan Xinyi Chen Zhongang Cai Junzhe Zhang Haiyu Zhao Shuai Yi Ziwei Liu 3DPC 225 177 0 20 Apr 2021
Beta-CROWN: Efficient Bound Propagation with Per-neuron Split Constraints for Complete and Incomplete Neural Network Robustness Verification Shiqi Wang Huan Zhang Kaidi Xu Xue Lin Suman Jana Cho-Jui Hsieh Zico Kolter 61 189 0 11 Mar 2021
A Survey on Visual Transformer Kai Han Yunhe Wang Hanting Chen Xinghao Chen Jianyuan Guo ... Chunjing Xu Yixing Xu Zhaohui Yang Yiman Zhang Dacheng Tao ViT 95 2,174 0 23 Dec 2020
Linguistic Structure Guided Context Modeling for Referring Image Segmentation Tianrui Hui Si Liu Shaofei Huang Guanbin Li Sansi Yu Faxi Zhang Jizhong Han 55 150 0 01 Oct 2020
Deep Polynomial Neural Networks Grigorios G. Chrysos Stylianos Moschoglou Giorgos Bouritsas Jiankang Deng Yannis Panagakis Stefanos Zafeiriou 45 92 0 20 Jun 2020
Convolutional Generation of Textured 3D Meshes Dario Pavllo Graham Spinks Thomas Hofmann Marie-Francine Moens Aurelien Lucchi 43 62 0 13 Jun 2020
Contextual Residual Aggregation for Ultra High-Resolution Image Inpainting Zili Yi Qiang Tang Shekoofeh Azizi Daesik Jang Zhan Xu 35 305 0 19 May 2020
Deep Spatial Gradient and Temporal Depth Learning for Face Anti-spoofing Zezheng Wang Zitong Yu Chenxu Zhao Xiangyu Zhu Yunxiao Qin Qiusheng Zhou Feng Zhou Zhen Lei CVBM 60 172 0 18 Mar 2020
Semi-Supervised StyleGAN for Disentanglement Learning Weili Nie Tero Karras Animesh Garg Shoubhik Debhath Anjul Patney Ankit B. Patel Anima Anandkumar DRL 109 72 0 06 Mar 2020
Fine-grained Video-Text Retrieval with Hierarchical Graph Reasoning Shizhe Chen Yida Zhao Qin Jin Qi Wu 68 311 0 01 Mar 2020
Cross-Domain Few-Shot Classification via Learned Feature-Wise Transformation Hung-Yu Tseng Hsin-Ying Lee Jia-Bin Huang Ming-Hsuan Yang 64 387 0 23 Jan 2020
Pathomic Fusion: An Integrated Framework for Fusing Histopathology and Genomic Features for Cancer Diagnosis and Prognosis Richard J. Chen Ming Y. Lu Jingwen Wang Drew F. K. Williamson S. Rodig N. Lindeman Faisal Mahmood 46 405 0 18 Dec 2019
ManiGAN: Text-Guided Image Manipulation Bowen Li Xiaojuan Qi Thomas Lukasiewicz Philip Torr EGVM 73 285 0 12 Dec 2019
Towards Understanding the Spectral Bias of Deep Learning Yuan Cao Zhiying Fang Yue Wu Ding-Xuan Zhou Quanquan Gu 68 217 0 03 Dec 2019
SEAN: Image Synthesis with Semantic Region-Adaptive Normalization Peihao Zhu Rameen Abdal Yipeng Qin Peter Wonka DiffM 49 443 0 28 Nov 2019
Learning Hierarchy-Aware Knowledge Graph Embeddings for Link Prediction Zhanqiu Zhang Jianyu Cai Yongdong Zhang Jie Wang 64 386 0 21 Nov 2019
Learning to Predict Layout-to-image Conditional Convolutions for Semantic Image Synthesis Xihui Liu Guojun Yin Jing Shao Xiaogang Wang Hongsheng Li 63 205 0 15 Oct 2019
Unified Vision-Language Pre-Training for Image Captioning and VQA Luowei Zhou Hamid Palangi Lei Zhang Houdong Hu Jason J. Corso Jianfeng Gao MLLM VLM 320 930 0 24 Sep 2019
Image Inpainting with Learnable Bidirectional Attention Maps Chaohao Xie Shaohui Liu Chao Li Ming-Ming Cheng W. Zuo Xiao-Chang Liu Shilei Wen Errui Ding GAN 29 225 0 03 Sep 2019
Onion-Peel Networks for Deep Video Completion Seoung Wug Oh Sungho Lee Joon-Young Lee Seon Joo Kim 33 100 0 23 Aug 2019
Mish: A Self Regularized Non-Monotonic Activation Function Diganta Misra 46 679 0 23 Aug 2019
ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks Jiasen Lu Dhruv Batra Devi Parikh Stefan Lee SSL VLM 188 3,659 0 06 Aug 2019
MaskGAN: Towards Diverse and Interactive Facial Image Manipulation Cheng-Han Lee Ziwei Liu Lingyun Wu Ping Luo CVBM 132 1,070 0 27 Jul 2019
RUBi: Reducing Unimodal Biases in Visual Question Answering Rémi Cadène Corentin Dancette H. Ben-younes Matthieu Cord Devi Parikh CML 68 373 0 24 Jun 2019
Encrypted Speech Recognition using Deep Polynomial Networks Shi-Xiong Zhang Jiawei Liu Dong Yu 35 26 0 11 May 2019
Analysing Mathematical Reasoning Abilities of Neural Models D. Saxton Edward Grefenstette Felix Hill Pushmeet Kohli LRM 108 420 0 02 Apr 2019
MirrorGAN: Learning Text-to-image Generation by Redescription Tingting Qiao Jing Zhang Duanqing Xu Dacheng Tao VLM GAN 48 539 0 14 Mar 2019
Self-Tuning Networks: Bilevel Optimization of Hyperparameters using Structured Best-Response Functions M. Mackay Paul Vicol Jonathan Lorraine David Duvenaud Roger C. Grosse 69 164 0 07 Mar 2019
Superposition of many models into one Brian Cheung A. Terekhov Yubei Chen Pulkit Agrawal Bruno A. Olshausen MoMe 22 115 0 14 Feb 2019
A Style-Based Generator Architecture for Generative Adversarial Networks Tero Karras S. Laine Timo Aila 494 10,466 0 12 Dec 2018
FineGAN: Unsupervised Hierarchical Disentanglement for Fine-Grained Object Generation and Discovery Krishna Kumar Singh Utkarsh Ojha Yong Jae Lee OCL 88 132 0 27 Nov 2018
Gather-Excite: Exploiting Feature Context in Convolutional Neural Networks Jie Hu Li Shen Samuel Albanie Gang Sun Andrea Vedaldi 46 573 0 29 Oct 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 862 93,936 0 11 Oct 2018
CBAM: Convolutional Block Attention Module Sanghyun Woo Jongchan Park Joon-Young Lee In So Kweon 167 16,337 0 17 Jul 2018
On the Spectral Bias of Neural Networks Nasim Rahaman A. Baratin Devansh Arpit Felix Dräxler Min Lin Fred Hamprecht Yoshua Bengio Aaron Courville 92 1,408 0 22 Jun 2018