Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications with $1/n$ Parameters

17 February 2021

Papers citing "Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications with $1/n$ Parameters"

23 / 23 papers shown

Title
V-EfficientNets: Vector-Valued Efficiently Scaled Convolutional Neural Network Models Guilherme Vieira Neto Marcos Eduardo Valle 31 0 0 08 May 2025
Lightweight Hypercomplex MRI Reconstruction: A Generalized Kronecker-Parameterized Approach Hanwang Zhang Jiahao Huang Yinzhe Wu Congren Dai Fanwen Wang Zhenxuan Zhang Guang Yang 58 0 0 13 Mar 2025
AutoLoRA: Automatically Tuning Matrix Ranks in Low-Rank Adaptation Based on Meta Learning Ruiyi Zhang Rushi Qiang Sai Ashish Somayajula Pengtao Xie 39 13 0 14 Mar 2024
Understanding Vector-Valued Neural Networks and Their Relationship with Real and Hypercomplex-Valued Neural Networks Marcos Eduardo Valle 19 3 0 14 Sep 2023
Parameter-efficient is not sufficient: Exploring Parameter, Memory, and Time Efficient Adapter Tuning for Dense Predictions Dongshuo Yin Xueting Han Bin Li Hao Feng Jinghua Bai VPVLM 26 17 0 16 Jun 2023
Automated Few-shot Classification with Instruction-Finetuned Language Models Rami Aly Xingjian Shi Kaixiang Lin Aston Zhang A. Wilson 38 9 0 21 May 2023
Parameter-Efficient Fine-Tuning Design Spaces Jiaao Chen Aston Zhang Xingjian Shi Mu Li Alexander J. Smola Diyi Yang 36 59 0 04 Jan 2023
Late Prompt Tuning: A Late Prompt Could Be Better Than Many Prompts Xiangyang Liu Tianxiang Sun Xuanjing Huang Xipeng Qiu VLM 36 27 0 20 Oct 2022
AlphaTuning: Quantization-Aware Parameter-Efficient Adaptation of Large-Scale Pre-Trained Language Models S. Kwon Jeonghoon Kim Jeongin Bae Kang Min Yoo Jin-Hwa Kim Baeseong Park Byeongwook Kim Jung-Woo Ha Nako Sung Dongsoo Lee MQ 26 30 0 08 Oct 2022
Polyhistor: Parameter-Efficient Multi-Task Adaptation for Dense Vision Tasks Yen-Cheng Liu Chih-Yao Ma Junjiao Tian Zijian He Z. Kira 123 47 0 07 Oct 2022
Hypercomplex Image-to-Image Translation Eleonora Grassucci Luigi Sigillo A. Uncini Danilo Comminiello 29 7 0 04 May 2022
Multi-View Hypercomplex Learning for Breast Cancer Screening Eleonora Lopez Eleonora Grassucci Martina Valleriani Danilo Comminiello 28 8 0 12 Apr 2022
IDPG: An Instance-Dependent Prompt Generation Method Zhuofeng Wu Sinong Wang Jiatao Gu Rui Hou Yuxiao Dong V. Vydiswaran Hao Ma VLM 30 58 0 09 Apr 2022
PERFECT: Prompt-free and Efficient Few-shot Learning with Language Models Rabeeh Karimi Mahabadi Luke Zettlemoyer James Henderson Marzieh Saeidi Lambert Mathias Ves Stoyanov Majid Yazdani VLM 31 69 0 03 Apr 2022
Parameter-efficient Model Adaptation for Vision Transformers Xuehai He Chunyuan Li Pengchuan Zhang Jianwei Yang Qing Guo 30 84 0 29 Mar 2022
EdgeFormer: A Parameter-Efficient Transformer for On-Device Seq2seq Generation Tao Ge Si-Qing Chen Furu Wei MoE 24 21 0 16 Feb 2022
Color Image Inpainting via Robust Pure Quaternion Matrix Completion: Error Bound and Weighted Loss Junren Chen Michael Kwok-Po Ng 14 20 0 04 Feb 2022
VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks Yi-Lin Sung Jaemin Cho Joey Tianyi Zhou VLM VPVLM 35 343 0 13 Dec 2021
PHNNs: Lightweight Neural Networks via Parameterized Hypercomplex Convolutions Eleonora Grassucci Aston Zhang Danilo Comminiello 25 38 0 08 Oct 2021
HopfE: Knowledge Graph Representation Learning using Inverse Hopf Fibrations Anson Bastos Kuldeep Singh Abhishek Nadgeri Saeedeh Shekarpour I. Mulang' Johannes Hoffart 22 18 0 12 Aug 2021
Compacter: Efficient Low-Rank Hypercomplex Adapter Layers Rabeeh Karimi Mahabadi James Henderson Sebastian Ruder MoE 46 467 0 08 Jun 2021
Quaternion Convolutional Neural Networks for Heterogeneous Image Processing Titouan Parcollet Mohamed Morchid G. Linarès 140 93 0 31 Oct 2018
A Decomposable Attention Model for Natural Language Inference Ankur P. Parikh Oscar Täckström Dipanjan Das Jakob Uszkoreit 201 1,367 0 06 Jun 2016

Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications with 1/n1/n1/n Parameters

Papers citing "Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications with $1/n$ Parameters"

Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications with $1/n$ Parameters