v1v2v3 (latest)

Towards Sparsification of Graph Neural Networks

11 September 2022

Hongwu Peng

Caiwen Ding

Papers citing "Towards Sparsification of Graph Neural Networks"

42 / 42 papers shown

Title
A Length Adaptive Algorithm-Hardware Co-design of Transformer on FPGA Through Sparse Attention and Dynamic Pipelining Hongwu Peng Shaoyi Huang Shiyang Chen Bingbing Li Tong Geng ... Weiwen Jiang Wujie Wen J. Bi Hang Liu Caiwen Ding 63 54 0 07 Aug 2022
An Automatic and Efficient BERT Pruning for Edge AI Systems Shaoyi Huang Ning Liu Yueying Liang Hongwu Peng Hongjia Li Dongkuan Xu Mimi Xie Caiwen Ding 105 22 0 21 Jun 2022
Towards Training Billion Parameter Graph Neural Networks for Atomic Simulations Anuroop Sriram Abhishek Das Brandon M. Wood Siddharth Goyal C. L. Zitnick AI4CE 61 27 0 18 Mar 2022
Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets Tianlong Chen Xuxi Chen Xiaolong Ma Yanzhi Wang Zhangyang Wang 55 34 0 09 Feb 2022
Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Models Tri Dao Beidi Chen Kaizhao Liang Jiaming Yang Zhao Song Atri Rudra Christopher Ré 94 79 0 30 Nov 2021
MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge Geng Yuan Xiaolong Ma Wei Niu Zhengang Li Zhenglun Kong ... Minghai Qin Bin Ren Yanzhi Wang Sijia Liu Xue Lin 68 94 0 26 Oct 2021
Accelerating Framework of Transformer by Hardware Design and Model Compression Co-Optimization Panjie Qi E. Sha Qingfeng Zhuge Hongwu Peng Shaoyi Huang Zhenglun Kong Yuhong Song Bingbing Li 64 51 0 19 Oct 2021
Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm Shaoyi Huang Dongkuan Xu Ian En-Hsu Yen Yijue Wang Sung-En Chang ... Shiyang Chen Mimi Xie Sanguthevar Rajasekaran Hang Liu Caiwen Ding CLL VLM 42 32 0 15 Oct 2021
Binary Complex Neural Network Acceleration on FPGA Hongwu Peng Shangli Zhou Scott Weitze Jiaxin Li Sahidul Islam ... Wei Zhang M. Song Mimi Xie Hang Liu Caiwen Ding MQ 43 20 0 10 Aug 2021
Improving DNN Fault Tolerance using Weight Pruning and Differential Crossbar Mapping for ReRAM-based Edge AI Geng Yuan Zhiheng Liao Xiaolong Ma Yuxuan Cai Zhenglun Kong ... Hongwu Peng Ning Liu Ao Ren Jinhui Wang Yanzhi Wang AAML 75 33 0 16 Jun 2021
Top-KAST: Top-K Always Sparse Training Siddhant M. Jayakumar Razvan Pascanu Jack W. Rae Simon Osindero Erich Elsen 154 99 0 07 Jun 2021
Rethinking Network Pruning -- under the Pre-train and Fine-tune Paradigm Dongkuan Xu Ian En-Hsu Yen Jinxi Zhao Zhibin Xiao VLM AAML 66 58 0 18 Apr 2021
Graph Neural Network for Traffic Forecasting: A Survey Weiwei Jiang Jiayun Luo GNN AI4TS AI4CE 222 877 0 27 Jan 2021
Molecular graph generation with Graph Neural Networks P. Bongini Monica Bianchini F. Scarselli GNN 92 142 0 14 Dec 2020
Auto Graph Encoder-Decoder for Neural Network Pruning Sixing Yu Arya Mazaheri Ali Jannesari GNN 67 40 0 25 Nov 2020
Rethinking Weight Decay For Efficient Neural Network Pruning Hugo Tessier Vincent Gripon Mathieu Léonardon M. Arzel T. Hannagan David Bertrand 84 26 0 20 Nov 2020
Pruning neural networks without any data by iteratively conserving synaptic flow Hidenori Tanaka D. Kunin Daniel L. K. Yamins Surya Ganguli 169 648 0 09 Jun 2020
Point-GNN: Graph Neural Network for 3D Object Detection in a Point Cloud Weijing Shi Ragunathan R. Rajkumar 3DPC 224 743 0 02 Mar 2020
Soft Threshold Weight Reparameterization for Learnable Sparsity Aditya Kusupati Vivek Ramanujan Raghav Somani Mitchell Wortsman Prateek Jain Sham Kakade Ali Farhadi 148 247 0 08 Feb 2020
Rigging the Lottery: Making All Tickets Winners Utku Evci Trevor Gale Jacob Menick Pablo Samuel Castro Erich Elsen 193 602 0 25 Nov 2019
Multi-Channel Graph Neural Network for Entity Alignment Yixin Cao Zhiyuan Liu Chengjiang Li Zhiyuan Liu Juan-Zi Li Tat-Seng Chua 54 259 0 26 Aug 2019
Sparse Networks from Scratch: Faster Training without Losing Performance Tim Dettmers Luke Zettlemoyer 142 340 0 10 Jul 2019
AliGraph: A Comprehensive Graph Neural Network Platform Rong Zhu Kun Zhao Hongxia Yang Wei Lin Chang Zhou Baole Ai Yong Li Jingren Zhou GNN 102 388 0 23 Feb 2019
Formal Verification of Neural Network Controlled Autonomous Systems Xiaowu Sun Haitham Khedr Yasser Shoukry 76 139 0 31 Oct 2018
Sparse DNNs with Improved Adversarial Robustness Yiwen Guo Chao Zhang Changshui Zhang Yurong Chen AAML 62 154 0 23 Oct 2018
Rethinking the Value of Network Pruning Zhuang Liu Mingjie Sun Tinghui Zhou Gao Huang Trevor Darrell 36 1,470 0 11 Oct 2018
SNIP: Single-shot Network Pruning based on Connection Sensitivity Namhoon Lee Thalaiyasingam Ajanthan Philip Torr VLM 263 1,205 0 04 Oct 2018
Graph Convolutional Neural Networks for Web-Scale Recommender Systems Rex Ying Ruining He Kaifeng Chen Pong Eksombatchai William L. Hamilton J. Leskovec GNN BDL 263 3,549 0 06 Jun 2018
A Systematic DNN Weight Pruning Framework using Alternating Direction Method of Multipliers Tianyun Zhang Shaokai Ye Kaiqi Zhang Jian Tang Wujie Wen M. Fardad Yanzhi Wang 62 438 0 10 Apr 2018
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks Jonathan Frankle Michael Carbin 242 3,484 0 09 Mar 2018
FastGCN: Fast Learning with Graph Convolutional Networks via Importance Sampling Jie Chen Tengfei Ma Cao Xiao GNN 144 1,513 0 30 Jan 2018
Graph Attention Networks Petar Velickovic Guillem Cucurull Arantxa Casanova Adriana Romero Pietro Lio Yoshua Bengio GNN 479 20,164 0 30 Oct 2017
CirCNN: Accelerating and Compressing Deep Neural Networks Using Block-CirculantWeight Matrices Caiwen Ding Siyu Liao Yanzhi Wang Zhe Li Ning Liu ... Yipeng Zhang Jian Tang Qinru Qiu Xinyu Lin Bo Yuan GNN 55 260 0 29 Aug 2017
Channel Pruning for Accelerating Very Deep Neural Networks Yihui He Xiangyu Zhang Jian Sun 204 2,525 0 19 Jul 2017
Scalable Training of Artificial Neural Networks with Adaptive Sparse Connectivity inspired by Network Science Decebal Constantin Mocanu Elena Mocanu Peter Stone Phuong H. Nguyen M. Gibescu A. Liotta 175 633 0 15 Jul 2017
Inductive Representation Learning on Large Graphs William L. Hamilton Z. Ying J. Leskovec 509 15,300 0 07 Jun 2017
Exploring the Regularity of Sparse Structure in Convolutional Neural Networks Huizi Mao Song Han Jeff Pool Wenshuo Li Xingyu Liu Yu Wang W. Dally 100 243 0 24 May 2017
Motifs in Temporal Networks Ashwin Paranjape Austin R. Benson J. Leskovec 54 690 0 29 Dec 2016
SC-DCNN: Highly-Scalable Deep Convolutional Neural Network using Stochastic Computing Ao Ren Ji Li Zhe Li Caiwen Ding Xuehai Qian Qinru Qiu Bo Yuan Yanzhi Wang 48 196 0 18 Nov 2016
Semi-Supervised Classification with Graph Convolutional Networks Thomas Kipf Max Welling GNN SSL 644 29,076 0 09 Sep 2016
DeepWalk: Online Learning of Social Representations Bryan Perozzi Rami Al-Rfou Steven Skiena HAI 257 9,800 0 26 Mar 2014
Efficient Estimation of Word Representations in Vector Space Tomas Mikolov Kai Chen G. Corrado J. Dean 3DV 680 31,512 0 16 Jan 2013