Two Heads Are Better Than One: Boosting Graph Sparse Training via Semantic and Topological Awareness

2 February 2024

Papers citing "Two Heads Are Better Than One: Boosting Graph Sparse Training via Semantic and Topological Awareness"

27 / 27 papers shown

Title
The Graph Lottery Ticket Hypothesis: Finding Sparse, Informative Graph Structure Anton Tsitsulin Bryan Perozzi 42 6 0 08 Dec 2023
Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLMs Yuxin Zhang Lirui Zhao Mingbao Lin Yunyun Sun Yiwu Yao Xingjia Han Jared Tanner Shiwei Liu Rongrong Ji SyDa 65 42 0 13 Oct 2023
Dynamic Sparse Training via Balancing the Exploration-Exploitation Trade-off Shaoyi Huang Bowen Lei Dongkuan Xu Hongwu Peng Yue Sun Mimi Xie Caiwen Ding 49 19 0 30 Nov 2022
MGNN: Graph Neural Networks Inspired by Distance Geometry Problem Guanyu Cui Zhewei Wei 46 8 0 31 Jan 2022
Optimizing Sparse Matrix Multiplications for Graph Neural Networks Shenghao Qiu You Liang Zheng Wang GNN 43 18 0 30 Oct 2021
MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge Geng Yuan Xiaolong Ma Wei Niu Zhengang Li Zhenglun Kong ... Minghai Qin Bin Ren Yanzhi Wang Sijia Liu Xue Lin 52 93 0 26 Oct 2021
Early-Bird GCNs: Graph-Network Co-Optimization Towards More Efficient GCN Training and Inference via Drawing Early-Bird Lottery Tickets Haoran You Zhihan Lu Zijian Zhou Y. Fu Yingyan Lin GNN 76 32 0 01 Mar 2021
Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked Layers Junjie Liu Zhe Xu Runbin Shi R. Cheung Hayden Kwok-Hay So 46 121 0 14 May 2020
Open Graph Benchmark: Datasets for Machine Learning on Graphs Weihua Hu Matthias Fey Marinka Zitnik Yuxiao Dong Hongyu Ren Bowen Liu Michele Catasta J. Leskovec 289 2,725 0 02 May 2020
Rigging the Lottery: Making All Tickets Winners Utku Evci Trevor Gale Jacob Menick Pablo Samuel Castro Erich Elsen 178 600 0 25 Nov 2019
DropEdge: Towards Deep Graph Convolutional Networks on Node Classification Yu Rong Wenbing Huang Tingyang Xu Junzhou Huang 104 1,334 0 25 Jul 2019
Sparse Networks from Scratch: Faster Training without Losing Performance Tim Dettmers Luke Zettlemoyer 130 339 0 10 Jul 2019
Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks Wei-Lin Chiang Xuanqing Liu Si Si Yang Li Samy Bengio Cho-Jui Hsieh GNN 142 1,272 0 20 May 2019
Inductive Matrix Completion Based on Graph Neural Networks Muhan Zhang Yixin Chen 68 234 0 26 Apr 2019
Fast Graph Representation Learning with PyTorch Geometric Matthias Fey J. E. Lenssen 3DH GNN 3DPC 212 4,334 0 06 Mar 2019
A Comprehensive Survey on Graph Neural Networks Zonghan Wu Shirui Pan Fengwen Chen Guodong Long Chengqi Zhang Philip S. Yu FaML GNN AI4TS AI4CE 692 8,496 0 03 Jan 2019
Graph Neural Networks: A Review of Methods and Applications Jie Zhou Ganqu Cui Shengding Hu Zhengyan Zhang Cheng Yang Zhiyuan Liu Lifeng Wang Changcheng Li Maosong Sun AI4CE GNN 1.0K 5,493 0 20 Dec 2018
SNIP: Single-shot Network Pruning based on Connection Sensitivity Namhoon Lee Thalaiyasingam Ajanthan Philip Torr VLM 243 1,196 0 04 Oct 2018
How Powerful are Graph Neural Networks? Keyulu Xu Weihua Hu J. Leskovec Stefanie Jegelka GNN 226 7,623 0 01 Oct 2018
Graph Convolutional Neural Networks for Web-Scale Recommender Systems Rex Ying Ruining He Kaifeng Chen Pong Eksombatchai William L. Hamilton J. Leskovec GNN BDL 248 3,524 0 06 Jun 2018
Link Prediction Based on Graph Neural Networks Muhan Zhang Yixin Chen GNN 79 1,929 0 27 Feb 2018
FastGCN: Fast Learning with Graph Convolutional Networks via Importance Sampling Jie Chen Tengfei Ma Cao Xiao GNN 141 1,513 0 30 Jan 2018
Graph Attention Networks Petar Velickovic Guillem Cucurull Arantxa Casanova Adriana Romero Pietro Lio Yoshua Bengio GNN 438 20,089 0 30 Oct 2017
To prune, or not to prune: exploring the efficacy of pruning for model compression Michael Zhu Suyog Gupta 185 1,275 0 05 Oct 2017
Scalable Training of Artificial Neural Networks with Adaptive Sparse Connectivity inspired by Network Science Decebal Constantin Mocanu Elena Mocanu Peter Stone Phuong H. Nguyen M. Gibescu A. Liotta 164 628 0 15 Jul 2017
Inductive Representation Learning on Large Graphs William L. Hamilton Z. Ying J. Leskovec 464 15,179 0 07 Jun 2017
Semi-Supervised Classification with Graph Convolutional Networks Thomas Kipf Max Welling GNN SSL 589 28,999 0 09 Sep 2016