Graph-level Representation Learning with Joint-Embedding Predictive Architectures

27 September 2023

Papers citing "Graph-level Representation Learning with Joint-Embedding Predictive Architectures"

50 / 59 papers shown

Title
T-JEPA: Augmentation-Free Self-Supervised Learning for Tabular Data Hugo Thimonier José Lucas De Melo Costa Fabrice Popineau Arpad Rimmel Bich-Liên Doan 80 1 0 07 Oct 2024
Prospective Role of Foundation Models in Advancing Autonomous Vehicles Jianhua Wu B. Gao Jincheng Gao Jianhao Yu Hongqing Chu ... Xun Gong Yi Chang H. E. Tseng Hong Chen Jie Chen 55 5 0 08 Dec 2023
A-JEPA: Joint-Embedding Predictive Architecture Can Listen Zhengcong Fei Mingyuan Fan Junshi Huang 72 17 0 27 Nov 2023
MC-JEPA: A Joint-Embedding Predictive Architecture for Self-Supervised Learning of Motion and Content Features Adrien Bardes Jean Ponce Yann LeCun MDE 60 25 0 24 Jul 2023
Modeling Graphs Beyond Hyperbolic: Graph Neural Networks in Symmetric Positive Definite Matrices Weichen Zhao Federico López J. M. Riestenberg Michael Strube Diaaeldin Taha Steve J. Trettel 47 7 0 24 Jun 2023
The Edge of Orthogonality: A Simple View of What Makes BYOL Tick Pierre Harvey Richemond Allison C. Tam Yunhao Tang Florian Strub Bilal Piot Felix Hill SSL 44 9 0 09 Feb 2023
Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture Mahmoud Assran Quentin Duval Ishan Misra Piotr Bojanowski Pascal Vincent Michael G. Rabbat Yann LeCun Nicolas Ballas SSL AI4TS MDE 64 346 0 19 Jan 2023
Everything is Connected: Graph Neural Networks Petar Velickovic GNN AI4CE 54 183 0 19 Jan 2023
A Generalization of ViT/MLP-Mixer to Graphs Xiaoxin He Bryan Hooi T. Laurent Adam Perold Yann LeCun Xavier Bresson 67 95 0 27 Dec 2022
Long Range Graph Benchmark Vijay Prakash Dwivedi Ladislav Rampášek Mikhail Galkin Alipanah Parviz Guy Wolf Anh Tuan Luu Dominique Beaini 76 209 0 16 Jun 2022
GraphMAE: Self-Supervised Masked Graph Autoencoders Zhenyu Hou Xiao Liu Yukuo Cen Yuxiao Dong Hongxia Yang C. Wang Jie Tang SSL 71 575 0 22 May 2022
Diagnosing and Fixing Manifold Overfitting in Deep Generative Models Gabriel Loaiza-Ganem Brendan Leigh Ross Jesse C. Cresswell Anthony L. Caterini GAN DRL 40 30 0 14 Apr 2022
Self-Supervised Representation Learning via Latent Graph Prediction Yaochen Xie Zhao Xu Shuiwang Ji SSL 42 33 0 16 Feb 2022
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language Alexei Baevski Wei-Ning Hsu Qiantong Xu Arun Babu Jiatao Gu Michael Auli SSL VLM ViT 89 852 0 07 Feb 2022
Augmentation-Free Self-Supervised Learning on Graphs Namkyeong Lee Junseok Lee Chanyoung Park 98 206 0 05 Dec 2021
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 422 7,705 0 11 Nov 2021
Graph Neural Networks with Learnable Structural and Positional Representations Vijay Prakash Dwivedi Anh Tuan Luu T. Laurent Yoshua Bengio Xavier Bresson GNN 254 325 0 15 Oct 2021
From Canonical Correlation Analysis to Self-supervised Graph Neural Networks Hengrui Zhang Qitian Wu Junchi Yan David Wipf Philip S. Yu SSL 48 219 0 23 Jun 2021
Adversarial Graph Augmentation to Improve Graph Contrastive Learning Susheel Suresh Pan Li Cong Hao Jennifer Neville AAML 59 342 0 10 Jun 2021
Automated Self-Supervised Learning for Graphs Wei Jin Xiaorui Liu Xiangyu Zhao Yao Ma Neil Shah Jiliang Tang SSL 65 76 0 10 Jun 2021
On Memorization in Probabilistic Deep Generative Models G. V. D. Burg Christopher K. I. Williams TDI 46 62 0 06 Jun 2021
Self-Supervised Learning of Graph Neural Networks: A Unified Review Yaochen Xie Zhao Xu Jingtun Zhang Zhengyang Wang Shuiwang Ji SSL 76 333 0 22 Feb 2021
Large-Scale Representation Learning on Graphs via Bootstrapping S. Thakoor Corentin Tallec M. G. Azar Mehdi Azabou Eva L. Dyer Rémi Munos Petar Velivcković Michal Valko SSL 67 224 0 12 Feb 2021
A Generalization of Transformer Networks to Graphs Vijay Prakash Dwivedi Xavier Bresson AI4CE 98 747 0 17 Dec 2020
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 240 4,036 0 20 Nov 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 512 40,739 0 22 Oct 2020
The Surprising Power of Graph Neural Networks with Random Node Initialization Ralph Abboud .Ismail .Ilkan Ceylan Martin Grohe Thomas Lukasiewicz 80 221 0 02 Oct 2020
TUDataset: A collection of benchmark datasets for learning with graphs Christopher Morris Nils M. Kriege Franka Bause Kristian Kersting Petra Mutzel Marion Neumann 196 817 0 16 Jul 2020
GPT-GNN: Generative Pre-Training of Graph Neural Networks Ziniu Hu Yuxiao Dong Kuansan Wang Kai-Wei Chang Yizhou Sun SSL AI4CE 123 560 0 27 Jun 2020
Self-supervised Learning on Graphs: Deep Insights and New Direction Wei Jin Hanyu Wang Haochen Liu Yiqi Wang Suhang Wang Zitao Liu Jiliang Tang SSL 58 175 0 17 Jun 2020
Self-supervised Learning: Generative or Contrastive Xiao Liu Fanjin Zhang Zhenyu Hou Zhaoyu Wang Li Mian Jing Zhang Jie Tang SSL 119 1,612 0 15 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 323 6,773 0 13 Jun 2020
Contrastive Multi-View Representation Learning on Graphs Kaveh Hassani Amir Hosein Khas Ahmadi SSL 211 1,299 0 10 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 567 41,706 0 28 May 2020
What Makes for Good Views for Contrastive Learning? Yonglong Tian Chen Sun Ben Poole Dilip Krishnan Cordelia Schmid Phillip Isola SSL 82 1,323 0 20 May 2020
Decision-Making with Auto-Encoding Variational Bayes Romain Lopez Pierre Boyeau Nir Yosef Michael I. Jordan Jeffrey Regier BDL 291 10,591 0 17 Feb 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 307 18,686 0 13 Feb 2020
On Layer Normalization in the Transformer Architecture Ruibin Xiong Yunchang Yang Di He Kai Zheng Shuxin Zheng Chen Xing Huishuai Zhang Yanyan Lan Liwei Wang Tie-Yan Liu AI4CE 112 988 0 12 Feb 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 337 42,282 0 03 Dec 2019
InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximization Fan-Yun Sun Jordan Hoffmann Vikas Verma Jian Tang SSL 143 861 0 31 Jul 2019
Strategies for Pre-training Graph Neural Networks Weihua Hu Bowen Liu Joseph Gomes Marinka Zitnik Percy Liang Vijay S. Pande J. Leskovec SSL AI4CE 96 1,398 0 29 May 2019
Fast Graph Representation Learning with PyTorch Geometric Matthias Fey J. E. Lenssen 3DH GNN 3DPC 189 4,326 0 06 Mar 2019
Simplifying Graph Convolutional Networks Felix Wu Tianyi Zhang Amauri Souza Christopher Fifty Tao Yu Kilian Q. Weinberger GNN 191 3,168 0 19 Feb 2019
Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networks Christopher Morris Martin Ritzert Matthias Fey William L. Hamilton J. E. Lenssen Gaurav Rattan Martin Grohe GNN 160 1,630 0 04 Oct 2018
How Powerful are Graph Neural Networks? Keyulu Xu Weihua Hu J. Leskovec Stefanie Jegelka GNN 208 7,623 0 01 Oct 2018
Hierarchical Graph Representation Learning with Differentiable Pooling Rex Ying Jiaxuan You Christopher Morris Xiang Ren William L. Hamilton J. Leskovec GNN 256 2,140 0 22 Jun 2018
Representation Tradeoffs for Hyperbolic Embeddings Christopher De Sa Albert Gu Christopher Ré Frederic Sala 177 411 0 10 Apr 2018
Relational Autoencoder for Feature Extraction Qinxue Meng D. Catchpoole D. Skillicom Paul J. Kennedy 42 174 0 09 Feb 2018
Residual Gated Graph ConvNets Xavier Bresson T. Laurent GNN 118 480 0 20 Nov 2017
Graph Attention Networks Petar Velickovic Guillem Cucurull Arantxa Casanova Adriana Romero Pietro Lio Yoshua Bengio GNN 413 20,061 0 30 Oct 2017