SAINT: Improved Neural Networks for Tabular Data via Row Attention and Contrastive Pre-Training

2 June 2021

Papers citing "SAINT: Improved Neural Networks for Tabular Data via Row Attention and Contrastive Pre-Training"

36 / 36 papers shown

Title
Large Language Models as Attribution Regularizers for Efficient Model Training Davor Vukadin Marin Šilić Goran Delač 184 0 0 27 Feb 2025
Imputation for prediction: beware of diminishing returns Marine Le Morvan Gaël Varoquaux AI4TS 188 4 0 21 Feb 2025
Tabular Embeddings for Tables with Bi-Dimensional Hierarchical Metadata and Nesting Gyanendra Shrestha Chutain Jiang Sai Akula Vivek Yannam Anna Pyayt Michael Gubanov LMTD 143 0 0 20 Feb 2025
Zero-Shot Decision Tree Construction via Large Language Models Lucas Carrasco Felipe Urrutia Andrés Abeliuk 170 0 0 28 Jan 2025
TabM: Advancing Tabular Deep Learning with Parameter-Efficient Ensembling Yury Gorishniy Akim Kotelnikov Artem Babenko LMTD MoE 260 13 0 31 Oct 2024
Gradient Boosting Reinforcement Learning Benjamin Fuhrer Chen Tessler Gal Dalal OffRL AI4CE 153 3 0 11 Jul 2024
Virtual Human Generative Model: Masked Modeling Approach for Learning Human Characteristics Kenta Oono Nontawat Charoenphakdee K. Bito Zhengyan Gao Yoshiaki Ota ... Kohei Hayashi Yuki Saito Koki Tsuda Hiroshi Maruyama K. Hayashi 127 1 0 19 Jun 2023
A Framework and Benchmark for Deep Batch Active Learning for Regression David Holzmüller Viktor Zaverkin Johannes Kastner Ingo Steinwart UQCV BDL GP 92 37 0 17 Mar 2022
TABBIE: Pretrained Representations of Tabular Data H. Iida Dung Ngoc Thai Varun Manjunatha Mohit Iyyer LMTD SSL VLM 70 176 0 06 May 2021
TabTransformer: Tabular Data Modeling Using Contextual Embeddings Xin Huang A. Khetan Milan Cvitkovic Zohar Karnin ViT LMTD 207 457 0 11 Dec 2020
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 258 4,072 0 20 Nov 2020
Tabular Transformers for Modeling Multivariate Time Series Inkit Padhi Yair Schiff Igor Melnyk Mattia Rigotti Youssef Mroueh Pierre Dognin Jerret Ross Ravi Nair Erik Altman LMTD AI4TS 67 92 0 03 Nov 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 383 6,833 0 13 Jun 2020
TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data Pengcheng Yin Graham Neubig Wen-tau Yih Sebastian Riedel RALM LMTD 94 604 0 17 May 2020
AutoGluon-Tabular: Robust and Accurate AutoML for Structured Data Nick Erickson Jonas W. Mueller Alexander Shirkov Hang Zhang Pedro Larroy Mu Li Alex Smola LMTD 218 628 0 13 Mar 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 375 18,859 0 13 Feb 2020
Axial Attention in Multidimensional Transformers Jonathan Ho Nal Kalchbrenner Dirk Weissenborn Tim Salimans 110 533 0 20 Dec 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 210 12,121 0 13 Nov 2019
TabNet: Attentive Interpretable Tabular Learning Sercan O. Arik Tomas Pfister LMTD 188 1,355 0 20 Aug 2019
Learning Semantic Annotations for Tabular Data Jiaoyan Chen Ernesto Jiménez-Ruiz Ian Horrocks Charles Sutton LMTD 51 56 0 30 May 2019
CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features Sangdoo Yun Dongyoon Han Seong Joon Oh Sanghyuk Chun Junsuk Choe Y. Yoo OOD 622 4,798 0 13 May 2019
Generating Long Sequences with Sparse Transformers R. Child Scott Gray Alec Radford Ilya Sutskever 129 1,915 0 23 Apr 2019
CatBoost: gradient boosting with categorical features support Anna Veronika Dorogush Vasily Ershov Andrey Gulin 140 1,339 0 24 Oct 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,114 0 11 Oct 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 351 10,349 0 10 Jul 2018
Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination Zhirong Wu Yuanjun Xiong Stella X. Yu Dahua Lin SSL 179 3,465 0 05 May 2018
Graph Attention Networks Petar Velickovic Guillem Cucurull Arantxa Casanova Adriana Romero Pietro Lio Yoshua Bengio GNN 479 20,225 0 30 Oct 2017
mixup: Beyond Empirical Risk Minimization Hongyi Zhang Moustapha Cissé Yann N. Dauphin David Lopez-Paz NoLa 282 9,797 0 25 Oct 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 730 132,363 0 12 Jun 2017
Layer Normalization Jimmy Lei Ba J. Kiros Geoffrey E. Hinton 422 10,526 0 21 Jul 2016
Gaussian Error Linear Units (GELUs) Dan Hendrycks Kevin Gimpel 172 5,037 0 27 Jun 2016
Context Encoders: Feature Learning by Inpainting Deepak Pathak Philipp Krahenbuhl Jeff Donahue Trevor Darrell Alexei A. Efros SSL 69 5,299 0 25 Apr 2016
XGBoost: A Scalable Tree Boosting System Tianqi Chen Carlos Guestrin 809 39,062 0 09 Mar 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,322 0 10 Dec 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 2.0K 150,260 0 22 Dec 2014
OpenML: networked science in machine learning Joaquin Vanschoren Jan N. van Rijn B. Bischl Luís Torgo FedML AI4CE 163 1,327 0 29 Jul 2014