Transformers with Stochastic Competition for Tabular Data Modelling

Transformers with Stochastic Competition for Tabular Data Modelling

18 July 2024

Charalambos Christoforou

ArXiv (abs)PDF HTML

Papers citing "Transformers with Stochastic Competition for Tabular Data Modelling"

16 / 16 papers shown

Title
Revisiting Pretraining Objectives for Tabular Deep Learning Ivan Rubachev Artem Alekberov Yu. V. Gorishniy Artem Babenko LMTD 56 47 0 07 Jul 2022
TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Second Noah Hollmann Samuel G. Müller Katharina Eggensperger Frank Hutter 109 315 0 05 Jul 2022
On Embeddings for Numerical Features in Tabular Deep Learning Yura Gorishniy Ivan Rubachev Artem Babenko LMTD 103 177 0 10 Mar 2022
Competing Mutual Information Constraints with Stochastic Competition-based Activations for Learning Diversified Representations Konstantinos P. Panousis A. Antoniadis S. Chatzis 58 5 0 10 Jan 2022
Stochastic Transformer Networks with Linear Competing Units: Application to end-to-end SL Translation Andreas Voskou Konstantinos P. Panousis D. Kosmopoulos Dimitris N. Metaxas S. Chatzis SLR 83 43 0 01 Sep 2021
Revisiting Deep Learning Models for Tabular Data Yu. V. Gorishniy Ivan Rubachev Valentin Khrulkov Artem Babenko LMTD 122 765 0 22 Jun 2021
Tabular Data: Deep Learning is Not All You Need Ravid Shwartz-Ziv Amitai Armon LMTD 159 1,275 0 06 Jun 2021
SAINT: Improved Neural Networks for Tabular Data via Row Attention and Contrastive Pre-Training Gowthami Somepalli Micah Goldblum Avi Schwarzschild C. Bayan Bruss Tom Goldstein LMTD 88 331 0 02 Jun 2021
TABBIE: Pretrained Representations of Tabular Data H. Iida Dung Ngoc Thai Varun Manjunatha Mohit Iyyer LMTD SSL VLM 73 176 0 06 May 2021
Position Information in Transformers: An Overview Philipp Dufter Martin Schmitt Hinrich Schütze 88 148 0 22 Feb 2021
TabTransformer: Tabular Data Modeling Using Contextual Embeddings Xin Huang A. Khetan Milan Cvitkovic Zohar Karnin ViT LMTD 207 457 0 11 Dec 2020
Gradient Boosting Neural Networks: GrowNet Sarkhan Badirli Xuanqing Liu Zhengming Xing Avradeep Bhowmik Khoa D. Doan S. Keerthi FedML 56 87 0 19 Feb 2020
NGBoost: Natural Gradient Boosting for Probabilistic Prediction Tony Duan Anand Avati D. Ding Khanh K. Thai S. Basu A. Ng Alejandro Schuler BDL 34 303 0 08 Oct 2019
Neural Oblivious Decision Ensembles for Deep Learning on Tabular Data Sergei Popov S. Morozov Artem Babenko LMTD 148 317 0 13 Sep 2019
TabNet: Attentive Interpretable Tabular Learning Sercan O. Arik Tomas Pfister LMTD 206 1,355 0 20 Aug 2019
Nonparametric Bayesian Deep Networks with Local Competition Konstantinos P. Panousis S. Chatzis Sergios Theodoridis BDL 79 32 0 19 May 2018

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.