XTab: Cross-table Pretraining for Tabular Transformers

10 May 2023

George Karypis

Papers citing "XTab: Cross-table Pretraining for Tabular Transformers"

50 / 51 papers shown

Title
Griffin: Towards a Graph-Centric Relational Database Foundation Model Yanbo Wang Xiyuan Wang Quan Gan Minjie Wang Qibin Yang David Wipf Muhan Zhang 97 0 0 08 May 2025
Representation Learning for Tabular Data: A Comprehensive Survey Jun-Peng Jiang Si-Yang Liu Hao-Run Cai Qile Zhou Han-Jia Ye LMTD 46 0 0 17 Apr 2025
Datum-wise Transformer for Synthetic Tabular Data Detection in the Wild G. C. N. Kindji Elisa Fromont L. Rojas-Barahona Tanguy Urvoy 37 0 0 10 Apr 2025
TabKAN: Advancing Tabular Data Analysis using Kolmogorov-Arnold Network Ali Eslamian Alireza Afzal Aghaei Qiang Cheng LMTD 80 0 0 09 Apr 2025
AutoML Benchmark with shorter time constraints and early stopping Israel Campero Jurado Pieter Gijsbers Joaquin Vanschoren AI4TS 110 0 0 01 Apr 2025
A Closer Look at TabPFN v2: Strength, Limitation, and Extension Han-Jia Ye Si-Yang Liu Wei-Lun Chao 41 3 0 24 Feb 2025
In-context learning of evolving data streams with tabular foundational models Afonso Lourenço João Gama Eric P. Xing Goreti Marreiros 64 0 0 24 Feb 2025
Tabular Embeddings for Tables with Bi-Dimensional Hierarchical Metadata and Nesting Gyanendra Shrestha Chutain Jiang Sai Akula Vivek Yannam Anna Pyayt Michael Gubanov LMTD 97 0 0 20 Feb 2025
TabICL: A Tabular Foundation Model for In-Context Learning on Large Data Jingang Qu David Holzmüller Gaël Varoquaux Marine Le Morvan LMTD 86 5 0 08 Feb 2025
TabPFN Unleashed: A Scalable and Effective Solution to Tabular Classification Problems Si-Yang Liu Han-Jia Ye 68 6 0 04 Feb 2025
Improving LLM Group Fairness on Tabular Data via In-Context Learning Valeriia Cherepanova Chia-Jung Lee Nil-Jana Akpinar Riccardo Fogliato Martín Bertrán Michael Kearns James Zou LMTD 73 0 0 05 Dec 2024
TableGPT2: A Large Multimodal Model with Tabular Data Integration Aofeng Su Aowen Wang Chao Ye Chen Zhou G. Zhang ... Xijun Gu Xingchen Sun Xianrui Li Yuqing Yang Zhiqing Xiao PINN VLM LMTD 67 11 0 04 Nov 2024
TabDPT: Scaling Tabular Foundation Models Junwei Ma Valentin Thomas Rasa Hosseinzadeh Hamidreza Kamkari Alex Labach Jesse C. Cresswell Keyvan Golestan Guangwei Yu M. Volkovs Anthony L. Caterini LMTD 36 3 0 23 Oct 2024
PORTAL: Scalable Tabular Foundation Models via Content-Specific Tokenization Marco Spinaci Marek Polewczyk Johannes Hoffart Markus C. Kohler Sam Thelin Tassilo Klein LMTD 28 2 0 17 Oct 2024
A Survey on Deep Tabular Learning Shriyank Somvanshi Subasish Das Syed Aaqib Javed Gian Antariksa Ahmed Hossain LMTD 34 7 0 15 Oct 2024
Scalable Representation Learning for Multimodal Tabular Transactions Natraj Raman Sumitra Ganesh Manuela Veloso LMTD 33 0 0 10 Oct 2024
T-JEPA: Augmentation-Free Self-Supervised Learning for Tabular Data Hugo Thimonier José Lucas De Melo Costa Fabrice Popineau Arpad Rimmel Bich-Liên Doan 53 1 0 07 Oct 2024
Tabular Transfer Learning via Prompting LLMs Jaehyun Nam Woomin Song Seong Hyeon Park Jihoon Tack Sukmin Yun Jaehyung Kim Kyu Hwan Oh Jinwoo Shin RALM LMTD VPVLM 36 2 0 09 Aug 2024
PTaRL: Prototype-based Tabular Representation Learning via Space Calibration Hangting Ye Wei Fan Xiaozhuang Song Shun Zheng He Zhao Dandan Guo Yi Chang OOD 42 18 0 07 Jul 2024
Artificial Inductive Bias for Synthetic Tabular Data Generation in Data-Scarce Scenarios Patricia A. Apellániz Ana Jiménez Borja Arroyo Galende J. Parras Santiago Zazo 57 1 0 03 Jul 2024
Causality for Tabular Data Synthesis: A High-Order Structure Causal Benchmark Framework Ruibo Tu Zineb Senane Lele Cao Cheng Zhang Hedvig Kjellström G. Henter CML 51 4 0 12 Jun 2024
Optimized Feature Generation for Tabular Data via LLMs with Decision Tree Reasoning Jaehyun Nam Kyuyoung Kim Seunghyuk Oh Jihoon Tack Jaehyung Kim Jinwoo Shin LMTD 39 9 0 12 Jun 2024
CTSyn: A Foundational Model for Cross Tabular Data Generation Xiaofeng Lin Chenheng Xu Matthew Yang Guang Cheng 43 3 0 07 Jun 2024
Cross-Table Pretraining towards a Universal Function Space for Heterogeneous Tabular Data Jintai Chen Zhen Lin Qiyuan Chen Jimeng Sun LMTD 38 0 0 01 Jun 2024
Binning as a Pretext Task: Improving Self-Supervised Learning in Tabular Domains Kyungeun Lee Ye Seul Sim Hye-Seung Cho Moonjung Eo Suhee Yoon Sanghyu Yoon Woohyung Lim SSL 35 5 0 13 May 2024
Why Tabular Foundation Models Should Be a Research Priority B. V. Breugel M. Schaar LMTD VLM AI4CE 39 33 0 02 May 2024
Large Language Models Can Automatically Engineer Features for Few-Shot Tabular Learning Sungwon Han Jinsung Yoon Sercan Ö. Arik Tomas Pfister LMTD 40 23 0 15 Apr 2024
PyTorch Frame: A Modular Framework for Multi-Modal Tabular Learning Weihua Hu Yiwen Yuan Zecheng Zhang Akihiro Nitta Kaidi Cao Vid Kocijan J. Leskovec Matthias Fey LMTD 39 11 0 31 Mar 2024
Unleashing the Potential of Large Language Models for Predictive Tabular Tasks in Data Science Yazheng Yang Yuqi Wang Sankalok Sen Lei Li Qi Liu LMTD 46 9 0 29 Mar 2024
Making Pre-trained Language Models Great on Tabular Prediction Jiahuan Yan Bo Zheng Hongxia Xu Yiheng Zhu Danny Chen Jimeng Sun Jian Wu Jintai Chen LMTD 39 37 0 04 Mar 2024
Federated Learning for Estimating Heterogeneous Treatment Effects Disha Makhija Joydeep Ghosh Yejin Kim CML FedML 43 2 0 27 Feb 2024
CARTE: Pretraining and Transfer for Tabular Learning Myung Jun Kim Léo Grinsztajn Gaël Varoquaux LMTD 62 13 0 26 Feb 2024
Learning a Decision Tree Algorithm with Transformers Yufan Zhuang Liyuan Liu Chandan Singh Jingbo Shang Jianfeng Gao 44 5 0 06 Feb 2024
A Survey on Self-Supervised Learning for Non-Sequential Tabular Data Wei-Yao Wang Wei-Wei Du Derek Xu Wei Wang Wenjie Peng LMTD 38 7 0 02 Feb 2024
Fusing Echocardiography Images and Medical Records for Continuous Patient Stratification Nathan Painchaud P. Courand Pierre-Marc Jodoin Nicolas Duchateau Olivier Bernard 39 2 0 15 Jan 2024
Mixture Data for Training Cannot Ensure Out-of-distribution Generalization Songming Zhang Yuxiao Luo Qizhou Wang Haoang Chi Xiaofeng Chen Bo Han Jinyan Li OODD 30 0 0 25 Dec 2023
Relational Deep Learning: Graph Representation Learning on Relational Databases Matthias Fey Weihua Hu Kexin Huang J. E. Lenssen Rishabh Ranjan Joshua Robinson Rex Ying Jiaxuan You J. Leskovec GNN 45 30 0 07 Dec 2023
Fine-Tuning the Retrieval Mechanism for Tabular Deep Learning Felix den Breejen Sangmin Bae Stephen Cha Tae-Young Kim Seoung Hyun Koh SeYoung Yun 35 3 0 13 Nov 2023
A Performance-Driven Benchmark for Feature Selection in Tabular Deep Learning Valeriia Cherepanova Roman Levin Gowthami Somepalli Jonas Geiping C. Bayan Bruss Andrew Gordon Wilson Tom Goldstein Micah Goldblum 28 18 0 10 Nov 2023
TabRepo: A Large Scale Repository of Tabular Model Evaluations and its AutoML Applications David Salinas Nick Erickson 24 10 0 06 Nov 2023
Unlocking the Transferability of Tokens in Deep Models for Tabular Data Qi-Le Zhou Han-Jia Ye Le-Ye Wang De-Chuan Zhan 29 7 0 23 Oct 2023
UniPredict: Large Language Models are Universal Tabular Classifiers Ruiyu Wang Zifeng Wang Jimeng Sun LMTD 16 1 0 05 Oct 2023
Scaling Experiments in Self-Supervised Cross-Table Representation Learning Maximilian Schambach Dominique Paul Wei Le LMTD 33 2 0 29 Sep 2023
Pretrained deep models outperform GBDTs in Learning-To-Rank under label scarcity Charlie Hou K. K. Thekumparampil Michael Shavlovsky Giulia Fanti Yesh Dattatreya Sujay Sanghavi LMTD 21 1 0 31 Jul 2023
MediTab: Scaling Medical Tabular Data Predictors via Data Consolidation, Enrichment, and Refinement Zifeng Wang Chufan Gao Cao Xiao Jimeng Sun LMTD 28 12 0 20 May 2023
When Do Neural Nets Outperform Boosted Trees on Tabular Data? Duncan C. McElfresh Sujay Khandagale Jonathan Valverde C. VishakPrasad Ben Feuer Chinmay Hegde Ganesh Ramakrishnan Micah Goldblum Colin White LMTD 34 132 0 04 May 2023
Topology-aware Federated Learning in Edge Computing: A Comprehensive Survey Jiajun Wu Steve Drew Fan Dong Zhuangdi Zhu Jiayu Zhou FedML 53 46 0 06 Feb 2023
ExcelFormer: A neural network surpassing GBDTs on tabular data Jintai Chen Jiahuan Yan Qiyuan Chen Danny Chen Jian Wu Jimeng Sun LMTD 43 22 0 07 Jan 2023
Transfer Learning with Deep Tabular Models Roman Levin Valeriia Cherepanova Avi Schwarzschild Arpit Bansal C. Bayan Bruss Tom Goldstein A. Wilson Micah Goldblum OOD FedML LMTD 75 58 0 30 Jun 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 308 7,443 0 11 Nov 2021