Testing the Limits of Unified Sequence to Sequence LLM Pretraining on
Diverse Table Data Tasks

Testing the Limits of Unified Sequence to Sequence LLM Pretraining on Diverse Table Data Tasks

1 October 2023

Soumajyoti Sarkar

Leonard Lausen

Papers citing "Testing the Limits of Unified Sequence to Sequence LLM Pretraining on Diverse Table Data Tasks"

8 / 8 papers shown

Title
iTBLS: A Dataset of Interactive Conversations Over Tabular Information Anirudh S. Sundar Christopher Richardson William Gay Larry Heck LMTD 52 1 0 19 Apr 2024
Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Survey Xi Fang Weijie Xu Fiona Anting Tan Jiani Zhang Ziqing Hu Yanjun Qi Scott Nickleach Diego Socolinsky Srinivasan H. Sengamedu Christos Faloutsos LMTD ALM 62 66 0 27 Feb 2024
ReasTAP: Injecting Table Reasoning Skills During Pre-training via Synthetic Reasoning Examples Yilun Zhao Linyong Nan Zhenting Qi Rui Zhang Dragomir R. Radev ReLM LMTD LRM 55 36 0 22 Oct 2022
Table Pre-training: A Survey on Model Architectures, Pre-training Objectives, and Downstream Tasks Haoyu Dong Zhoujun Cheng Xinyi He Mengyuan Zhou Anda Zhou Fan Zhou Ao Liu Shi Han Dongmei Zhang LMTD 65 64 0 24 Jan 2022
Multitask Prompted Training Enables Zero-Shot Task Generalization Victor Sanh Albert Webson Colin Raffel Stephen H. Bach Lintang Sutawika ... T. Bers Stella Biderman Leo Gao Thomas Wolf Alexander M. Rush LRM 221 1,664 0 15 Oct 2021
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation Yue Wang Weishi Wang Shafiq Joty Guosheng Lin 252 1,512 0 02 Sep 2021
Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skills Ori Yoran Alon Talmor Jonathan Berant ReLM LRM 183 53 0 15 Jul 2021
TabTransformer: Tabular Data Modeling Using Contextual Embeddings Xin Huang A. Khetan Milan Cvitkovic Zohar Karnin ViT LMTD 159 420 0 11 Dec 2020