KaggleDBQA: Realistic Evaluation of Text-to-SQL Parsers

22 June 2021

Papers citing "KaggleDBQA: Realistic Evaluation of Text-to-SQL Parsers"

26 / 26 papers shown

Title
MultiTEND: A Multilingual Benchmark for Natural Language to NoSQL Query Translation Zhiqian Qin Yuanfeng Song Jinwei Lu Yuanwei Song Shuaimin Li Chen Zhang 46 0 0 16 Feb 2025
Is Long Context All You Need? Leveraging LLM's Extended Context for NL2SQL Yeounoh Chung Gaurav Tarlok Kakkar Yu Gan Brenton Milne Fatma Ozcan RALM 63 5 0 21 Jan 2025
Confidence Estimation for Error Detection in Text-to-SQL Systems Oleg Somov Elena Tutubalina 43 1 0 17 Jan 2025
Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows Fangyu Lei Jixuan Chen Yuxiao Ye Ruisheng Cao Dongchan Shin ... Caiming Xiong Ruoxi Sun Qian Liu Sida I. Wang Tao Yu LMTD 79 21 0 12 Nov 2024
From Natural Language to SQL: Review of LLM-based Text-to-SQL Systems Ali Mohammadjafari Anthony Maida Raju N. Gottumukkala AI4TS 36 5 0 01 Oct 2024
AMBROSIA: A Benchmark for Parsing Ambiguous Questions into Database Queries Irina Saparina Mirella Lapata 57 11 0 27 Jun 2024
AnnotatedTables: A Large Tabular Dataset with Language Model Annotations Yaojie Hu Ilias Fountalis Jin Tian N. Vasiloglou LMTD 36 3 0 24 Jun 2024
BookSQL: A Large Scale Text-to-SQL Dataset for Accounting Domain Rahul Kumar Amar Raja Dibbu Shrutendra Harsola Vignesh T. Subrahmaniam Ashutosh Modi 26 6 0 12 Jun 2024
Next-Generation Database Interfaces: A Survey of LLM-based Text-to-SQL Zijin Hong Zheng Yuan Qinggang Zhang Hao Chen Junnan Dong Feiran Huang Xiao Huang 69 50 0 12 Jun 2024
Towards Unbiased Evaluation of Detecting Unanswerable Questions in EHRSQL Yongjin Yang Sihyeon Kim Sangmook Kim Gyubok Lee Se-Young Yun Edward Choi 33 2 0 29 Apr 2024
Is Table Retrieval a Solved Problem? Exploring Join-Aware Multi-Table Retrieval Peter Baile Chen Yi Zhang Dan Roth LMTD 49 12 0 15 Apr 2024
Archer: A Human-Labeled Text-to-SQL Dataset with Arithmetic, Commonsense and Hypothetical Reasoning Danna Zheng Mirella Lapata Jeff Z. Pan RALM 37 6 0 19 Feb 2024
Improving Demonstration Diversity by Human-Free Fusing for Text-to-SQL Dingzirui Wang Longxu Dou Xuanliang Zhang Qingfu Zhu Wanxiang Che 31 7 0 16 Feb 2024
LLM-SQL-Solver: Can LLMs Determine SQL Equivalence? Fuheng Zhao Lawrence Lim Ishtiyaque Ahmad D. Agrawal A. El Abbadi Amr El Abbadi 65 9 0 16 Dec 2023
Selective Demonstrations for Cross-domain Text-to-SQL Shuaichen Chang Eric Fosler-Lussier 15 19 0 10 Oct 2023
Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLs Jinyang Li Binyuan Hui Ge Qu Jiaxi Yang Binhua Li ... Guoliang Li Kevin C. C. Chang Fei Huang Reynold Cheng Yongbin Li LMTD 41 359 0 04 May 2023
Dr.Spider: A Diagnostic Evaluation Benchmark towards Text-to-SQL Robustness Shuaichen Chang Jun Wang Mingwen Dong Lin Pan Henghui Zhu ... William Yang Wang Zhiguo Wang Vittorio Castelli Patrick K. L. Ng Bing Xiang OOD 41 34 0 21 Jan 2023
Structured Case-based Reasoning for Inference-time Adaptation of Text-to-SQL parsers Abhijeet Awasthi Soumen Chakrabarti Sunita Sarawagi 25 5 0 10 Jan 2023
Natural Language to Code Generation in Interactive Data Science Notebooks Pengcheng Yin Wen-Ding Li Kefan Xiao Abhishek Rao Yeming Wen ... Paige Bailey Michele Catasta Henryk Michalewski Oleksandr Polozov Charles Sutton 33 56 0 19 Dec 2022
Diverse Parallel Data Synthesis for Cross-Database Adaptation of Text-to-SQL Parsers Abhijeet Awasthi Ashutosh Sathe Sunita Sarawagi 35 4 0 29 Oct 2022
XRICL: Cross-lingual Retrieval-Augmented In-Context Learning for Cross-lingual Text-to-SQL Semantic Parsing Peng Shi Rui Zhang Richard He Bai Jimmy J. Lin RALM 20 42 0 25 Oct 2022
State-of-the-art generalisation research in NLP: A taxonomy and review Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Ryan Cotterell Zhijing Jin 114 93 0 06 Oct 2022
WildQA: In-the-Wild Video Question Answering Santiago Castro Naihao Deng Pingxuan Huang Mihai Burzo Rada Mihalcea 70 7 0 14 Sep 2022
Knowledge Base Question Answering: A Semantic Parsing Perspective Yu Gu Vardaan Pahuja Gong Cheng Yu-Chuan Su 34 29 0 12 Sep 2022
Did You Ask a Good Question? A Cross-Domain Question Intention Classification Benchmark for Text-to-SQL Yusen Zhang Xiangyu Dong Shuaichen Chang Tao Yu Peng Shi Rui Zhang OOD 45 15 0 23 Oct 2020
Towards Ecologically Valid Research on Language User Interfaces H. D. Vries Dzmitry Bahdanau Christopher D. Manning 212 51 0 28 Jul 2020