Evaluating the Text-to-SQL Capabilities of Large Language Models

15 March 2022

Papers citing "Evaluating the Text-to-SQL Capabilities of Large Language Models"

50 / 65 papers shown

Title
SciReplicate-Bench: Benchmarking LLMs in Agent-driven Algorithmic Reproduction from Research Papers Yanzheng Xiang Hanqi Yan Shuyin Ouyang Lin Gui Yulan He 51 2 0 31 Mar 2025
OmniSQL: Synthesizing High-quality Text-to-SQL Data at Scale Haoyang Li Shang Wu Xiaokang Zhang Xinmei Huang J. Zhang ... Tieying Zhang Jianjun Chen Rui Shi Hongyu Chen C. Li SyDa 82 3 0 04 Mar 2025
Independent Mobility GPT (IDM-GPT): A Self-Supervised Multi-Agent Large Language Model Framework for Customized Traffic Mobility Analysis Using Machine Learning Models Fengze Yang Xiaoyue Cathy Liu Lingjiu Lu Bingzhang Wang Chenxi 40 0 0 25 Feb 2025
TableMaster: A Recipe to Advance Table Understanding with Language Models Lang Cao Hanbing Liu LMTD RALM 260 0 1 31 Jan 2025
ROUTE: Robust Multitask Tuning and Collaboration for Text-to-SQL Yang Qin Chao Chen Z. Fu Ze Chen Dezhong Peng Peng Hu Jieping Ye 105 2 0 13 Dec 2024
Tree-of-Table: Unleashing the Power of LLMs for Enhanced Large-Scale Table Understanding Deyi Ji Lanyun Zhu Siqi Gao Peng Xu Hongtao Lu Jieping Ye Feng Zhao PINN LMTD 52 3 0 13 Nov 2024
Grounding Natural Language to SQL Translation with Data-Based Self-Explanations Yuankai Fan Tonghui Ren Can Huang Zhenying He Xinyu Wang LRM 47 1 0 05 Nov 2024
TableRAG: Million-Token Table Understanding with Language Models Si-An Chen Lesly Miculicich Julian Martin Eisenschlos Zifeng Wang Zilong Wang Yanfei Chen Yasuhisa Fujii Hsuan-Tien Lin Chen-Yu Lee Tomas Pfister LMTD RALM 53 11 0 07 Oct 2024
Generating CAD Code with Vision-Language Models for 3D Designs Kamel Alrashedy Pradyumna Tambwekar Z. Zaidi Megan Langwasser Wei Xu Matthew Gombolay 44 8 0 07 Oct 2024
From Natural Language to SQL: Review of LLM-based Text-to-SQL Systems Ali Mohammadjafari Anthony Maida Raju N. Gottumukkala AI4TS 38 5 0 01 Oct 2024
DataGpt-SQL-7B: An Open-Source Language Model for Text-to-SQL Lixia Wu Peng Li Junhong Lou Lei Fu 22 4 0 24 Sep 2024
Next-Generation Database Interfaces: A Survey of LLM-based Text-to-SQL Zijin Hong Zheng Yuan Qinggang Zhang Hao Chen Junnan Dong Feiran Huang Xiao Huang 77 51 0 12 Jun 2024
CHESS: Contextual Harnessing for Efficient SQL Synthesis Shayan Talaei Mohammadreza Pourreza Yu-Chen Chang Azalia Mirhoseini Amin Saberi 46 52 0 27 May 2024
PURPLE: Making a Large Language Model a Better SQL Writer Tonghui Ren Yuankai Fan Zhenying He Ren Huang Jiaqi Dai Can Huang Yinan Jing Kai Zhang Yifan Yang Xiaoyang Sean Wang 25 22 0 29 Mar 2024
Couler: Unified Machine Learning Workflow Optimization in Cloud Xiaoda Wang Yuan-ju Tang Tengda Guo Bo Sang Jingji Wu Jian Sha Ke Zhang Jiang Qian Mingjie Tang 33 0 0 12 Mar 2024
Exploring the Potential of Large Language Models for Improving Digital Forensic Investigation Efficiency Akila Wickramasekara F. Breitinger Mark Scanlon 52 8 0 29 Feb 2024
Metasql: A Generate-then-Rank Framework for Natural Language to SQL Translation Yuankai Fan Zhenying He Tonghui Ren Can Huang Yinan Jing Kai Zhang Xiaoyang Sean Wang 30 12 0 27 Feb 2024
An LLM Maturity Model for Reliable and Transparent Text-to-Query Lei Yu Abir Ray 12 0 0 20 Feb 2024
Chain-of-Table: Evolving Tables in the Reasoning Chain for Table Understanding Zilong Wang Hao Zhang Chun-Liang Li Julian Martin Eisenschlos Vincent Perot ... Lesly Miculicich Yasuhisa Fujii Jingbo Shang Chen-Yu Lee Tomas Pfister ReLM LMTD LRM 46 92 0 09 Jan 2024
Semantic Parsing for Complex Data Retrieval: Targeting Query Plans vs. SQL for No-Code Access to Relational Databases Ben Eyal Amir Bachar Ophir Haroche Michael Elhadad 24 0 0 22 Dec 2023
FoMo Rewards: Can we cast foundation models as reward functions? Ekdeep Singh Lubana Johann Brehmer P. D. Haan Taco S. Cohen OffRL LRM 48 2 0 06 Dec 2023
DBCopilot: Natural Language Querying over Massive Databases via Schema Routing Tianshu Wang Hongyu Lin Hongyu Lin Le Sun Xiaoyang Chen Hao Wang Zhenyu Zeng 42 0 0 06 Dec 2023
Natural Language Interfaces for Tabular Data Querying and Visualization: A Survey Weixu Zhang Yifei Wang Yuanfeng Song Victor Junqiu Wei Yuxing Tian Yiyan Qi Jonathan H. Chan Raymond Chi-Wing Wong Haiqin Yang LMTD 46 16 0 27 Oct 2023
Battle of the Large Language Models: Dolly vs LLaMA vs Vicuna vs Guanaco vs Bard vs ChatGPT -- A Text-to-SQL Parsing Comparison Shuo Sun Yuchen Zhang Jiahuan Yan Yuze Gao Donovan Ong Bin Chen Jian Su ELM ALM 43 12 0 16 Oct 2023
Selective Demonstrations for Cross-domain Text-to-SQL Shuaichen Chang Eric Fosler-Lussier 20 19 0 10 Oct 2023
L2CEval: Evaluating Language-to-Code Generation Capabilities of Large Language Models Ansong Ni Pengcheng Yin Yilun Zhao Chen Wei Yanjun Wang ... Mingyuan Zhang Chen Change Loy Yingbo Zhou Dragomir R. Radev Arman Cohan ELM 32 18 0 29 Sep 2023
Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation Dawei Gao Haibin Wang Yaliang Li Xiuyu Sun Yichen Qian Bolin Ding Jingren Zhou AI4TS 62 244 0 29 Aug 2023
C3: Zero-shot Text-to-SQL with ChatGPT Xuemei Dong C. Zhang Yuhang Ge Yuren Mao Yunjun Gao Lu Chen Jinshu Lin Dongfang Lou 14 127 0 14 Jul 2023
Retrieval-augmented GPT-3.5-based Text-to-SQL Framework with Sample-aware Prompting and Dynamic Revision Chain Chunxi Guo Zhiliang Tian Jintao Tang Shasha Li Zhihua Wen Kaixuan Wang Ting Wang RALM 26 17 0 11 Jul 2023
Diverse Retrieval-Augmented In-Context Learning for Dialogue State Tracking Brendan King Jeffrey Flanigan 27 11 0 04 Jul 2023
Interleaving Pre-Trained Language Models and Large Language Models for Zero-Shot NL2SQL Generation Zihui Gu Ju Fan Nan Tang Songyue Zhang Yuxin Zhang Zui Chen Lei Cao Guoliang Li Sam Madden Xiaoyong Du 35 21 0 15 Jun 2023
Federated Learning for Semantic Parsing: Task Formulation, Evaluation Setup, New Algorithms Tianshu Zhang Changchang Liu Wei-Han Lee Yu-Chuan Su Huan Sun FedML 17 4 0 26 May 2023
UNITE: A Unified Benchmark for Text-to-SQL Evaluation Wuwei Lan Zhiguo Wang Anuj Chauhan Henghui Zhu A. Li ... Jiarong Jiang Stephen M. Ash Vittorio Castelli Patrick K. L. Ng Bing Xiang ELM LMTD 29 8 0 25 May 2023
Exploring Chain-of-Thought Style Prompting for Text-to-SQL Chang-You Tai Ziru Chen Tianshu Zhang Xiang Deng Huan Sun LRM AI4CE ReLM 30 45 0 23 May 2023
Skill-Based Few-Shot Selection for In-Context Learning Shengnan An Bo Zhou Zeqi Lin Qiang Fu B. Chen Nanning Zheng Weizhu Chen Jian-Guang Lou 36 31 0 23 May 2023
Generating Data for Symbolic Language with Large Language Models Jiacheng Ye Chengzu Li Lingpeng Kong Tao Yu 33 10 0 23 May 2023
Neural Machine Translation for Code Generation K. Dharma Clayton T. Morrison 32 4 0 22 May 2023
Enhancing Few-shot Text-to-SQL Capabilities of Large Language Models: A Study on Prompt Design Strategies Linyong Nan Yilun Zhao Weijin Zou Narutatsu Ri Jaesung Tae Ellen Zhang Arman Cohan Dragomir R. Radev LMTD 30 47 0 21 May 2023
How to Prompt LLMs for Text-to-SQL: A Study in Zero-shot, Single-domain, and Cross-domain Settings Shuaichen Chang Eric Fosler-Lussier LRM 16 59 0 19 May 2023
Text2Cohort: Facilitating Intuitive Access to Biomedical Data with Natural Language Cohort Discovery Pranav Kulkarni Adway U. Kanhere P. Yi Vishwa S. Parekh 27 0 0 12 May 2023
Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLs Jinyang Li Binyuan Hui Ge Qu Jiaxi Yang Binhua Li ... Guoliang Li Kevin C. C. Chang Fei Huang Reynold Cheng Yongbin Li LMTD 59 363 0 04 May 2023
Prompting GPT-3.5 for Text-to-SQL with De-semanticization and Skeleton Retrieval Chunxi Guo Zhiliang Tian Jintao Tang Pancheng Wang Zhihua Wen Kang Yang Ting Wang 35 19 0 26 Apr 2023
Divide and Prompt: Chain of Thought Prompting for Text-to-SQL X. Liu Zhao Tan ReLM LRM 37 14 0 23 Apr 2023
DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correction Mohammadreza Pourreza Davood Rafiei ReLM LRM 29 313 0 21 Apr 2023
Why Does ChatGPT Fall Short in Providing Truthful Answers? Shen Zheng Jie Huang Kevin Chen-Chuan Chang HILM AI4MH 24 51 0 20 Apr 2023
Teaching Large Language Models to Self-Debug Xinyun Chen Maxwell Lin Nathanael Scharli Denny Zhou LRM 38 641 0 11 Apr 2023
Towards Understanding the Generalization of Medical Text-to-SQL Models and Datasets Richard Tarbell Kim-Kwang Raymond Choo Glenn Dietrich Anthony Rios 18 9 0 22 Mar 2023
Large Language Models and Simple, Stupid Bugs Kevin Jesse Toufique Ahmed Prem Devanbu Emily Morgan ELM 39 51 0 20 Mar 2023
Mirror: A Natural Language Interface for Data Querying, Summarization, and Visualization Canwen Xu Julian McAuley Penghan Wang VLM 24 4 0 15 Mar 2023
A comprehensive evaluation of ChatGPT's zero-shot Text-to-SQL capability Aiwei Liu Xuming Hu Lijie Wen Philip S. Yu LMTD AI4MH 82 149 0 12 Mar 2023