Evaluating the Text-to-SQL Capabilities of Large Language Models

Evaluating the Text-to-SQL Capabilities of Large Language Models

15 March 2022

Nitarshan Rajkumar

Dzmitry Bahdanau

Papers citing "Evaluating the Text-to-SQL Capabilities of Large Language Models"

15 / 65 papers shown

Title
LEVER: Learning to Verify Language-to-Code Generation with Execution Ansong Ni Srini Iyer Dragomir R. Radev Ves Stoyanov Wen-tau Yih Sida I. Wang Xi Lin 29 211 0 16 Feb 2023
On Robustness of Prompt-based Semantic Parsing with Large Pre-trained Language Model: An Empirical Study on Codex Terry Yue Zhuo Zhuang Li Yujin Huang Fatemeh Shiri Weiqing Wang Gholamreza Haffari Yuan-Fang Li AAML 34 54 0 30 Jan 2023
Dr.Spider: A Diagnostic Evaluation Benchmark towards Text-to-SQL Robustness Shuaichen Chang Jun Wang Mingwen Dong Lin Pan Henghui Zhu ... William Yang Wang Zhiguo Wang Vittorio Castelli Patrick Ng Bing Xiang OOD 46 34 0 21 Jan 2023
Don't Generate, Discriminate: A Proposal for Grounding Language Models to Real-World Environments Yu Gu Xiang Deng Yu-Chuan Su LLMAG 42 52 0 19 Dec 2022
Large Language Models Meet NL2Code: A Survey Daoguang Zan B. Chen Fengji Zhang Di Lu Bingchao Wu Bei Guan Yongji Wang Jian-Guang Lou ELM ALM 31 171 0 19 Dec 2022
Natural Language to Code Generation in Interactive Data Science Notebooks Pengcheng Yin Wen-Ding Li Kefan Xiao Abhishek Rao Yeming Wen ... Paige Bailey Michele Catasta Henryk Michalewski Oleksandr Polozov Charles Sutton 33 59 0 19 Dec 2022
XRICL: Cross-lingual Retrieval-Augmented In-Context Learning for Cross-lingual Text-to-SQL Semantic Parsing Peng Shi Rui Zhang Richard He Bai Jimmy J. Lin RALM 41 42 0 25 Oct 2022
Binding Language Models in Symbolic Languages Zhoujun Cheng Tianbao Xie Peng Shi Chengzu Li Rahul Nadkarni ... Dragomir R. Radev Mari Ostendorf Luke Zettlemoyer Noah A. Smith Tao Yu LMTD 134 199 0 06 Oct 2022
Learning by Distilling Context Charles Burton Snell Dan Klein Ruiqi Zhong ReLM LRM 174 44 0 30 Sep 2022
NL2INTERFACE: Interactive Visualization Interface Generation from Natural Language Queries Yiru Chen Ryan Li Austin Mac Tianbao Xie Tao Yu Eugene Wu 44 12 0 19 Sep 2022
A Survey on Text-to-SQL Parsing: Concepts, Methods, and Future Directions Bowen Qin Binyuan Hui Lihan Wang Min Yang Jinyang Li ... Rongyu Cao Jian Sun Luo Si Fei Huang Yongbin Li LMTD 35 52 0 29 Aug 2022
Evaluating the Impact of Model Scale for Compositional Generalization in Semantic Parsing Linlu Qiu Peter Shaw Panupong Pasupat Tianze Shi Jonathan Herzig Emily Pitler Fei Sha Kristina Toutanova AI4CE LRM 35 52 0 24 May 2022
CodexDB: Generating Code for Processing SQL Queries using GPT-3 Codex Immanuel Trummer LMTD 29 19 0 19 Apr 2022
In-Context Learning for Few-Shot Dialogue State Tracking Yushi Hu Chia-Hsuan Lee Tianbao Xie Tao Yu Noah A. Smith Mari Ostendorf BDL 27 59 0 16 Mar 2022
PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models Torsten Scholak Nathan Schucher Dzmitry Bahdanau 156 376 0 10 Sep 2021