Semantic Evaluation for Text-to-SQL with Distilled Test Suites

6 October 2020

Ruiqi Zhong

Papers citing "Semantic Evaluation for Text-to-SQL with Distilled Test Suites"

28 / 28 papers shown

Title
Graph-Reward-SQL: Execution-Free Reinforcement Learning for Text-to-SQL via Graph Matching and Stepwise Reward Han Weng Boyi Liu Yuanfeng Song Dun Zeng Yingxiang Yang Yi Zhan Longjie Cui Xiaoming Yin Yang Sun 12 0 0 18 May 2025
LLMs Get Lost In Multi-Turn Conversation Philippe Laban Hiroaki Hayashi Yingbo Zhou Jennifer Neville 53 3 0 09 May 2025
VTS-LLM: Domain-Adaptive LLM Agent for Enhancing Awareness in Vessel Traffic Services through Natural Language Sijin Sun Liangbin Zhao Ming Deng Xiuju Fu 28 0 0 02 May 2025
When Reasoning Beats Scale: A 1.5B Reasoning Model Outranks 13B LLMs as Discriminator Md Fahim Anjum LRM 34 0 0 30 Apr 2025
DB-Explore: Automated Database Exploration and Instruction Synthesis for Text-to-SQL Haoyuan Ma Yongliang Shen Hengwei Liu Wenqi Zhang Haolei Xu Qiuying Peng Jun Wang Weiming Lu 49 2 0 06 Mar 2025
Grounding Natural Language to SQL Translation with Data-Based Self-Explanations Yuankai Fan Tonghui Ren Can Huang Zhenying He Xinyu Wang LRM 50 1 0 05 Nov 2024
RH-SQL: Refined Schema and Hardness Prompt for Text-to-SQL J. Yi Guo Chen Zixiang Shen 41 1 0 13 Jun 2024
PURPLE: Making a Large Language Model a Better SQL Writer Tonghui Ren Yuankai Fan Zhenying He Ren Huang Jiaqi Dai Can Huang Yinan Jing Kai Zhang Yifan Yang Xiaoyang Sean Wang 35 22 0 29 Mar 2024
AraSpider: Democratizing Arabic-to-SQL Ahmed Heakl Youssef Mohamed A. Zaky 38 0 0 12 Feb 2024
Using LLM to select the right SQL Query from candidates Zhenwen Li Tao Xie LLMAG 38 9 0 04 Jan 2024
MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQL Bing Wang Changyu Ren Jian Yang Xinnian Liang Jiaqi Bai ... Zhao Yan Qian-Wen Zhang Di Yin Xing Sun Zhoujun Li 36 54 0 18 Dec 2023
LLM-SQL-Solver: Can LLMs Determine SQL Equivalence? Fuheng Zhao Lawrence Lim Ishtiyaque Ahmad D. Agrawal A. El Abbadi Amr El Abbadi 65 10 0 16 Dec 2023
Selective Demonstrations for Cross-domain Text-to-SQL Shuaichen Chang Eric Fosler-Lussier 20 19 0 10 Oct 2023
Divide and Prompt: Chain of Thought Prompting for Text-to-SQL X. Liu Zhao Tan ReLM LRM 37 14 0 23 Apr 2023
RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQL Haoyang Li Jing Zhang Cuiping Li Hong Chen 32 175 0 12 Feb 2023
OFASys: A Multi-Modal Multi-Task Learning System for Building Generalist Models Jinze Bai Rui Men Han Yang Xuancheng Ren Kai Dang ... Wenhang Ge Jianxin Ma Junyang Lin Jingren Zhou Chang Zhou 37 15 0 08 Dec 2022
Calibrated Interpretation: Confidence Estimation in Semantic Parsing Elias Stengel-Eskin Benjamin Van Durme UQLM 41 24 0 14 Nov 2022
DocuT5: Seq2seq SQL Generation with Table Documentation E. Soare Iain Mackie Jeffrey Stephen Dalton LMTD 44 2 0 11 Nov 2022
XRICL: Cross-lingual Retrieval-Augmented In-Context Learning for Cross-lingual Text-to-SQL Semantic Parsing Peng Shi Rui Zhang Richard He Bai Jimmy J. Lin RALM 41 42 0 25 Oct 2022
Non-Programmers Can Label Programs Indirectly via Active Examples: A Case Study with Text-to-SQL Ruiqi Zhong Charles Burton Snell Dan Klein Jason Eisner 24 8 0 25 May 2022
Natural Language to Code Translation with Execution Freda Shi Daniel Fried Marjan Ghazvininejad Luke Zettlemoyer Sida I. Wang 40 124 0 25 Apr 2022
Evaluating the Text-to-SQL Capabilities of Large Language Models Nitarshan Rajkumar Raymond Li Dzmitry Bahdanau LMTD ELM 32 100 0 15 Mar 2022
UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Models Tianbao Xie Chen Henry Wu Peng Shi Ruiqi Zhong Torsten Scholak ... Lingpeng Kong Rui Zhang Noah A. Smith Luke Zettlemoyer Tao Yu LMTD 39 297 0 16 Jan 2022
mRAT-SQL+GAP:A Portuguese Text-to-SQL Transformer M. A. José Fabio Gagliardi Cozman LMTD 32 11 0 07 Oct 2021
PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models Torsten Scholak Nathan Schucher Dzmitry Bahdanau 156 377 0 10 Sep 2021
KaggleDBQA: Realistic Evaluation of Text-to-SQL Parsers Chia-Hsuan Lee Oleksandr Polozov Matthew Richardson LMTD RALM 26 86 0 22 Jun 2021
MT-Teql: Evaluating and Augmenting Consistency of Text-to-SQL Models with Metamorphic Testing Pingchuan Ma Shuai Wang 16 2 0 21 Dec 2020
DuoRAT: Towards Simpler Text-to-SQL Models Torsten Scholak Raymond Li Dzmitry Bahdanau H. D. Vries C. Pal AI4TS 35 27 0 21 Oct 2020