MT-Teql: Evaluating and Augmenting Consistency of Text-to-SQL Models with Metamorphic Testing

21 December 2020

Papers citing "MT-Teql: Evaluating and Augmenting Consistency of Text-to-SQL Models with Metamorphic Testing"

20 / 20 papers shown

Title
"What Do You Mean by That?" A Parser-Independent Interactive Approach for Enhancing Text-to-SQL Yuntao Li Bei Chen Qian Liu Yan Gao Jian-Guang Lou Yan Zhang Dongmei Zhang 35 16 0 09 Nov 2020
Semantic Evaluation for Text-to-SQL with Distilled Test Suites Ruiqi Zhong Tao Yu Dan Klein 62 134 0 06 Oct 2020
Astraea: Grammar-based Fairness Testing E. Soremekun Sakshi Udeshi Sudipta Chattopadhyay 111 30 0 06 Oct 2020
A Tale of Two Linkings: Dynamically Gating between Schema Linking and Structural Linking for Text-to-SQL Parsing Sanxing Chen Aidan San Xiaodong Liu Yangfeng Ji 55 8 0 30 Sep 2020
GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsing Tao Yu Chien-Sheng Wu Xi Lin Bailin Wang Y. Tan Xinyi Yang Dragomir R. Radev R. Socher Caiming Xiong LMTD 95 254 0 29 Sep 2020
Task-Oriented Dialogue as Dataflow Synthesis Semantic Machines Jacob Andreas J. Bufe David Burkett Charles C. Chen ... Izabela Witoszko Jason Wolfe A. Wray Yuchen Zhang Alexander Zotov AIFin 214 160 0 24 Sep 2020
Photon: A Robust Cross-Domain Text-to-SQL System Jichuan Zeng Xi Lin Caiming Xiong R. Socher Michael R. Lyu Irwin King Guosheng Lin 73 52 0 30 Jul 2020
Beyond Accuracy: Behavioral Testing of NLP models with CheckList Marco Tulio Ribeiro Tongshuang Wu Carlos Guestrin Sameer Singh ELM 208 1,107 0 08 May 2020
RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain Databases Donghyun Choi M. Shin EungGyun Kim Dong Ryeol Shin 71 128 0 07 Apr 2020
RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers Bailin Wang Richard Shin Xiaodong Liu Oleksandr Polozov Matthew Richardson 92 592 0 10 Nov 2019
Global Reasoning over Database Structures for Text-to-SQL Parsing Ben Bogin Matt Gardner Jonathan Berant 3DV NAI 72 104 0 29 Aug 2019
Structure-Invariant Testing for Machine Translation Pinjia He Clara Meister Z. Su 54 105 0 19 Jul 2019
Towards Complex Text-to-SQL in Cross-Domain Database with Intermediate Representation Jiaqi Guo Zecheng Zhan Yan Gao Yan Xiao Jian-Guang Lou Ting Liu Dongmei Zhang 58 384 0 20 May 2019
Representing Schema Structure with Graph Neural Networks for Text-to-SQL Parsing Ben Bogin Matt Gardner Jonathan Berant NAI GNN 45 181 0 15 May 2019
SyntaxSQLNet: Syntax Tree Networks for Complex and Cross-DomainText-to-SQL Task Tao Yu Michihiro Yasunaga Kai-Chou Yang Rui Zhang Dongxu Wang Zifan Li Dragomir R. Radev 43 189 0 11 Oct 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,175 0 11 Oct 2018
Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Task Tao Yu Rui Zhang Kai-Chou Yang Michihiro Yasunaga Dongxu Wang ... Irene Li Qingning Yao Shanelle Roman Zilin Zhang Dragomir R. Radev RALM 114 1,243 0 24 Sep 2018
TypeSQL: Knowledge-based Type-Aware Neural Text-to-SQL Generation Tao Yu Zifan Li Zilin Zhang Rui Zhang Dragomir R. Radev 62 258 0 25 Apr 2018
SQLNet: Generating Structured Queries From Natural Language Without Reinforcement Learning Xiaojun Xu Chang-rui Liu Basel Alomair AI4TS 59 408 0 13 Nov 2017
Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning Victor Zhong Caiming Xiong R. Socher RALM 134 1,205 0 31 Aug 2017