SGD-X: A Benchmark for Robust Generalization in Schema-Guided Dialogue Systems

13 October 2021

Papers citing "SGD-X: A Benchmark for Robust Generalization in Schema-Guided Dialogue Systems"

29 / 29 papers shown

Title
Generative Induction of Dialogue Task Schemas with Streaming Refinement and Simulated Interactions James D. Finch Yasasvi Josyula Jinho D. Choi 38 0 0 25 Apr 2025
MTU-Bench: A Multi-granularity Tool-Use Benchmark for Large Language Models Pei Wang Yanan Wu Zekun Wang Jiaheng Liu Xiaoshuai Song ... Ge Zhang Hangyu Guo Zhaoxiang Zhang Wenbo Su Bo Zheng ELM 39 2 0 15 Oct 2024
HR-Agent: A Task-Oriented Dialogue (TOD) LLM Agent Tailored for HR Applications Weijie Xu Jay Desai Fanyou Wu Josef Valvoda Srinivasan H. Sengamedu LLMAG 38 1 0 15 Oct 2024
Transforming Slot Schema Induction with Generative Dialogue State Inference Ange Lou Yike Zhang Jinho D. Choi 40 1 0 03 Aug 2024
An Approach to Build Zero-Shot Slot-Filling System for Industry-Grade Conversational Assistants G P Shrivatsa Bhargav S. Neelam Udit Sharma S. Ikbal Dheeraj Sreedhar ... Dinesh Garg Kyle Croutwater Haode Qi Eric Wayne J. William Murdock 21 1 0 13 Jun 2024
Benchmarks Underestimate the Readiness of Multi-lingual Dialogue Agents Andrew H. Lee Sina J. Semnani Galo Castillo-López Gaël de Chalendar Monojit Choudhury ... Jiwon Seo Tianhao Shen Manish Shrivastava Deyi Xiong Monica S. Lam 40 0 0 28 May 2024
LLM Task Interference: An Initial Study on the Impact of Task-Switch in Conversational History Akash Gupta Ivaxi Sheth Vyas Raina Mark J. F. Gales Mario Fritz 40 4 0 28 Feb 2024
Exploring the Robustness of Task-oriented Dialogue Systems for Colloquial German Varieties Ekaterina Artemova Verena Blaschke Barbara Plank 28 3 0 03 Feb 2024
HR-MultiWOZ: A Task Oriented Dialogue (TOD) Dataset for HR LLM Agent Weijie Xu Zicheng Huang Wenxiang Hu Xi Fang Rajesh Kumar Cherukuri Naumaan Nayyar Lorenzo Malandri Srinivasan H. Sengamedu 24 5 0 01 Feb 2024
Are LLMs Robust for Spoken Dialogues? Seyed Mahed Mousavi Gabriel Roccabruna Simone Alghisi Massimo Rizzoli Mirco Ravanelli Giuseppe Riccardi AuLLM 33 7 0 04 Jan 2024
Step by Step to Fairness: Attributing Societal Bias in Task-oriented Dialogue Systems Hsuan Su Rebecca Qian Chinnadhurai Sankar Shahin Shayandeh Shang-Tse Chen Hung-yi Lee Daniel M. Bikel 34 0 0 11 Nov 2023
Towards Better Evaluation of Instruction-Following: A Case-Study in Summarization Ondrej Skopek Rahul Aralikatte Sian Gooding Victor Carbune ELM 39 18 0 12 Oct 2023
Hexa: Self-Improving for Knowledge-Grounded Dialogue System DaeJin Jo D. W. Nam Gunsoo Han Kyoung-Woon On Taehwan Kwon Seungeun Rho Sungwoong Kim 19 0 0 10 Oct 2023
Grounding Description-Driven Dialogue State Trackers with Knowledge-Seeking Turns Alexandru Coca Bo-Hsiang Tseng J. Chen Weizhe Lin Weixuan Zhang Tisha Anders Bill Byrne 20 0 0 23 Sep 2023
Enhancing Performance on Seen and Unseen Dialogue Scenarios using Retrieval-Augmented End-to-End Task-Oriented System Jianguo Zhang Stephen Roller Kun Qian Zhiwei Liu Rui Meng Shelby Heinecke Haiquan Wang Silvio Savarese Caiming Xiong RALM 25 3 0 16 Aug 2023
Span-Selective Linear Attention Transformers for Effective and Robust Schema-Guided Dialogue State Tracking Björn Bebensee Haejun Lee 25 4 0 15 Jun 2023
The StatCan Dialogue Dataset: Retrieving Data Tables through Conversations with Genuine Intents Xing Han Lù Siva Reddy H. D. Vries LMTD 23 7 0 03 Apr 2023
Personalizing Task-oriented Dialog Systems via Zero-shot Generalizable Reward Function A. B. Siddique M. H. Maqbool Kshitija Taywade H. Foroosh 24 12 0 24 Mar 2023
More Robust Schema-Guided Dialogue State Tracking via Tree-Based Paraphrase Ranking Alexandru Coca Bo-Hsiang Tseng Weizhe Lin Bill Byrne 21 2 0 17 Mar 2023
Multi-Stage Coarse-to-Fine Contrastive Learning for Conversation Intent Induction Caiyuan Chu Ya Li Yifan Liu Jia-Chen Gu Quan Liu Yongxin Ge Guoping Hu 30 0 0 09 Mar 2023
Schema-Guided Semantic Accuracy: Faithfulness in Task-Oriented Dialogue Response Generation Jinghong Chen Weizhe Lin Bill Byrne 19 1 0 29 Jan 2023
A.I. Robustness: a Human-Centered Perspective on Technological Challenges and Opportunities Andrea Tocchetti Lorenzo Corti Agathe Balayn Mireia Yurrita Philip Lippmann Marco Brambilla Jie-jin Yang 24 10 0 17 Oct 2022
Information Extraction and Human-Robot Dialogue towards Real-life Tasks: A Baseline Study with the MobileCS Dataset Hong Liu Hao Peng Zhijian Ou Juan-Zi Li Yi Huang Junlan Feng 21 6 0 27 Sep 2022
GenTUS: Simulating User Behaviour and Language in Task-oriented Dialogues with Generative Transformers Hsien-Chin Lin Christian Geishauser Shutong Feng Nurul Lubis Carel van Niekerk Michael Heck Milica Gavsić 23 24 0 23 Aug 2022
"Do you follow me?": A Survey of Recent Approaches in Dialogue State Tracking Léo Jacqmin L. Rojas-Barahona Benoit Favre 41 27 0 29 Jul 2022
Show, Don't Tell: Demonstrations Outperform Descriptions for Schema-Guided Task-Oriented Dialogue Raghav Gupta Harrison Lee Jeffrey Zhao Abhinav Rastogi Yuan Cao Yonghui Wu 27 24 0 08 Apr 2022
Description-Driven Task-Oriented Dialog Modeling Jeffrey Zhao Raghav Gupta Yuan Cao Dian Yu Mingqiu Wang Harrison Lee Abhinav Rastogi Izhak Shafran Yonghui Wu 48 64 0 21 Jan 2022
Robustness Gym: Unifying the NLP Evaluation Landscape Karan Goel Nazneen Rajani Jesse Vig Samson Tan Jason M. Wu Stephan Zheng Caiming Xiong Joey Tianyi Zhou Christopher Ré AAML OffRL OOD 151 136 0 13 Jan 2021
STAR: A Schema-Guided Dialog Dataset for Transfer Learning Johannes E. M. Mosig Shikib Mehri Thomas Kober 89 42 0 22 Oct 2020