An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction

4 September 2019

Jonathan K. Kummerfeld

Papers citing "An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction"

50 / 290 papers shown

Title
SeqGPT: An Out-of-the-box Large Language Model for Open Domain Sequence Understanding Tianyu Yu Chengyue Jiang Chao Lou Shen Huang Xiaobin Wang ... Haitao Zheng Ningyu Zhang Pengjun Xie Fei Huang Yong-jia Jiang LRM 64 17 0 21 Aug 2023
How Good Are LLMs at Out-of-Distribution Detection? Bo Liu Li-Ming Zhan Zexin Lu Yu Feng Lei Xue Xiao-Ming Wu OODD 42 8 0 20 Aug 2023
Utilisation of open intent recognition models for customer support intent detection Rasheed Mohammad Oliver Favell Shariq Shah Emmett Cooper Edlira Vakaj 25 0 0 31 Jul 2023
DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AI Jianguo Zhang Kun Qian Zhiwei Liu Shelby Heinecke Rui Meng Ye Liu Zhou Yu Huan Wang Silvio Savarese Caiming Xiong 44 22 0 19 Jul 2023
Dialogue Agents 101: A Beginner's Guide to Critical Ingredients for Designing Effective Conversational Systems Shivani Kumar S. Bhatia Milan Aggarwal Tanmoy Chakraborty 32 1 0 14 Jul 2023
Morse Neural Networks for Uncertainty Quantification Benoit Dherin Huiyi Hu Jie Jessie Ren Michael W. Dusenberry Balaji Lakshminarayanan UQCV AI4CE 29 4 0 02 Jul 2023
Large Language Models Enable Few-Shot Clustering Vijay Viswanathan Kiril Gashteovski Carolin (Haas) Lawrence Tongshuang Wu Graham Neubig 16 60 0 02 Jul 2023
Class-Incremental Learning based on Label Generation Yijia Shao Yiduo Guo Dongyan Zhao Bin Liu CLL 37 14 0 22 Jun 2023
FutureTOD: Teaching Future Knowledge to Pre-trained Language Model for Task-Oriented Dialogue Weihao Zeng Keqing He Yejie Wang Chen Zeng Jingang Wang Yunsen Xian Weiran Xu 24 1 0 17 Jun 2023
BED: Bi-Encoder-Based Detectors for Out-of-Distribution Detection Louis Owen Biddwan Ahmed Abhay Kumar OODD 19 0 0 15 Jun 2023
Revisit Few-shot Intent Classification with PLMs: Direct Fine-tuning vs. Continual Pre-training Haode Zhang Haowen Liang Li-Ming Zhan Xiao-Ming Wu Albert Y. S. Lam VLM 26 8 0 08 Jun 2023
Open Set Relation Extraction via Unknown-Aware Training Jun Zhao Xin Zhao Wenyu Zhan Qi Zhang Tao Gui Zhongyu Wei Yunwen Chen Xiang Gao Xuanjing Huang 38 1 0 08 Jun 2023
CELDA: Leveraging Black-box Language Model as Enhanced Classifier without Labels Hyunsoo Cho Youna Kim Sang-goo Lee 14 3 0 05 Jun 2023
IDAS: Intent Discovery with Abstractive Summarization Maarten De Raedt Fréderic Godin Thomas Demeester Chris Develder 42 16 0 31 May 2023
Reliable and Interpretable Drift Detection in Streams of Short Texts Ella Rabinovich Matan Vetzler Samuel Ackerman Ateret Anaby-Tavor AI4TS 52 2 0 28 May 2023
Decoupling Pseudo Label Disambiguation and Representation Learning for Generalized Intent Discovery Yutao Mou Xiaoshuai Song Keqing He Chen Zeng Pei Wang Jingang Wang Yunsen Xian Weiran Xu 40 8 0 28 May 2023
Label Agnostic Pre-training for Zero-shot Text Classification Christopher Clarke Yuzhao Heng Yiping Kang Krisztian Flautner Lingjia Tang Jason Mars VLM 27 2 0 25 May 2023
Revisiting Parallel Context Windows: A Frustratingly Simple Alternative and Chain-of-Thought Deterioration Kejuan Yang Xiao Liu Kaiwen Men Aohan Zeng Yuxiao Dong Jie Tang LLMAG LRM 29 3 0 24 May 2023
ClusterLLM: Large Language Models as a Guide for Text Clustering Yuwei Zhang Zihan Wang Jingbo Shang 40 53 0 24 May 2023
Pre-training Intent-Aware Encoders for Zero- and Few-Shot Intent Classification Mujeen Sung James Gung Elman Mansimov Nikolaos Pappas Raphael Shu Salvatore Romeo Yi Zhang Vittorio Castelli 33 7 0 24 May 2023
SELFOOD: Self-Supervised Out-Of-Distribution Detection via Learning to Rank Dheeraj Mekala Adithya Samavedhi Chengyu Dong Jingbo Shang OODD 31 2 0 24 May 2023
TaDSE: Template-aware Dialogue Sentence Embeddings Min Sik Oh Jiwei Li Guoyin Wang 29 2 0 23 May 2023
Revealing User Familiarity Bias in Task-Oriented Dialogue via Interactive Evaluation Takyoung Kim Jamin Shin Young-Ho Kim Sanghwan Bae Sungdong Kim 53 1 0 23 May 2023
Is Fine-tuning Needed? Pre-trained Language Models Are Near Perfect for Out-of-Domain Detection Rheeya Uppaal Junjie Hu Yixuan Li OODD 119 33 0 22 May 2023
ChatGPT to Replace Crowdsourcing of Paraphrases for Intent Classification: Higher Diversity and Comparable Model Robustness Ján Cegin Jakub Simko Peter Brusilovsky 43 42 0 22 May 2023
Measuring and Mitigating Local Instability in Deep Neural Networks Arghya Datta Subhrangshu Nandi Jingcheng Xu Greg Ver Steeg He Xie Anoop Kumar Aram Galstyan 32 3 0 18 May 2023
Going beyond research datasets: Novel intent discovery in the industry setting Aleksandra Chrabrowa Tsimur Hadeliya D. Kajtoch Robert Mroczkowski Piotr Rybak 29 2 0 09 May 2023
Out-of-Domain Intent Detection Considering Multi-Turn Dialogue Contexts Hao Lang Yinhe Zheng Binyuan Hui Fei Huang Yongbin Li 42 4 0 05 May 2023
A Survey on Out-of-Distribution Detection in NLP Hao Lang Yinhe Zheng Yixuan Li Jian Sun Feiling Huang Yongbin Li 34 20 0 05 May 2023
NatCS: Eliciting Natural Customer Support Dialogues James Gung Emily Moeng Wesley Rose Arshit Gupta Yi Zhang Saab Mansour 26 2 0 04 May 2023
Task-Optimized Adapters for an End-to-End Task-Oriented Dialogue System Namo Bang Jeehyun Lee M. Koo 187 38 0 04 May 2023
Intent Induction from Conversations for Task-Oriented Dialogue Track at DSTC 11 James Gung Raphael Shu Emily Moeng Wesley Rose Salvatore Romeo Yassine Benajiba Arshit Gupta Saab Mansour Yi Zhang 33 8 0 25 Apr 2023
Effective Open Intent Classification with K-center Contrastive Learning and Adjustable Decision Boundary Xiaokang Liu Jianquan Li Jingjing Mu Min Yang Ruifeng Xu Benyou Wang VLM 22 4 0 20 Apr 2023
A Clustering Framework for Unsupervised and Semi-supervised New Intent Discovery Hanlei Zhang Huanlin Xu Xin Eric Wang Fei Long Kai Gao 40 11 0 16 Apr 2023
Boosting Few-Shot Text Classification via Distribution Estimation Han Liu Feng Zhang Xiaotong Zhang Siyang Zhao Fenglong Ma Xiao-Ming Wu Hongyang Chen Hong Yu Xianchao Zhang OODD VLM 43 12 0 26 Mar 2023
Multi-View Zero-Shot Open Intent Induction from Dialogues: Multi Domain Batch and Proxy Gradient Transfer Hyukhun Koh Haesung Pyun Nakyeong Yang Kyomin Jung 45 1 0 23 Mar 2023
Open World Classification with Adaptive Negative Samples Ke Bai Guoyin Wang Jiwei Li Sunghyun Park Sungjin Lee Puyang Xu Ricardo Henao Lawrence Carin VLM 34 5 0 09 Mar 2023
QAID: Question Answering Inspired Few-shot Intent Detection Asaf Yehudai Matan Vetzler Y. Mass Koren Lazar Doron Cohen Boaz Carmeli 27 7 0 02 Mar 2023
Unsupervised Layer-wise Score Aggregation for Textual OOD Detection Maxime Darrin Guillaume Staerman Eduardo Dadalto Camara Gomes Jackie CK Cheung Pablo Piantanida Pierre Colombo OODD 57 11 0 20 Feb 2023
Selective In-Context Data Augmentation for Intent Detection using Pointwise V-Information Yen-Ting Lin Alexandros Papangelis Seokhwan Kim Sungjin Lee Devamanyu Hazarika Mahdi Namazifar Di Jin Yang Liu Dilek Z. Hakkani-Tür 39 35 0 10 Feb 2023
Real-Time Visual Feedback to Guide Benchmark Creation: A Human-and-Metric-in-the-Loop Workflow Anjana Arunkumar Swaroop Mishra Bhavdeep Singh Sachdeva Chitta Baral Chris Bryan 36 0 0 09 Feb 2023
Bringing the State-of-the-Art to Customers: A Neural Agent Assistant Framework for Customer Service Support Stephen Obadinma Faiza Khan Khattak Shi Wang Tania Sidhom Elaine Lau ... Jaswinder Narain D. Pandya Xiao-Dan Zhu Frank Rudzicz Elham Dolatabadi AI4TS 31 3 0 07 Feb 2023
Towards Detecting Harmful Agendas in News Articles Melanie Subbiah Amrita Bhattacharjee Yilun Hua Tharindu Kumarage Huan Liu Kathleen McKeown 11 3 0 31 Jan 2023
Fine-Tuning Deteriorates General Textual Out-of-Distribution Detection by Distorting Task-Agnostic Features Sishuo Chen Wenkai Yang Xiaohan Bi Xu Sun OODD 20 13 0 30 Jan 2023
Probing Out-of-Distribution Robustness of Language Models with Parameter-Efficient Transfer Learning Hyunsoo Cho Choonghyun Park Junyeop Kim Sungmin Cho Kang Min Yoo Sang-goo Lee OODD 35 3 0 27 Jan 2023
Multi-Tenant Optimization For Few-Shot Task-Oriented FAQ Retrieval Asha Vishwanathan R. Warrier G. V. Suresh Chandrashekhar Kandpal 13 2 0 25 Jan 2023
Distinguish Sense from Nonsense: Out-of-Scope Detection for Virtual Assistants Cheng Qian Haode Qi Gengyu Wang L. Kunc Saloni Potdar 33 4 0 16 Jan 2023
Parallel Context Windows for Large Language Models Nir Ratner Yoav Levine Yonatan Belinkov Ori Ram Inbal Magar Omri Abend Ehud D. Karpas Amnon Shashua Kevin Leyton-Brown Y. Shoham RALM 30 70 0 21 Dec 2022
Azimuth: Systematic Error Analysis for Text Classification Gabrielle Gauthier Melançon Orlando Marquez Ayala Lindsay D. Brin Chris Tyler Frederic Branchaud-Charron Joseph Marinier Karine Grande Dieu-Thu Le 26 4 0 16 Dec 2022
Decomposing a Recurrent Neural Network into Modules for Enabling Reusability and Replacement S. Imtiaz Fraol Batole Astha Singh Rangeet Pan Breno Dantas Cruz Hridesh Rajan 18 7 0 09 Dec 2022