An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction

4 September 2019

Jonathan K. Kummerfeld

Papers citing "An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction"

50 / 290 papers shown

Title
NLU++: A Multi-Label, Slot-Rich, Generalisable Dataset for Natural Language Understanding in Task-Oriented Dialogue I. Casanueva Ivan Vulić Georgios P. Spithourakis Paweł Budzianowski 31 10 0 27 Apr 2022
Metric Learning and Adaptive Boundary for Out-of-Domain Detection Petr Lorenc Tommaso Gargiani Jan Pichl Jakub Konrád Petro Marek Ondrej Kobza Jan Sedivý 27 0 0 22 Apr 2022
Learning to Classify Open Intent via Soft Labeling and Manifold Mixup Zifeng Cheng Zhiwei Jiang Yafeng Yin Cong Wang Qing Gu VLM 24 13 0 16 Apr 2022
Redwood: Using Collision Detection to Grow a Large-Scale Intent Classification Dataset Stefan Larson Kevin Leach 32 9 0 12 Apr 2022
A Generative Language Model for Few-shot Aspect-Based Sentiment Analysis Ehsan Hosseini-Asl Wenhao Liu Caiming Xiong 29 24 0 11 Apr 2022
Gaining Insights into Unrecognized User Utterances in Task-Oriented Dialog Systems Ella Rabinovich Matan Vetzler David Boaz Vineet Kumar Gaurav Pandey Ateret Anaby-Tavor 24 7 0 11 Apr 2022
MGIMN: Multi-Grained Interactive Matching Network for Few-shot Text Classification Jianhai Zhang M. Maimaiti Xing Gao Yuanhang Zheng Ji Zhang 23 9 0 11 Apr 2022
Quick Starting Dialog Systems with Paraphrase Generation Louis Marceau R. Belbahar Marc Queudot Nada Naji Eric Charton Marie-Jean Meurs 13 3 0 06 Apr 2022
Data Augmentation for Intent Classification with Off-the-shelf Large Language Models Gaurav Sahu Pau Rodríguez López I. Laradji Parmida Atighehchian David Vazquez Dzmitry Bahdanau 37 61 0 05 Apr 2022
Confidence Calibration for Intent Detection via Hyperspherical Space and Rebalanced Accuracy-Uncertainty Loss Yantao Gong Cao Liu Fan Yang Xunliang Cai Guanglu Wan Jiansong Chen Weipeng Zhang Houfeng Wang UQCV 24 2 0 17 Mar 2022
One Agent To Rule Them All: Towards Multi-agent Conversational AI Christopher Clarke Joseph Peper Karthik Krishnamurthy W. Talamonti Kevin Leach Walter S. Lasecki Yiping Kang Lingjia Tang Jason Mars LLMAG 17 12 0 15 Mar 2022
Towards Personalized Intelligence at Scale Yiping Kang Ashish Mahendra Christopher Clarke Lingjia Tang Jason Mars 36 1 0 13 Mar 2022
Learning Discriminative Representations and Decision Boundaries for Open Intent Detection Hanlei Zhang Huan Xu Shaojie Zhao Qianrui Zhou 35 18 0 11 Mar 2022
FlowEval: A Consensus-Based Dialogue Evaluation Framework Using Segment Act Flows Jianqiao Zhao Yanyang Li Wanyu Du Yangfeng Ji Dong Yu M. Lyu Liwei Wang 33 4 0 14 Feb 2022
Nonparametric Uncertainty Quantification for Single Deterministic Neural Network Nikita Kotelevskii A. Artemenkov Kirill Fedyanin Fedor Noskov Alexander Fishkov Artem Shelmanov Artem Vazhentsev Aleksandr Petiushko Maxim Panov UQCV BDL 56 26 0 07 Feb 2022
Cross-Lingual Dialogue Dataset Creation via Outline-Based Generation Olga Majewska E. Razumovskaia Edoardo Ponti Ivan Vulić Anna Korhonen 39 28 0 31 Jan 2022
Dialog Intent Induction via Density-based Deep Clustering Ensemble Jiashu Pu Guandan Chen Yongzhu Chang Xiaoxi Mao 22 1 0 18 Jan 2022
Semi-Supervised Clustering with Contrastive Learning for Discovering New Intents Feng juan Wei Zhenbo Chen Zhenghong Hao Fengxin Yang Hua Wei Bing Han Shengbo Guo 22 12 0 07 Jan 2022
Hyperparameter-free Continuous Learning for Domain Classification in Natural Language Understanding Ting Hua Yilin Shen Changsheng Zhao Yen-Chang Hsu Hongxia Jin 39 5 0 05 Jan 2022
Exploring the Limits of Natural Language Inference Based Setup for Few-Shot Intent Detection Ayush Kumar Vijit Malik Jithendra Vepa 31 1 0 14 Dec 2021
Text classification problems via BERT embedding method and graph convolutional neural network L. Tran Tuan-Kiet Tran An Mai GNN 30 4 0 30 Nov 2021
ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning V. Aribandi Yi Tay Tal Schuster J. Rao H. Zheng ... Jianmo Ni Jai Gupta Kai Hui Sebastian Ruder Donald Metzler MoE 34 214 0 22 Nov 2021
Cross-lingual Adaption Model-Agnostic Meta-Learning for Natural Language Understanding Qianying Liu Fei Cheng Sadao Kurohashi 17 1 0 10 Nov 2021
PnPOOD : Out-Of-Distribution Detection for Text Classification via Plug andPlay Data Augmentation Mrinal Rawat R. Hebbalaguppe L. Vig OODD 16 10 0 31 Oct 2021
Multi-stage Clarification in Conversational AI: The case of Question-Answering Dialogue Systems H. Lautraite Nada Naji Louis Marceau Marc Queudot Eric Charton 42 2 0 28 Oct 2021
Virtual Augmentation Supported Contrastive Learning of Sentence Representations Dejiao Zhang Wei Xiao Henghui Zhu Xiaofei Ma Andrew O. Arnold SSL 59 29 0 16 Oct 2021
LIDSNet: A Lightweight on-device Intent Detection model using Deep Siamese Network Vibhav Agarwal Sudeep Deepak Shivnikar Sourav Ghosh H. Arora Yash Saini 26 7 0 06 Oct 2021
Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue System Yixuan Su Lei Shu Elman Mansimov Arshit Gupta Deng Cai Yi-An Lai Yi Zhang 150 192 0 29 Sep 2021
ConvFiT: Conversational Fine-Tuning of Pretrained Language Models Ivan Vulić Pei-hao Su Sam Coope D. Gerz Paweł Budzianowski I. Casanueva Nikola Mrkvsić Tsung-Hsien Wen 29 36 0 21 Sep 2021
Alquist 4.0: Towards Social Intelligence Using Generative Models and Dialogue Personalization Jakub Konrád Jan Pichl Petro Marek Petr Lorenc Van Duy Ta Ondrej Kobza L. Hýlová Jan Sedivý 24 17 0 16 Sep 2021
Different Strokes for Different Folks: Investigating Appropriate Further Pre-training Approaches for Diverse Dialogue Tasks Yao Qiu Jinchao Zhang Jie Zhou 25 5 0 14 Sep 2021
Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning Jianguo Zhang Trung Bui Seunghyun Yoon Xiang Chen Zhiwei Liu Congying Xia Quan Hung Tran Walter Chang Philip Yu VLM 31 87 0 13 Sep 2021
Traffic Event Detection as a Slot Filling Problem Xiangyu Yang Giannis Bekoulis Nikos Deligiannis 27 5 0 13 Sep 2021
Effectiveness of Pre-training for Few-shot Intent Classification Haode Zhang Yuwei Zhang Li-Ming Zhan Jiaxin Chen Guangyuan Shi Xiao-Ming Wu Albert Y. S. Lam VLM 86 44 0 13 Sep 2021
TEXTOIR: An Integrated and Visualized Platform for Text Open Intent Recognition Hanlei Zhang Xiaoteng Li Hua Xu Panpan Zhang Kang Zhao Kai Gao 36 35 0 13 Sep 2021
CINS: Comprehensive Instruction for Few-shot Learning in Task-oriented Dialog Systems Fei Mi Yitong Li Yasheng Wang Xin Jiang Qun Liu 30 43 0 10 Sep 2021
GOLD: Improving Out-of-Scope Detection in Dialogues using Data Augmentation Derek Chen Zhou Yu 32 31 0 07 Sep 2021
ConQX: Semantic Expansion of Spoken Queries for Intent Detection based on Conditioned Text Generation E. Yilmaz Cagri Toraman 30 1 0 02 Sep 2021
Self-training Improves Pre-training for Few-shot Learning in Task-oriented Dialog Systems Fei Mi Wanhao Zhou Feng Cai Lingjing Kong Minlie Huang Boi Faltings 27 32 0 28 Aug 2021
ProtoInfoMax: Prototypical Networks with Mutual Information Maximization for Out-of-Domain Detection Iftitahu Ni'mah Meng Fang Vlado Menkovski Mykola Pechenizkiy 35 5 0 27 Aug 2021
Density-Based Dynamic Curriculum Learning for Intent Detection Yeyun Gong Cao Liu Jianying Yuan Fan Yang Xunliang Cai Guanglu Wan Jiansong Chen Ruiyao Niu Houfeng Wang 28 13 0 24 Aug 2021
Lifelong Intent Detection via Multi-Strategy Rebalancing Qingbin Liu Xiaoyan Yu Shizhu He Kang Liu Jun Zhao CLL OffRL 23 14 0 10 Aug 2021
Exploring Out-of-Distribution Generalization in Text Classifiers Trained on Tobacco-3482 and RVL-CDIP Stefan Larson Navtej Singh Saarthak Maheshwari Shanti Stewart U. Krishnaswamy OODD OOD 25 3 0 05 Aug 2021
Energy-based Unknown Intent Detection with Data Manipulation Yawen Ouyang Jiasheng Ye Yu Chen Xinyu Dai Shujian Huang Jiajun Chen 25 21 0 27 Jul 2021
Improved Text Classification via Contrastive Adversarial Training Lin Pan Chung-Wei Hang Avirup Sil Saloni Potdar AAML 33 86 0 21 Jul 2021
Enhancing the Generalization for Intent Classification and Out-of-Domain Detection in SLU Yilin Shen Yen-Chang Hsu Avik Ray Hongxia Jin 27 37 0 28 Jun 2021
Stochastic Batch Acquisition: A Simple Baseline for Deep Active Learning Andreas Kirsch Sebastian Farquhar Parmida Atighehchian Andrew Jesson Frederic Branchaud-Charron Y. Gal 49 20 0 22 Jun 2021
A Simple Fix to Mahalanobis Distance for Improving Near-OOD Detection Jie Jessie Ren Stanislav Fort J. Liu Abhijit Guha Roy Shreyas Padhy Balaji Lakshminarayanan UQCV 33 219 0 16 Jun 2021
Out-of-Scope Intent Detection with Self-Supervision and Discriminative Training Li-Ming Zhan Haowen Liang Bo Liu Lu Fan Xiao-Ming Wu Albert Y. S. Lam OODD 26 75 0 16 Jun 2021
Uncertainty Baselines: Benchmarks for Uncertainty & Robustness in Deep Learning Zachary Nado Neil Band Mark Collier Josip Djolonga Michael W. Dusenberry ... D. Sculley Balaji Lakshminarayanan Jasper Snoek Y. Gal Dustin Tran UQCV ELM 38 96 0 07 Jun 2021