An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction

4 September 2019

Jonathan K. Kummerfeld

Papers citing "An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction"

50 / 290 papers shown

Title
Intent Recognition in Conversational Recommender Systems Sahar Moradizeyveh 50 5 0 06 Dec 2022
Measuring the Measuring Tools: An Automatic Evaluation of Semantic Metrics for Text Corpora George Kour Samuel Ackerman Orna Raz E. Farchi Boaz Carmeli Ateret Anaby-Tavor 41 10 0 29 Nov 2022
Generalized Category Discovery with Decoupled Prototypical Network Wenbin An Feng Tian Qinghua Zheng Wei Ding Qianying Wang Ping Chen 49 44 0 28 Nov 2022
Multi-Level Knowledge Distillation for Out-of-Distribution Detection in Text Qianhui Wu Huiqiang Jiang Haonan Yin Börje F. Karlsson Chin-Yew Lin 40 10 0 21 Nov 2022
3d human motion generation from the text via gesture action classification and the autoregressive model Gwantae Kim Youngsuk Ryu Junyeop Lee D. Han Jeongmin Bae Hanseok Ko 22 2 0 18 Nov 2022
Estimating Soft Labels for Out-of-Domain Intent Detection Hao Lang Yinhe Zheng Jian Sun Feiling Huang Luo Si Yongbin Li 48 15 0 10 Nov 2022
Few-Shot Character Understanding in Movies as an Assessment to Meta-Learning of Theory-of-Mind Mo Yu Qiujing Wang Shunchi Zhang Yisi Sang Kangsheng Pu ... Han Wang Liyan Xu Jing Li Yue Yu Jie Zhou 41 19 0 09 Nov 2022
Learning Better Intent Representations for Financial Open Intent Classification Xianzhi Li Will Aitken Xiao-Dan Zhu Stephen W. Thomas AIFin 22 8 0 25 Oct 2022
Better Few-Shot Relation Extraction with Label Prompt Dropout Peiyuan Zhang Wei Lu VLM 26 24 0 25 Oct 2022
Discovering New Intents Using Latent Variables Yunhua Zhou Peiju Liu Yuxin Wang Xipeng QIu 32 1 0 21 Oct 2022
Exploring Predictive Uncertainty and Calibration in NLP: A Study on the Impact of Method & Data Scarcity Dennis Ulmer J. Frellsen Christian Hardmeier 200 22 0 20 Oct 2022
Enhancing Out-of-Distribution Detection in Natural Language Understanding via Implicit Layer Ensemble Hyunsoo Cho Choonghyun Park Jaewoo Kang Kang Min Yoo Taeuk Kim Sang-goo Lee OODD 32 8 0 20 Oct 2022
UniNL: Aligning Representation Learning with Scoring Function for OOD Detection via Unified Neighborhood Learning Yutao Mou Pei Wang Keqing He Yanan Wu Jingang Wang Wei Wu Weiran Xu 29 6 0 19 Oct 2022
Pseudo-OOD training for robust language models Dhanasekar Sundararaman Nikhil Mehta Lawrence Carin 25 0 0 17 Oct 2022
Watch the Neighbors: A Unified K-Nearest Neighbor Contrastive Learning Framework for OOD Intent Discovery Yutao Mou Keqing He Pei Wang Yanan Wu Jingang Wang Wei Wu Weiran Xu 33 13 0 17 Oct 2022
Disentangling Confidence Score Distribution for Out-of-Domain Intent Detection with Energy-Based Learning Yanan Wu Zhiyuan Zeng Keqing He Yutao Mou Pei Wang Yuanmeng Yan Weiran Xu OODD 27 3 0 17 Oct 2022
Prompt Conditioned VAE: Enhancing Generative Replay for Lifelong Learning in Task-Oriented Dialogue Ying Zhao Yinhe Zheng Zhiliang Tian Chang Gao Yu Bowen Haiyang Yu Yongbin Li Jianguo Sun N. Zhang CLL OffRL 37 12 0 14 Oct 2022
Fine-grained Category Discovery under Coarse-grained supervision with Hierarchical Weighted Self-contrastive Learning Wenbin An Feng Tian Ping Chen Siliang Tang Qinghua Zheng Qianying Wang 43 17 0 14 Oct 2022
Holistic Sentence Embeddings for Better Out-of-Distribution Detection Sishuo Chen Xiaohan Bi Rundong Gao Xu Sun OODD 32 4 0 14 Oct 2022
Evaluating Out-of-Distribution Performance on Document Image Classifiers Stefan Larson Gordon Lim Yutong Ai David Kuang Kevin Leach OODD OOD 42 18 0 14 Oct 2022
The Open-World Lottery Ticket Hypothesis for OOD Intent Classification Yunhua Zhou Pengyu Wang Peiju Liu Yuxin Wang Xipeng Qiu 36 2 0 13 Oct 2022
The Devil is in the Details: On Models and Training Regimes for Few-Shot Intent Classification Mohsen Mesgar Thy Thy Tran Goran Glavaš Iryna Gurevych 24 3 0 12 Oct 2022
Efficient Bayesian Updates for Deep Learning via Laplace Approximations Denis Huseljic M. Herde Lukas Rauch Paul Hahn Zhixin Huang D. Kottke S. Vogt Bernhard Sick BDL 23 0 0 12 Oct 2022
Semantic-based Pre-training for Dialogue Understanding Xuefeng Bai Linfeng Song Yue Zhang 43 7 0 19 Sep 2022
SPACE-3: Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generation Wanwei He Yinpei Dai Min Yang Jian Sun Fei Huang Luo Si Yongbin Li 36 60 0 14 Sep 2022
SPACE-2: Tree-Structured Semi-Supervised Contrastive Pre-training for Task-Oriented Dialog Understanding Wanwei He Yinpei Dai Binyuan Hui Min Yang Zhen Cao Jianbo Dong Fei Huang Luo Si Yongbin Li VLM 48 31 0 14 Sep 2022
Distribution Calibration for Out-of-Domain Detection with Bayesian Approximation Yanan Wu Zhiyuan Zeng Keqing He Yutao Mou Pei Wang Weiran Xu 50 8 0 14 Sep 2022
A Review and Roadmap of Deep Learning Causal Discovery in Different Variable Paradigms Hang Chen Keqing Du Xinyu Yang Chenguang Li CML 44 11 0 14 Sep 2022
Alexa, Let's Work Together: Introducing the First Alexa Prize TaskBot Challenge on Conversational Task Assistance Anna Gottardi Osman Ipek Giuseppe Castellucci Shui Hu Lavina Vaz ... Oleg Rokhlenko Kate Bland Eugene Agichtein R. Ghanadan Y. Maarek 43 23 0 13 Sep 2022
Generalized Intent Discovery: Learning from Open World Dialogue System Yutao Mou Keqing He Yanan Wu Pei Wang Jingang Wang Wei Wu Y. Huang Junlan Feng Weiran Xu 42 8 0 13 Sep 2022
MIntRec: A New Dataset for Multimodal Intent Recognition Hanlei Zhang Huanlin Xu Xin Eric Wang Qianrui Zhou Shaojie Zhao Jiayan Teng 41 39 0 09 Sep 2022
Constraining Representations Yields Models That Know What They Don't Know João Monteiro Pau Rodríguez López Pierre-Andre Noel I. Laradji David Vazquez AAML 46 0 0 30 Aug 2022
Z-BERT-A: a zero-shot Pipeline for Unknown Intent detection Daniele Comi Dimitrios Christofidellis Pier Francesco Piazza Matteo Manica 37 3 0 15 Aug 2022
LAD: Language Models as Data for Zero-Shot Dialog Shikib Mehri Yasemin Altun M. Eskénazi 27 25 0 28 Jul 2022
A Survey of Intent Classification and Slot-Filling Datasets for Task-Oriented Dialog Stefan Larson Kevin Leach 46 20 0 26 Jul 2022
Plex: Towards Reliability using Pretrained Large Model Extensions Dustin Tran J. Liu Michael W. Dusenberry Du Phan Mark Collier ... D. Sculley Y. Gal Zoubin Ghahramani Jasper Snoek Balaji Lakshminarayanan VLM 39 124 0 15 Jul 2022
Template-based Approach to Zero-shot Intent Recognition Dmitry Lamanov Pavel Burnyshev Ekaterina Artemova Valentin Malykh A. Bout Irina Piontkovskaya 20 9 0 22 Jun 2022
Natural Language Sentence Generation from API Specifications Siyu Huo K. Mukherjee Jayachandu Bandlamudi Vatche Isahagian Vinod Muthusamy Sadhana Kumaravel 30 2 0 01 Jun 2022
Fast and Light-Weight Answer Text Retrieval in Dialogue Systems H. Wan S. Patel J. William Murdock Saloni Potdar Sachindra Joshi 36 1 0 27 May 2022
Learning Dialogue Representations from Consecutive Utterances Zhihan Zhou Dejiao Zhang Wei Xiao Nicholas Dingwall Xiaofei Ma Andrew O. Arnold Bing Xiang SSL 67 21 0 26 May 2022
InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning Prakhar Gupta Cathy Jiao Yi-Ting Yeh Shikib Mehri M. Eskénazi Jeffrey P. Bigham ALM 49 47 0 25 May 2022
DFM: Dialogue Foundation Model for Universal Large-Scale Dialogue-Oriented Task Learning Zhi Chen Jijia Bao Lu Chen Yuncong Liu Da Ma ... Xinhsuai Dong Fujiang Ge Qingliang Miao Jian-Guang Lou Kai Yu ALM AI4CE 55 3 0 25 May 2022
New Intent Discovery with Pre-training and Contrastive Learning Yuwei Zhang Haode Zhang Li-Ming Zhan Albert Y.S. Lam Albert Y. S. Lam SSL VLM 49 41 0 25 May 2022
When More Data Hurts: A Troubling Quirk in Developing Broad-Coverage Natural Language Understanding Systems Elias Stengel-Eskin Emmanouil Antonios Platanios Adam Pauls Sam Thomson Hao Fang Benjamin Van Durme J. Eisner Yu-Chuan Su 39 2 0 24 May 2022
Benchmark Data and Evaluation Framework for Intent Discovery Around COVID-19 Vaccine Hesitancy Shai Gretz Assaf Toledo Roni Friedman Dan Lahav Rose Weeks N. Bar-Zeev João Sedoc P. Sangha Yoav Katz Noam Slonim 39 8 0 24 May 2022
Accuracy on In-Domain Samples Matters When Building Out-of-Domain detectors: A Reply to Marek et al. (2021) Yinhe Zheng Guanyi Chen OODD 37 0 0 24 May 2022
Exploring the Advantages of Dense-Vector to One-Hot Encoding of Intent Classes in Out-of-Scope Detection Tasks Claudio S. Pinhanez Paulo Cavalin 19 1 0 18 May 2022
Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropization Haode Zhang Haowen Liang Yuwei Zhang Li-Ming Zhan Xiao-Ming Wu Xiaolei Lu Albert Y. S. Lam 31 28 0 15 May 2022
A Framework to Generate High-Quality Datapoints for Multiple Novel Intent Detection Ankan Mullick Sukannya Purkayastha Pawan Goyal Niloy Ganguly 22 5 0 04 May 2022
A Simple Approach to Improve Single-Model Deep Uncertainty via Distance-Awareness J. Liu Shreyas Padhy Jie Jessie Ren Zi Lin Yeming Wen Ghassen Jerfel Zachary Nado Jasper Snoek Dustin Tran Balaji Lakshminarayanan UQCV BDL 30 48 0 01 May 2022