Revisiting Mahalanobis Distance for Transformer-Based Out-of-Domain Detection

11 January 2021

Papers citing "Revisiting Mahalanobis Distance for Transformer-Based Out-of-Domain Detection"

28 / 28 papers shown

Title
Benchmarking Uncertainty Quantification Methods for Large Language Models with LM-Polygraph Roman Vashurin Ekaterina Fadeeva Artem Vazhentsev Akim Tsvigun Daniil Vasilev ... Timothy Baldwin Timothy Baldwin Maxim Panov Artem Shelmanov Artem Shelmanov HILM 92 28 0 21 Jun 2024
Online Reinforcement Learning in Non-Stationary Context-Driven Environments Pouya Hamadanian Arash Nasr-Esfahany Malte Schwarzkopf Siddartha Sen MohammadIman Alizadeh CLL OffRL 103 0 0 04 Feb 2023
Keywords and Instances: A Hierarchical Contrastive Learning Framework Unifying Hybrid Granularities for Text Generation Li Mingzhe Xiexiong Lin Preslav Nakov Jinxiong Chang Qishen Zhang ... Taifeng Wang Zhongyi Liu Wei Chu Dongyan Zhao Rui Yan 121 12 0 26 May 2022
Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awareness Jeremiah Zhe Liu Zi Lin Shreyas Padhy Dustin Tran Tania Bedrax-Weiss Balaji Lakshminarayanan UQCV BDL 168 447 0 17 Jun 2020
Selective Question Answering under Domain Shift Amita Kamath Robin Jia Percy Liang OOD 39 212 0 16 Jun 2020
Pretrained Transformers Improve Out-of-Distribution Robustness Dan Hendrycks Xiaoyuan Liu Eric Wallace Adam Dziedzic R. Krishnan D. Song OOD 179 434 0 13 Apr 2020
Why is the Mahalanobis Distance Effective for Anomaly Detection? Ryo Kamoi Kei Kobayashi OODD 154 58 0 01 Mar 2020
Likelihood Ratios and Generative Classifiers for Unsupervised Out-of-Domain Detection In Task Oriented Dialog Varun Gangal Abhinav Arora Arash Einolghozati S. Gupta OODD 49 54 0 30 Dec 2019
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 475 42,407 0 03 Dec 2019
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter Victor Sanh Lysandre Debut Julien Chaumond Thomas Wolf 230 7,498 0 02 Oct 2019
Out-of-domain Detection for Natural Language Understanding in Dialog Systems Yinhe Zheng Guanyi Chen Minlie Huang 61 123 0 09 Sep 2019
An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction Stefan Larson Anish Mahendran Joseph Peper Christopher Clarke Andrew Lee ... Jonathan K. Kummerfeld Kevin Leach M. Laurenzano Lingjia Tang Jason Mars 105 530 0 04 Sep 2019
Out-of-Domain Detection for Low-Resource Text Classification Tasks Ming Tan Yang Yu Haoyu Wang Dakuo Wang Saloni Potdar Shiyu Chang Mo Yu OODD 39 58 0 31 Aug 2019
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Nils Reimers Iryna Gurevych 1.3K 12,193 0 27 Aug 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 594 24,431 0 26 Jul 2019
Robustness properties of Facebook's ResNeXt WSL models Emin Orhan VLM 52 31 0 17 Jul 2019
Statistical Analysis of Nearest Neighbor Methods for Anomaly Detection Xiaoyi Gu Leman Akoglu Alessandro Rinaldo 132 96 0 08 Jul 2019
Likelihood Ratios for Out-of-Distribution Detection Jie Jessie Ren Peter J. Liu Emily Fertig Jasper Snoek Ryan Poplin M. DePristo Joshua V. Dillon Balaji Lakshminarayanan OODD 182 722 0 07 Jun 2019
Deep Unknown Intent Detection with Margin Loss Ting-En Lin Hua Xu UQCV 64 142 0 02 Jun 2019
Deep Anomaly Detection with Outlier Exposure Dan Hendrycks Mantas Mazeika Thomas G. Dietterich OODD 181 1,478 0 11 Dec 2018
Cross-Lingual Transfer Learning for Multilingual Task Oriented Dialog Sebastian Schuster S. Gupta Rushin Shah M. Lewis 71 286 0 31 Oct 2018
Do Deep Generative Models Know What They Don't Know? Eric T. Nalisnick Akihiro Matsukawa Yee Whye Teh Dilan Görür Balaji Lakshminarayanan OOD 63 757 0 22 Oct 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.7K 94,770 0 11 Oct 2018
A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attacks Kimin Lee Kibok Lee Honglak Lee Jinwoo Shin OODD 179 2,050 0 10 Jul 2018
Predictive Uncertainty Estimation via Prior Networks A. Malinin Mark Gales UD BDL EDL UQCV PER 186 914 0 28 Feb 2018
Distance-based Confidence Score for Neural Network Classifiers Amit Mandelbaum D. Weinshall UQCV 51 112 0 28 Sep 2017
Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networks Shiyu Liang Yixuan Li R. Srikant UQCV OODD 168 2,068 0 08 Jun 2017
A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks Dan Hendrycks Kevin Gimpel UQCV 155 3,452 0 07 Oct 2016