Behavior Analysis of NLI Models: Uncovering the Influence of Three Factors on Robustness

11 May 2018

Papers citing "Behavior Analysis of NLI Models: Uncovering the Influence of Three Factors on Robustness"

31 / 31 papers shown

Title
The Factorization Curse: Which Tokens You Predict Underlie the Reversal Curse and More O. Kitouni Niklas Nolte Diane Bouchacourt Adina Williams Mike Rabbat Mark Ibrahim LRM CLL 51 12 0 07 Jun 2024
Semantic Sensitivities and Inconsistent Predictions: Measuring the Fragility of NLI Models Erik Arakelyan Zhaoqi Liu Isabelle Augenstein AAML 45 9 0 25 Jan 2024
SETI: Systematicity Evaluation of Textual Inference Xiyan Fu Anette Frank LRM 19 5 0 24 May 2023
Contrastive variational information bottleneck for aspect-based sentiment analysis Ming-Wei Chang Min Yang Qingshan Jiang Ruifeng Xu 24 4 0 06 Mar 2023
Using Focal Loss to Fight Shallow Heuristics: An Empirical Analysis of Modulated Cross-Entropy in Natural Language Inference Frano Rajic Ivan Stresec Axel Marmet Tim Postuvan 29 3 0 23 Nov 2022
A.I. Robustness: a Human-Centered Perspective on Technological Challenges and Opportunities Andrea Tocchetti Lorenzo Corti Agathe Balayn Mireia Yurrita Philip Lippmann Marco Brambilla Jie-jin Yang 27 10 0 17 Oct 2022
State-of-the-art generalisation research in NLP: A taxonomy and review Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Ryan Cotterell Zhijing Jin 121 94 0 06 Oct 2022
Linear Connectivity Reveals Generalization Strategies Jeevesh Juneja Rachit Bansal Kyunghyun Cho João Sedoc Naomi Saphra 244 45 0 24 May 2022
When Does Syntax Mediate Neural Language Model Performance? Evidence from Dropout Probes Mycal Tucker Tiwalayo Eisape Peng Qian R. Levy J. Shah MILM 20 12 0 20 Apr 2022
Understanding Out-of-distribution: A Perspective of Data Dynamics Dyah Adila Dongyeop Kang 38 12 0 29 Nov 2021
A Logic-Based Framework for Natural Language Inference in Dutch Lasha Abzianidze Konstantinos Kogkalidis 23 2 0 07 Oct 2021
AdapterHub Playground: Simple and Flexible Few-Shot Learning with Adapters Tilman Beck Bela Bohlender Christina Viehmann Vincent Hane Yanik Adamson Jaber Khuri Jonas Brossmann Jonas Pfeiffer Iryna Gurevych 21 15 0 18 Aug 2021
Combining Feature and Instance Attribution to Detect Artifacts Pouya Pezeshkpour Sarthak Jain Sameer Singh Byron C. Wallace TDI 18 43 0 01 Jul 2021
Statistically Profiling Biases in Natural Language Reasoning Datasets and Models Shanshan Huang Kenny Q. Zhu 16 1 0 09 Feb 2021
Robustness Gym: Unifying the NLP Evaluation Landscape Karan Goel Nazneen Rajani Jesse Vig Samson Tan Jason M. Wu Stephan Zheng Caiming Xiong Joey Tianyi Zhou Christopher Ré AAML OffRL OOD 154 137 0 13 Jan 2021
ConjNLI: Natural Language Inference Over Conjunctive Sentences Swarnadeep Saha Yixin Nie Joey Tianyi Zhou 12 35 0 20 Oct 2020
An Empirical Study on Model-agnostic Debiasing Strategies for Robust Natural Language Inference Tianyu Liu Xin Zheng Xiaoan Ding Baobao Chang Zhifang Sui 29 23 0 08 Oct 2020
What Can We Learn from Collective Human Opinions on Natural Language Inference Data? Yixin Nie Xiang Zhou Joey Tianyi Zhou 21 129 0 07 Oct 2020
Explaining Deep Neural Networks Oana-Maria Camburu XAI FAtt 28 26 0 04 Oct 2020
Beyond Leaderboards: A survey of methods for revealing weaknesses in Natural Language Inference data and models Viktor Schlegel Goran Nenadic R. Batista-Navarro ELM 33 18 0 29 May 2020
The Curse of Performance Instability in Analysis Datasets: Consequences, Source, and Suggestions Xiang Zhou Yixin Nie Hao Tan Joey Tianyi Zhou 20 40 0 28 Apr 2020
HypoNLI: Exploring the Artificial Patterns of Hypothesis-only Bias in Natural Language Inference Tianyu Liu Xin Zheng Baobao Chang Zhifang Sui 43 23 0 05 Mar 2020
SesameBERT: Attention for Anywhere Ta-Chun Su Hsiang-Chih Cheng 30 7 0 08 Oct 2019
Make Up Your Mind! Adversarial Generation of Inconsistent Natural Language Explanations Oana-Maria Camburu Brendan Shillingford Pasquale Minervini Thomas Lukasiewicz Phil Blunsom AAML GAN 11 96 0 07 Oct 2019
Can I Trust the Explainer? Verifying Post-hoc Explanatory Methods Oana-Maria Camburu Eleonora Giunchiglia Jakob N. Foerster Thomas Lukasiewicz Phil Blunsom FAtt AAML 26 60 0 04 Oct 2019
Probing Neural Network Comprehension of Natural Language Arguments Timothy Niven Hung-Yu kao AAML 36 453 0 17 Jul 2019
Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference R. Thomas McCoy Ellie Pavlick Tal Linzen 43 1,212 0 04 Feb 2019
Analysis Methods in Neural Language Processing: A Survey Yonatan Belinkov James R. Glass 39 547 0 21 Dec 2018
Analyzing Compositionality-Sensitivity of NLI Models Yixin Nie Yicheng Wang Joey Tianyi Zhou CoGe 16 82 0 16 Nov 2018
Comparing Attention-based Convolutional and Recurrent Neural Networks: Success and Limitations in Machine Reading Comprehension Matthias Blohm Glorianna Jagfeld Ekta Sood Xiang Yu Ngoc Thang Vu 21 54 0 27 Aug 2018
A Decomposable Attention Model for Natural Language Inference Ankur P. Parikh Oscar Täckström Dipanjan Das Jakob Uszkoreit 213 1,367 0 06 Jun 2016