v1v2 (latest)

Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Models

1 January 2021

Tongshuang Wu

Marco Tulio Ribeiro

Jeffrey Heer

Daniel S. Weld

ArXiv (abs)PDF HTML

Papers citing "Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Models"

50 / 181 papers shown

Title
On Degrees of Freedom in Defining and Testing Natural Language Understanding Saku Sugawara S. Tsugita ELM 91 1 0 24 May 2023
Clever Hans or Neural Theory of Mind? Stress Testing Social Reasoning in Large Language Models Natalie Shapira Mosh Levy S. Alavi Xuhui Zhou Yejin Choi Yoav Goldberg Maarten Sap Vered Shwartz LLMAG ELM 116 128 0 24 May 2023
Exploring Contrast Consistency of Open-Domain Question Answering Systems on Minimally Edited Questions Zhihan Zhang Wenhao Yu Zheng Ning Mingxuan Ju Meng Jiang 77 4 0 23 May 2023
Out-of-Distribution Generalization in Text Classification: Past, Present, and Future Linyi Yang Yangqiu Song Xuan Ren Chenyang Lyu Yidong Wang Lingqiao Liu Jindong Wang Jennifer Foster Yue Zhang OOD 131 3 0 23 May 2023
Improving Classifier Robustness through Active Generation of Pairwise Counterfactuals Ananth Balashankar Xuezhi Wang Yao Qin Ben Packer Nithum Thain Jilin Chen Ed H. Chi Alex Beutel 70 0 0 22 May 2023
SCENE: Self-Labeled Counterfactuals for Extrapolating to Negative Examples Deqing Fu Ameya Godbole Robin Jia 81 8 0 13 May 2023
COLA: Contextualized Commonsense Causal Reasoning from the Causal Inference Perspective Zhaowei Wang Quyet V. Do Hongming Zhang Jiayao Zhang Weiqi Wang Tianqing Fang Yangqiu Song Ginny Wong Simon See LRM 64 31 0 09 May 2023
ANTONIO: Towards a Systematic Method of Generating NLP Benchmarks for Verification Marco Casadio Luca Arnaboldi M. Daggitt Omri Isac Tanvi Dinkar Daniel Kienitz Verena Rieser Ekaterina Komendantskaya 92 4 0 06 May 2023
ReMask: A Robust Information-Masking Approach for Domain Counterfactual Generation Pengfei Hong Rishabh Bhardwaj Navonil Majumdar Somak Aditya Soujanya Poria AAML 60 0 0 04 May 2023
Explaining Language Models' Predictions with High-Impact Concepts Ruochen Zhao Shafiq Joty Yongjie Wang Tan Wang LRM 88 9 0 03 May 2023
TIGTEC : Token Importance Guided TExt Counterfactuals Milan Bhan Jean-Noel Vittaut Nicolas Chesneau Marie-Jeanne Lesot 102 9 0 24 Apr 2023
Angler: Helping Machine Translation Practitioners Prioritize Model Improvements Samantha Robertson Zijie J. Wang Dominik Moritz Mary Beth Kery Fred Hohman 102 16 0 12 Apr 2023
Explaining Recommendation System Using Counterfactual Textual Explanations Niloofar Ranjbar S. Momtazi MohammadMehdi Homayounpour 102 4 0 14 Mar 2023
GAM Coach: Towards Interactive and User-centered Algorithmic Recourse Zijie J. Wang J. W. Vaughan R. Caruana Duen Horng Chau HAI 96 22 0 27 Feb 2023
ScatterShot: Interactive In-context Example Curation for Text Transformation Tongshuang Wu Hua Shen Daniel S. Weld Jeffrey Heer Marco Tulio Ribeiro 60 25 0 14 Feb 2023
Toward a Theory of Causation for Interpreting Neural Code Models David Nader-Palacio Alejandro Velasco Nathan Cooper Á. Rodríguez Kevin Moran Denys Poshyvanyk 102 17 0 07 Feb 2023
DISCO: Distilling Counterfactuals with Large Language Models Zeming Chen Qiyue Gao Antoine Bosselut Ashish Sabharwal Kyle Richardson 104 31 0 20 Dec 2022
Discovering Language Model Behaviors with Model-Written Evaluations Ethan Perez Sam Ringer Kamilė Lukošiūtė Karina Nguyen Edwin Chen ... Danny Hernandez Deep Ganguli Evan Hubinger Nicholas Schiefer Jared Kaplan ALM 107 407 0 19 Dec 2022
AGRO: Adversarial Discovery of Error-prone groups for Robust Optimization Bhargavi Paranjape Pradeep Dasigi Vivek Srikumar Luke Zettlemoyer Hannaneh Hajishirzi 103 8 0 02 Dec 2022
AutoCAD: Automatically Generating Counterfactuals for Mitigating Shortcut Learning Jiaxin Wen Yeshuang Zhu Jinchao Zhang Jie Zhou Minlie Huang CML AAML 120 9 0 29 Nov 2022
GLUE-X: Evaluating Natural Language Understanding Models from an Out-of-distribution Generalization Perspective Linyi Yang Shuibai Zhang Libo Qin Yafu Li Yidong Wang Hanmeng Liu Jindong Wang Xingxu Xie Yue Zhang ELM 191 82 0 15 Nov 2022
Capabilities for Better ML Engineering Chenyang Yang Rachel A. Brower-Sinning Grace A. Lewis Christian Kastner Tongshuang Wu 63 4 0 11 Nov 2022
Discover, Explanation, Improvement: An Automatic Slice Detection Framework for Natural Language Processing Wenyue Hua Lifeng Jin Linfeng Song Haitao Mi Yongfeng Zhang Dong Yu 87 1 0 08 Nov 2022
NaturalAdversaries: Can Naturalistic Adversaries Be as Effective as Artificial Adversaries? Saadia Gabriel Hamid Palangi Yejin Choi AAML 98 1 0 08 Nov 2022
A General Search-based Framework for Generating Textual Counterfactual Explanations Daniel Gilo Shaul Markovitch LRM 94 0 0 01 Nov 2022
BioNLI: Generating a Biomedical NLI Dataset Using Lexico-semantic Constraints for Adversarial Examples Mohaddeseh Bastan Mihai Surdeanu Niranjan Balasubramanian 88 13 0 26 Oct 2022
Rich Knowledge Sources Bring Complex Knowledge Conflicts: Recalibrating Models to Reflect Conflicting Evidence Hung-Ting Chen Michael J.Q. Zhang Eunsol Choi RALM HILM 141 100 0 25 Oct 2022
Cascading Biases: Investigating the Effect of Heuristic Annotation Strategies on Data and Models Chaitanya Malaviya Sudeep Bhatia Mark Yatskar 69 4 0 24 Oct 2022
NeuroCounterfactuals: Beyond Minimal-Edit Counterfactuals for Richer Data Augmentation Phillip Howard Gadi Singer Vasudev Lal Yejin Choi Swabha Swayamdipta CML 121 25 0 22 Oct 2022
Robustifying Sentiment Classification by Maximally Exploiting Few Counterfactuals Maarten De Raedt Fréderic Godin Chris Develder Thomas Demeester 50 1 0 21 Oct 2022
Controllable Fake Document Infilling for Cyber Deception Yibo Hu Yu Lin Eric Parolin Latif Khan Kevin W. Hamlen 68 8 0 18 Oct 2022
Beyond Model Interpretability: On the Faithfulness and Adversarial Robustness of Contrastive Textual Explanations Julia El Zini M. Awad AAML 72 2 0 17 Oct 2022
CORE: A Retrieve-then-Edit Framework for Counterfactual Data Generation Tanay Dixit Bhargavi Paranjape Hannaneh Hajishirzi Luke Zettlemoyer SyDa 216 26 0 10 Oct 2022
FAST: Improving Controllability for Text Generation with Feedback Aware Self-Training Junyi Chai Reid Pryzant Victor Ye Dong Konstantin Golobokov Chenguang Zhu Yi Liu 90 5 0 06 Oct 2022
Unpacking Large Language Models with Conceptual Consistency Pritish Sahu Michael Cogswell Yunye Gong Ajay Divakaran LRM 116 17 0 29 Sep 2022
Causal Proxy Models for Concept-Based Model Explanations Zhengxuan Wu Karel DÓosterlinck Atticus Geiger Amir Zur Christopher Potts MILM 132 37 0 28 Sep 2022
Towards Faithful Model Explanation in NLP: A Survey Qing Lyu Marianna Apidianaki Chris Callison-Burch XAI 244 121 0 22 Sep 2022
On Faithfulness and Coherence of Language Explanations for Recommendation Systems Zhouhang Xie Julian McAuley Bodhisattwa Prasad Majumder LRM 79 1 0 12 Sep 2022
Interpreting Embedding Spaces by Conceptualization Adi Simhi Shaul Markovitch 99 7 0 22 Aug 2022
Leveraging Explanations in Interactive Machine Learning: An Overview Stefano Teso Öznur Alkan Wolfgang Stammer Elizabeth M. Daly XAI FAtt LRM 164 63 0 29 Jul 2022
Efficient Classification with Counterfactual Reasoning and Active Learning A. Mohammed D. Nguyen Bao Duong T. Nguyen CML 62 1 0 25 Jul 2022
Flexible text generation for counterfactual fairness probing Zee Fryer Vera Axelrod Ben Packer Alex Beutel Jilin Chen Kellie Webster 38 19 0 28 Jun 2022
Challenges in Applying Explainability Methods to Improve the Fairness of NLP Models Esma Balkir S. Kiritchenko I. Nejadgholi Kathleen C. Fraser 94 37 0 08 Jun 2022
OmniXAI: A Library for Explainable AI Wenzhuo Yang Hung Le Tanmay Laud Silvio Savarese Guosheng Lin SyDa 83 41 0 01 Jun 2022
Order-sensitive Shapley Values for Evaluating Conceptual Soundness of NLP Models Kaiji Lu Anupam Datta 60 0 0 01 Jun 2022
Leveraging Causal Inference for Explainable Automatic Program Repair Jianzong Wang Shijing Si Z. Zhu Xiaoyang Qu Zhenhou Hong Jing Xiao 105 4 0 26 May 2022
Counterfactually Augmented Data and Unintended Bias: The Case of Sexism and Hate Speech Detection Indira Sen Mattia Samory Claudia Wagner Isabelle Augenstein 74 17 0 09 May 2022
Necessity and Sufficiency for Explaining Text Classifiers: A Case Study in Hate Speech Detection Esma Balkir I. Nejadgholi Kathleen C. Fraser S. Kiritchenko FAtt 69 27 0 06 May 2022
ExSum: From Local Explanations to Model Understanding Yilun Zhou Marco Tulio Ribeiro J. Shah FAtt LRM 93 25 0 30 Apr 2022
Counterfactual Explanations for Natural Language Interfaces George Tolkachev Stephen Mell Steve Zdancewic Osbert Bastani LRM AAML 43 4 0 27 Apr 2022