v1v2 (latest)

Model Cards for Model Reporting

5 October 2018

Inioluwa Deborah Raji

Timnit Gebru

ArXiv (abs)PDF HTML

Papers citing "Model Cards for Model Reporting"

50 / 417 papers shown

Title
Reusable Templates and Guides For Documenting Datasets and Models for Natural Language Processing and Generation: A Case Study of the HuggingFace and GEM Data and Model Cards Angelina McMillan-Major Salomey Osei Juan Diego Rodriguez Pawan Sasanka Ammanamanchi Sebastian Gehrmann Yacine Jernite 86 49 0 16 Aug 2021
On Measures of Biases and Harms in NLP Sunipa Dev Emily Sheng Jieyu Zhao Aubrie Amstutz Jiao Sun ... M. Sanseverino Jiin Kim Akihiro Nishi Nanyun Peng Kai-Wei Chang 78 88 0 07 Aug 2021
Mitigating Dataset Harms Requires Stewardship: Lessons from 1000 Papers Kenny Peng Arunesh Mathur Arvind Narayanan 188 97 0 06 Aug 2021
Underreporting of errors in NLG output, and what to do about it Emiel van Miltenburg Miruna Clinciu Ondrej Dusek Dimitra Gkatzia Stephanie Inglis ... Saad Mahamood Emma Manning S. Schoch Craig Thomson Luou Wen 68 38 0 02 Aug 2021
Artificial Intelligence in Healthcare: Lost In Translation? V. Madai David C. Higgins 18 4 0 28 Jul 2021
QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehension Anna Rogers Matt Gardner Isabelle Augenstein 135 168 0 27 Jul 2021
MultiBench: Multiscale Benchmarks for Multimodal Representation Learning Paul Pu Liang Yiwei Lyu Xiang Fan Zetian Wu Yun Cheng ... Peter Wu Michelle A. Lee Yuke Zhu Ruslan Salakhutdinov Louis-Philippe Morency VLM 111 171 0 15 Jul 2021
Anticipating Safety Issues in E2E Conversational AI: Framework and Tooling Emily Dinan Gavin Abercrombie A. S. Bergman Shannon L. Spruit Dirk Hovy Y-Lan Boureau Verena Rieser 97 109 0 07 Jul 2021
"Garbage In, Garbage Out" Revisited: What Do Machine Learning Application Papers Report About Human-Labeled Training Data? R. Geiger Dominique Cope Jamie Ip Marsha Lotosh Aayush Shah Jenny Weng Rebekah Tang 44 63 0 05 Jul 2021
Ethics Sheets for AI Tasks Saif M. Mohammad 78 32 0 02 Jul 2021
The Spotlight: A General Method for Discovering Systematic Errors in Deep Learning Models G. dÉon Jason dÉon J. R. Wright Kevin Leyton-Brown 79 75 0 01 Jul 2021
Using AntiPatterns to avoid MLOps Mistakes Nikhil Muralidhar Sathappah Muthiah P. Butler Manish Jain Yu Yu ... Weipeng Li David Jones P. Arunachalam Hays Mccormick Naren Ramakrishnan 56 17 0 30 Jun 2021
Reliability and Validity of Image-Based and Self-Reported Skin Phenotype Metrics John J. Howard Yevgeniy B. Sirotin Jerry L. Tipton A. Vemury 80 28 0 18 Jun 2021
Latent Mappings: Generating Open-Ended Expressive Mappings Using Variational Autoencoders Tim Murray Browne P. Tigas DRL 29 14 0 16 Jun 2021
Best of both worlds: local and global explanations with human-understandable concepts Jessica Schrouff Sebastien Baur Shaobo Hou Diana Mincu Eric Loreaux Ralph Blanes James Wexler Alan Karthikesalingam Been Kim FAtt 103 28 0 16 Jun 2021
Counterfactual Explanations for Machine Learning: Challenges Revisited Sahil Verma John P Dickerson Keegan E. Hines LRM 55 27 0 14 Jun 2021
A Discussion on Building Practical NLP Leaderboards: The Case of Machine Translation Sebastin Santy Prasanta Bhattacharya LLMAG 75 3 0 11 Jun 2021
Ruddit: Norms of Offensiveness for English Reddit Comments Rishav Hada S. Sudhir Pushkar Mishra H. Yannakoudakis Saif M. Mohammad Ekaterina Shutova 94 37 0 10 Jun 2021
Hard Choices in Artificial Intelligence Roel Dobbe T. Gilbert Yonatan Dov Mintz 71 58 0 10 Jun 2021
Generative Models as a Data Source for Multiview Representation Learning Ali Jahanian Xavier Puig Yonglong Tian Phillip Isola 99 129 0 09 Jun 2021
Widening Access to Applied Machine Learning with TinyML Vijay Janapa Reddi Brian Plancher Susan Kennedy L. Moroney Pete Warden ... Dominic Pajak Dhilan Ramaprasad J. E. Smith Matthew P. Stewart D. Tingley 73 52 0 07 Jun 2021
How Good Is NLP? A Sober Look at NLP Tasks through the Lens of Social Impact Zhijing Jin Geeticka Chauhan Brian Tse Mrinmaya Sachan Rada Mihalcea 88 26 0 04 Jun 2021
The Contestation of Tech Ethics: A Sociotechnical Approach to Technology Ethics in Practice Benson K. Green AILaw 76 58 0 03 Jun 2021
Generate, Prune, Select: A Pipeline for Counterspeech Generation against Online Hate Speech Wanzheng Zhu S. Bhat 66 57 0 03 Jun 2021
The Care Label Concept: A Certification Suite for Trustworthy and Resource-Aware Machine Learning K. Morik Helena Kotthaus Lukas Heppe Danny Heinrich Raphael Fischer Andrea Pauly Nico Piatkowski 104 4 0 01 Jun 2021
DISSECT: Disentangled Simultaneous Explanations via Concept Traversals Asma Ghandeharioun Been Kim Chun-Liang Li Brendan Jou B. Eoff Rosalind W. Picard AAML 91 54 0 31 May 2021
Ten Quick Tips for Deep Learning in Biology Benjamin D. Lee A. Gitter Casey S. Greene S. Raschka F. Maguire ... Alexandr A Kalinin T. Triche Benjamin J. Lengerich Timothy J. Triche Jr S. Boca OOD 97 27 0 29 May 2021
Changing the World by Changing the Data Anna Rogers 76 73 0 28 May 2021
Yes We Care! -- Certification for Machine Learning Methods through the Care Label Framework K. Morik Helena Kotthaus Raphael Fischer Sascha Mucke Matthias Jakobs Nico Piatkowski Andrea Pauly Lukas Heppe Danny Heinrich 60 11 0 21 May 2021
Dynaboard: An Evaluation-As-A-Service Platform for Holistic Next-Generation Benchmarking Zhiyi Ma Kawin Ethayarajh Tristan Thrush Somya Jain Ledell Yu Wu Robin Jia Christopher Potts Adina Williams Douwe Kiela ELM 115 59 0 21 May 2021
Feature Interactions on Steroids: On the Composition of ML Models Christian Kastner Eunsuk Kang S. Apel 77 10 0 13 May 2021
Providing Assurance and Scrutability on Shared Data and Machine Learning Models with Verifiable Credentials I. Barclay Alun D. Preece Ian J. Taylor S. Radha J. Nabrzyski 42 14 0 13 May 2021
Reliability Testing for Natural Language Processing Systems Samson Tan Shafiq Joty K. Baxter Araz Taeihagh G. Bennett Min-Yen Kan 96 41 0 06 May 2021
A Step Toward More Inclusive People Annotations for Fairness Candice Schumann Susanna Ricco Utsav Prabhu V. Ferrari C. Pantofaru 76 64 0 05 May 2021
Learning by Design: Structuring and Documenting the Human Choices in Machine Learning Development Simon Enni Ira Assent 24 3 0 03 May 2021
An Examination of Fairness of AI Models for Deepfake Detection Loc Trinh Yang Liu CVBM 137 35 0 02 May 2021
Mitigating Political Bias in Language Models Through Reinforced Calibration Ruibo Liu Chenyan Jia Jason W. Wei Guangxuan Xu Lili Wang Soroush Vosoughi 73 99 0 30 Apr 2021
Discover the Unknown Biased Attribute of an Image Classifier Zhiheng Li Chenliang Xu 75 50 0 29 Apr 2021
Model-based metrics: Sample-efficient estimates of predictive model subpopulation performance Andrew C. Miller Leon A. Gatys Joseph D. Futoma E. Fox 63 9 0 25 Apr 2021
CLIPScore: A Reference-free Evaluation Metric for Image Captioning Jack Hessel Ari Holtzman Maxwell Forbes Ronan Le Bras Yejin Choi CLIP 214 1,594 0 18 Apr 2021
A Multistakeholder Approach Towards Evaluating AI Transparency Mechanisms Ana Lucic Madhulika Srikumar Umang Bhatt Alice Xiang Ankur Taly Q. V. Liao Maarten de Rijke 45 5 0 27 Mar 2021
Characterizing and Detecting Mismatch in Machine-Learning-Enabled Systems Grace A. Lewis S. Bellomo Ipek Ozkaya 57 39 0 25 Mar 2021
Requirement Engineering Challenges for AI-intense Systems Development Hans-Martin Heyn E. Knauss Amna Pir Muhammad O. Eriksson Jennifer Linder P. Subbiah S. K. Pradhan Sagar Tungal 66 36 0 18 Mar 2021
The Human Evaluation Datasheet 1.0: A Template for Recording Details of Human Evaluation Experiments in NLP Anastasia Shimorina Anya Belz 83 33 0 17 Mar 2021
Preregistering NLP Research Emiel van Miltenburg Chris van der Lee E. Krahmer AI4CE 80 24 0 11 Mar 2021
Fairness On The Ground: Applying Algorithmic Fairness Approaches to Production Systems Chloé Bakalar Renata Barreto Stevie Bergman Miranda Bogen Bobbie Chern ... J. Simons Jonathan Tannen Edmund Tong Kate Vredenburgh Jiejing Zhao FaML 123 28 0 10 Mar 2021
Designing Disaggregated Evaluations of AI Systems: Choices, Considerations, and Tradeoffs Solon Barocas Anhong Guo Ece Kamar J. Krones Meredith Ringel Morris Jennifer Wortman Vaughan Duncan Wadsworth Hanna M. Wallach 80 79 0 10 Mar 2021
A framework for fostering transparency in shared artificial intelligence models by increasing visibility of contributions I. Barclay Harrison Taylor Alun D. Preece Ian J. Taylor D. Verma Geeth de Mel 65 13 0 05 Mar 2021
Adaptive Sampling for Minimax Fair Classification S. Shekhar Greg Fields Mohammad Ghavamzadeh T. Javidi FaML 141 38 0 01 Mar 2021
Documentation Matters: Human-Centered AI System to Assist Data Science Code Documentation in Computational Notebooks A. Wang Dakuo Wang Jaimie Drozdal Michael J. Muller Soya Park Justin D. Weisz Xuye Liu Lingfei Wu Casey Dugan 116 66 0 24 Feb 2021