Scaling Laws Do Not Scale

5 July 2023

Papers citing "Scaling Laws Do Not Scale"

31 / 31 papers shown

Title
Bound by the Bounty: Collaboratively Shaping Evaluation Processes for Queer AI Harms Organizers of QueerInAI Nathaniel Dennler Anaelia Ovalle Ashwin Singh Luca Soldaini ... Kyra Yee Irene Font Peradejordi Zeerak Talat Mayra Russo Jessica de Jesus de Pinho Pinhal 41 15 0 15 Jul 2023
"I'm fully who I am": Towards Centering Transgender and Non-Binary Voices to Measure Biases in Open Language Generation Anaelia Ovalle Palash Goyal Jwala Dhamala Zachary Jaggers Kai-Wei Chang Aram Galstyan R. Zemel Rahul Gupta 55 65 0 17 May 2023
Whose Opinions Do Language Models Reflect? Shibani Santurkar Esin Durmus Faisal Ladhak Cinoo Lee Percy Liang Tatsunori Hashimoto 66 426 0 30 Mar 2023
Queer In AI: A Case Study in Community-Led Participatory AI AI OrganizersOfQueerin : Anaelia Ovalle Arjun Subramonian Ashwin Singh ... Evyn Dǒng Jackie Kay Manu Saraswat Nikhil Vytla Luke Stark 58 52 0 29 Mar 2023
Scaling laws for single-agent reinforcement learning Jacob Hilton Jie Tang John Schulman 88 21 0 31 Jan 2023
Cultural Re-contextualization of Fairness Research in Language Technologies in India Shaily Bhatt Sunipa Dev Partha P. Talukdar Shachi Dave Vinodkumar Prabhakaran 59 3 0 21 Nov 2022
The four-fifths rule is not disparate impact: a woeful tale of epistemic trespassing in algorithmic fairness E. A. Watkins Michael McKenna Jiahao Chen 56 31 0 19 Feb 2022
Assessing the Fairness of AI Systems: AI Practitioners' Processes, Challenges, and Needs for Support Michael A. Madaio Lisa Egede Hariharan Subramonyam Jennifer Wortman Vaughan Hanna M. Wallach 54 147 0 10 Dec 2021
A General Language Assistant as a Laboratory for Alignment Amanda Askell Yuntao Bai Anna Chen Dawn Drain Deep Ganguli ... Tom B. Brown Jack Clark Sam McCandlish C. Olah Jared Kaplan ALM 114 775 0 01 Dec 2021
AI and the Everything in the Whole Wide World Benchmark Inioluwa Deborah Raji Emily M. Bender Amandalynne Paullada Emily L. Denton A. Hanna 68 305 0 26 Nov 2021
ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning V. Aribandi Yi Tay Tal Schuster J. Rao H. Zheng ... Jianmo Ni Jai Gupta Kai Hui Sebastian Ruder Donald Metzler MoE 75 215 0 22 Nov 2021
Stakeholder Participation in AI: Beyond "Add Diverse Stakeholders and Stir" Fernando Delgado Stephen Yang Michael A. Madaio Qian Yang 61 55 0 01 Nov 2021
Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologies Sunipa Dev Masoud Monajatipoor Anaelia Ovalle Arjun Subramonian J. M. Phillips Kai-Wei Chang 102 170 0 27 Aug 2021
The Values Encoded in Machine Learning Research Abeba Birhane Pratyusha Kalluri Dallas Card William Agnew Ravit Dotan Michelle Bao 64 282 0 29 Jun 2021
Process for Adapting Language Models to Society (PALMS) with Values-Targeted Datasets Irene Solaiman Christy Dennison 85 224 0 18 Jun 2021
The Contestation of Tech Ethics: A Sociotechnical Approach to Technology Ethics in Practice Benson K. Green AILaw 42 56 0 03 Jun 2021
What's in the Box? A Preliminary Analysis of Undesirable Content in the Common Crawl Corpus A. Luccioni J. Viviano 58 118 0 06 May 2021
Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpus Jesse Dodge Maarten Sap Ana Marasović William Agnew Gabriel Ilharco Dirk Groeneveld Margaret Mitchell Matt Gardner AILaw 96 443 0 18 Apr 2021
Designing Disaggregated Evaluations of AI Systems: Choices, Considerations, and Tradeoffs Solon Barocas Anhong Guo Ece Kamar J. Krones Meredith Ringel Morris Jennifer Wortman Vaughan Duncan Wadsworth Hanna M. Wallach 57 77 0 10 Mar 2021
Characterizing Intersectional Group Fairness with Worst-Case Comparisons A. Ghosh Lea Genuit Mary Reagan FaML 110 53 0 05 Jan 2021
Participation is not a Design Fix for Machine Learning Mona Sloane Emanuel Moss O. Awomolo Laura Forlano HAI 53 209 0 05 Jul 2020
Low-resource Languages: A Review of Past Work and Future Challenges Alexandre Magueresse Vincent Carles Evan Heetderks 55 176 0 12 Jun 2020
Are All Languages Created Equal in Multilingual BERT? Shijie Wu Mark Dredze 66 322 0 18 May 2020
The Problem with Metrics is a Fundamental Problem for AI Rachel L. Thomas D. Uminsky 98 68 0 20 Feb 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 532 4,773 0 23 Jan 2020
Measurement and Fairness Abigail Z. Jacobs Hanna M. Wallach 78 387 0 11 Dec 2019
A Constructive Prediction of the Generalization Error Across Scales Jonathan S. Rosenfeld Amir Rosenfeld Yonatan Belinkov Nir Shavit 91 211 0 27 Sep 2019
On the Difficulty of Evaluating Baselines: A Study on Recommender Systems Steffen Rendle Li Zhang Y. Koren 66 127 0 04 May 2019
A Call for Clarity in Reporting BLEU Scores Matt Post 129 2,978 0 23 Apr 2018
Fair prediction with disparate impact: A study of bias in recidivism prediction instruments Alexandra Chouldechova FaML 295 2,109 0 24 Oct 2016
Equality of Opportunity in Supervised Learning Moritz Hardt Eric Price Nathan Srebro FaML 202 4,301 0 07 Oct 2016