minicons: Enabling Flexible Behavioral and Representational Analyses of Transformer Language Models

24 March 2022

Papers citing "minicons: Enabling Flexible Behavioral and Representational Analyses of Transformer Language Models"

13 / 13 papers shown

Title
Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora Alex Warstadt Aaron Mueller Leshem Choshen E. Wilcox Chengxu Zhuang ... Rafael Mosquera Bhargavi Paranjape Adina Williams Tal Linzen Ryan Cotterell 83 115 0 10 Apr 2025
Language Models Largely Exhibit Human-like Constituent Ordering Preferences Ada Defne Tur Gaurav Kamath Siva Reddy 86 0 0 08 Feb 2025
Teaching Models to Balance Resisting and Accepting Persuasion Elias Stengel-Eskin Peter Hase Joey Tianyi Zhou MU 42 5 0 18 Oct 2024
Towards Zero-shot Commonsense Reasoning with Self-supervised Refinement of Language Models T. Klein Moin Nabi ReLM LRM 51 8 0 10 Sep 2021
The Pile: An 800GB Dataset of Diverse Text for Language Modeling Leo Gao Stella Biderman Sid Black Laurence Golding Travis Hoppe ... Horace He Anish Thite Noa Nabeshima Shawn Presser Connor Leahy AIMat 356 2,051 0 31 Dec 2020
Unsupervised Commonsense Question Answering with Self-Talk Vered Shwartz Peter West Ronan Le Bras Chandra Bhagavatula Yejin Choi ReLM SSL AI4MH LRM 31 260 0 11 Apr 2020
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter Victor Sanh Lysandre Debut Julien Chaumond Thomas Wolf 82 7,386 0 02 Oct 2019
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Zhenzhong Lan Mingda Chen Sebastian Goodman Kevin Gimpel Piyush Sharma Radu Soricut SSL AIMat 234 6,420 0 26 Sep 2019
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 515 2,639 0 03 Sep 2019
Neural Language Models as Psycholinguistic Subjects: Representations of Syntactic State Richard Futrell Ethan Gotlieb Wilcox Takashi Morita Peng Qian Miguel Ballesteros R. Levy MILM 116 193 0 08 Mar 2019
Targeted Syntactic Evaluation of Language Models Rebecca Marvin Tal Linzen 47 414 0 27 Aug 2018
Neural Network Acceptability Judgments Alex Warstadt Amanpreet Singh Samuel R. Bowman 137 1,390 0 31 May 2018
What you can cram into a single vector: Probing sentence embeddings for linguistic properties Alexis Conneau Germán Kruszewski Guillaume Lample Loïc Barrault Marco Baroni 251 888 0 03 May 2018