LMentry: A Language Model Benchmark of Elementary Language Tasks

v1v2 (latest)

LMentry: A Language Model Benchmark of Elementary Language Tasks

3 November 2022

ArXiv (abs)PDF HTML

Papers citing "LMentry: A Language Model Benchmark of Elementary Language Tasks"

10 / 10 papers shown

Title
Improving the Validity and Practical Usefulness of AI/ML Evaluations Using an Estimands Framework Olivier Binette Jerome P. Reiter 67 0 0 14 Jun 2024
Efficient multi-prompt evaluation of LLMs Felipe Maia Polo Ronald Xu Lucas Weber Mírian Silva Onkar Bhardwaj Leshem Choshen Allysson Flavio Melo de Oliveira Yuekai Sun Mikhail Yurochkin 106 27 0 27 May 2024
Large Language Models Lack Understanding of Character Composition of Words Andrew Shin Kunitake Kaneko 104 11 0 18 May 2024
State of What Art? A Call for Multi-Prompt LLM Evaluation Moran Mizrahi Guy Kaplan Daniel Malkin Rotem Dror Dafna Shahaf Gabriel Stanovsky ELM 111 147 0 31 Dec 2023
Transcending the Attention Paradigm: Representation Learning from Geospatial Social Media Data Nick DiSanto Anthony Corso Benjamin Sanders Gavin Harding GNN 18 0 0 09 Oct 2023
How is ChatGPT's behavior changing over time? Lingjiao Chen Matei A. Zaharia James Zou ELM KELM AI4MH 143 433 0 18 Jul 2023
Empowering Cross-lingual Behavioral Testing of NLP Models with Typological Features Ester Hlavnova Sebastian Ruder 80 5 0 11 Jul 2023
LLM-Assisted Content Analysis: Using Large Language Models to Support Deductive Coding Robert F. Chew John Bollenbacher Michael Wenger Jessica Speer Annice Kim ELM 58 74 0 23 Jun 2023
Surfacing Biases in Large Language Models using Contrastive Input Decoding G. Yona Or Honovich Itay Laish Roee Aharoni 65 12 0 12 May 2023
Unnatural Instructions: Tuning Language Models with (Almost) No Human Labor Or Honovich Thomas Scialom Omer Levy Timo Schick ALM 167 374 0 19 Dec 2022

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.