Aligning Model Evaluations with Human Preferences: Mitigating Token Count Bias in Language Model Assessments

5 July 2024

Papers citing "Aligning Model Evaluations with Human Preferences: Mitigating Token Count Bias in Language Model Assessments"

5 / 5 papers shown

Title
Scaling Down to Scale Up: A Cost-Benefit Analysis of Replacing OpenAI's LLM with Open Source SLMs in Production Chandra Irugalbandara Ashish Mahendra Roland Daynauth T. Arachchige Kugesan Sivasothynathan Krisztian Flautner Lingjia Tang Yiping Kang Jason Mars ELM 42 17 0 20 Dec 2023
Orca 2: Teaching Small Language Models How to Reason Arindam Mitra Luciano Del Corro Shweti Mahajan Andres Codas Clarisse Simoes ... Hamid Palangi Guoqing Zheng Corby Rosset Hamed Khanpour Ahmed Hassan Awadallah ReLM LRM 27 137 0 18 Nov 2023
Zephyr: Direct Distillation of LM Alignment Lewis Tunstall E. Beeching Nathan Lambert Nazneen Rajani Kashif Rasul ... Nathan Habib Nathan Sarrazin Omar Sanseviero Alexander M. Rush Thomas Wolf ALM 59 382 0 25 Oct 2023
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Nils Reimers Iryna Gurevych 545 11,979 0 27 Aug 2019
BERTScore: Evaluating Text Generation with BERT Tianyi Zhang Varsha Kishore Felix Wu Kilian Q. Weinberger Yoav Artzi 187 5,668 0 21 Apr 2019