ALLURE: Auditing and Improving LLM-based Evaluation of Text using
Iterative In-Context-Learning

ALLURE: Auditing and Improving LLM-based Evaluation of Text using Iterative In-Context-Learning

24 September 2023

Hosein Hasanbeig

Felipe Vieira Frujeri

Papers citing "ALLURE: Auditing and Improving LLM-based Evaluation of Text using Iterative In-Context-Learning"

15 / 15 papers shown

Title
Comparing LLM Text Annotation Skills: A Study on Human Rights Violations in Social Media Data Poli Nemkova S. Ubani Mark V. Albert AILaw 35 0 0 15 May 2025
From Cool Demos to Production-Ready FMware: Core Challenges and a Technology Roadmap Gopi Krishnan Rajbahadur G. Oliva Dayi Lin Ahmed E. Hassan 43 1 0 28 Jan 2025
From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judge Dawei Li Bohan Jiang Liangjie Huang Alimohammad Beigi Chengshuai Zhao ... Canyu Chen Tianhao Wu Kai Shu Lu Cheng Huan Liu ELM AILaw 120 65 0 25 Nov 2024
Leveraging the Power of LLMs: A Fine-Tuning Approach for High-Quality Aspect-Based Summarization Ankan Mullick Sombit Bose Rounak Saha Ayan Kumar Bhowmick Aditya Vempaty Pawan Goyal Niloy Ganguly Prasenjit Dey Ravi Kokku 33 0 0 05 Aug 2024
Finding Blind Spots in Evaluator LLMs with Interpretable Checklists Sumanth Doddapaneni Mohammed Safi Ur Rahman Khan Sshubam Verma Mitesh Khapra 36 11 0 19 Jun 2024
Aligning Large Language Models from Self-Reference AI Feedback with one General Principle Rong Bao Rui Zheng Shihan Dou Xiao Wang Enyu Zhou Bo Wang Qi Zhang Liang Ding Dacheng Tao ALM 48 0 0 17 Jun 2024
Navigating LLM Ethics: Advancements, Challenges, and Future Directions Junfeng Jiao S. Afroogh Yiming Xu Connor Phillips AILaw 62 19 0 14 May 2024
Intelligent Monitoring Framework for Cloud Services: A Data-Driven Approach Pooja Srinivas Fiza Husain Anjaly Parayil Ayush Choure Chetan Bansal Saravan Rajmohan 30 5 0 29 Feb 2024
LLMAuditor: A Framework for Auditing Large Language Models Using Human-in-the-Loop Maryam Amirizaniani Jihan Yao Adrian Lavergne Elizabeth Snell Okada Aman Chadha Tanya Roosta Chirag Shah HILM 28 2 0 14 Feb 2024
LLM-based NLG Evaluation: Current Status and Challenges Mingqi Gao Xinyu Hu Jie Ruan Xiao Pu Xiaojun Wan ELM LM&MA 57 29 0 02 Feb 2024
Decoding In-Context Learning: Neuroscience-inspired Analysis of Representations in Large Language Models Safoora Yousefi Leo Betthauser Hosein Hasanbeig Raphael Milliere Ida Momennejad 21 4 0 30 Sep 2023
Practical and Ethical Challenges of Large Language Models in Education: A Systematic Scoping Review Lixiang Yan Lele Sha Linxuan Zhao Yuheng Li Roberto Martínez-Maldonado Guanliang Chen Xinyu Li Yueqiao Jin D. Gašević SyDa ELM AI4Ed 51 267 0 17 Mar 2023
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 313 11,915 0 04 Mar 2022
What Makes Good In-Context Examples for GPT- $3$ ? Jiachang Liu Dinghan Shen Yizhe Zhang Bill Dolan Lawrence Carin Weizhu Chen AAML RALM 275 1,312 0 17 Jan 2021
Teaching Machines to Read and Comprehend Karl Moritz Hermann Tomás Kociský Edward Grefenstette L. Espeholt W. Kay Mustafa Suleyman Phil Blunsom 175 3,509 0 10 Jun 2015