LegalBench: Prototyping a Collaborative Benchmark for Legal Reasoning

LegalBench: Prototyping a Collaborative Benchmark for Legal Reasoning

13 September 2022

Christopher Ré

Papers citing "LegalBench: Prototyping a Collaborative Benchmark for Legal Reasoning"

13 / 13 papers shown

Title
SaulLM-54B & SaulLM-141B: Scaling Up Domain Adaptation for the Legal Domain Pierre Colombo T. Pires Malik Boudiaf Rui Melo Dominic Culver Sofia Morgado Etienne Malaboeuf Gabriel Hautreux Johanne Charpentier Michael Desa ELM AILaw ALM 37 12 0 28 Jul 2024
Bridging Law and Data: Augmenting Reasoning via a Semi-Structured Dataset with IRAC methodology Xiaoxi Kang Lizhen Qu Lay-Ki Soon Zhuang Li Adnan Trakic AILaw 37 1 0 19 Jun 2024
Evaluating AI for Law: Bridging the Gap with Open-Source Solutions R. Bhambhoria Samuel Dahan Jonathan Li Xiaodan Zhu ELM 24 3 0 18 Apr 2024
Evalverse: Unified and Accessible Library for Large Language Model Evaluation Jihoo Kim Wonho Song Dahyun Kim Yunsu Kim Yungi Kim Chanjun Park ELM 61 3 0 01 Apr 2024
SaulLM-7B: A pioneering Large Language Model for Law Pierre Colombo T. Pires Malik Boudiaf Dominic Culver Rui Melo ... Andre F. T. Martins Fabrizio Esposito Vera Lúcia Raposo Sofia Morgado Michael Desa ELM AILaw 43 66 0 06 Mar 2024
Inadequacies of Large Language Model Benchmarks in the Era of Generative Artificial Intelligence Timothy R. McIntosh Teo Susnjak Tong Liu Paul Watters Malka N. Halgamuge ALM ELM 64 50 0 15 Feb 2024
BLT: Can Large Language Models Handle Basic Legal Text? Andrew Blair-Stanek Nils Holzenberger Benjamin Van Durme AILaw ELM 45 7 0 16 Nov 2023
Can ChatGPT Perform Reasoning Using the IRAC Method in Analyzing Legal Scenarios Like a Lawyer? Xiaoxi Kang Lizhen Qu Lay-Ki Soon Adnan Trakic Terry Yue Zhuo Patrick Charles Emerton Genevieve Grant LRM AILaw ELM 120 13 0 23 Oct 2023
Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification Neel Guha Mayee F. Chen Kush S. Bhatia Azalia Mirhoseini Frederic Sala Christopher Ré 29 4 0 20 Jul 2023
Towards Legally Enforceable Hate Speech Detection for Public Forums Chunyan Luo R. Bhambhoria Xiao-Dan Zhu Samuel Dahan AILaw 33 5 0 23 May 2023
LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domain Joel Niklaus Veton Matoshi Pooja Rani Andrea Galassi Matthias Sturmer Ilias Chalkidis ELM AILaw 19 55 0 30 Jan 2023
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 367 8,495 0 28 Jan 2022
LexGLUE: A Benchmark Dataset for Legal Language Understanding in English Ilias Chalkidis Abhik Jana D. Hartung M. Bommarito Ion Androutsopoulos Daniel Martin Katz Nikolaos Aletras AILaw ELM 130 248 0 03 Oct 2021