LawBench: Benchmarking Legal Knowledge of Large Language Models

28 September 2023

Xiaoyu Shen

Papers citing "LawBench: Benchmarking Legal Knowledge of Large Language Models"

33 / 33 papers shown

Title
Toward Generalizable Evaluation in the LLM Era: A Survey Beyond Benchmarks Yixin Cao Shibo Hong Xuran Li Jiahao Ying Yubo Ma ... Juanzi Li Aixin Sun Xuanjing Huang Tat-Seng Chua Tianwei Zhang ALM ELM 86 1 0 26 Apr 2025
Taxation Perspectives from Large Language Models: A Case Study on Additional Tax Penalties Eunkyung Choi Young Jin Suh H. Park Wonseok Hwang 55 1 0 05 Mar 2025
Evaluating Large Language Models for Public Health Classification and Extraction Tasks Joshua Harris Timothy Laurence Leo Loman Fan Grayson Toby Nonnenmacher ... Hamish Mohammed Thomas Finnie Luke Hounsome Michael Borowitz Steven Riley LM&MA AI4MH 83 5 0 20 Feb 2025
LawGPT: Knowledge-Guided Data Generation and Its Application to Legal LLM Zhi-Hua Zhou Kun-Yang Yu Shi-Yu Tian Jiang-Xin Shi Xiao-Wen Yang Pengxiao Song Yi-Xuan Jin Lan-Zhe Guo Yu-Feng Li ELM AILaw 52 1 0 10 Feb 2025
Adversarial Negotiation Dynamics in Generative Language Models Arinbjörn Kolbeinsson Benedikt Kolbeinsson AAML ELM 40 0 0 03 Jan 2025
Large Language Models in Politics and Democracy: A Comprehensive Survey Goshi Aoki LM&MA AILaw 75 1 0 01 Dec 2024
VersaTune: An Efficient Data Composition Framework for Training Multi-Capability LLMs Keer Lu Keshi Zhao Zheng Liang Da Pan Shusen Zhang ... Weipeng Chen Zenan Zhou Guosheng Dong Bin Cui Wentao Zhang VLM CLL 28 0 0 18 Nov 2024
A Novel Psychometrics-Based Approach to Developing Professional Competency Benchmark for Large Language Models Elena Kardanova Alina Ivanova Ksenia Tarasova Taras Pashchenko Aleksei Tikhoniuk Elen Yusupova Anatoly Kasprzhak Yaroslav Kuzminov Ekaterina Kruchinskaia Irina Brun 42 1 0 29 Oct 2024
LexEval: A Comprehensive Chinese Legal Benchmark for Evaluating Large Language Models Haitao Li You Chen Qingyao Ai Yueyue Wu Ruizhe Zhang Yiqun Liu ALM AILaw ELM 46 8 0 30 Sep 2024
Do We Need Domain-Specific Embedding Models? An Empirical Investigation Yixuan Tang Yi Yang AIFin 48 3 0 27 Sep 2024
CFinBench: A Comprehensive Chinese Financial Benchmark for Large Language Models Ying Nie Binwei Yan Tianyu Guo Hao Liu Haoyu Wang ... Weihao Wang Qiang Li Weijian Sun Yunhe Wang Dacheng Tao ELM 45 2 0 02 Jul 2024
UniGen: A Unified Framework for Textual Dataset Generation Using Large Language Models Siyuan Wu Yue Huang Chujie Gao Dongping Chen Qihui Zhang ... Tianyi Zhou Xiangliang Zhang Jianfeng Gao Chaowei Xiao Lichao Sun SyDa 33 22 0 27 Jun 2024
InternLM-Law: An Open Source Chinese Legal Large Language Model Zhiwei Fei Songyang Zhang Xiaoyu Shen Dawei Zhu Xiao Wang ... Yining Li Wenwei Zhang Dahua Lin Kai Chen Jidong Ge ELM AILaw 54 3 0 21 Jun 2024
IPEval: A Bilingual Intellectual Property Agency Consultation Evaluation Benchmark for Large Language Models Qiyao Wang Jianguo Huang Shule Lu Yuan Lin Kan Xu Liang Yang Hongfei Lin ELM 32 0 0 18 Jun 2024
Are Large Language Models True Healthcare Jacks-of-All-Trades? Benchmarking Across Health Professions Beyond Physician Exams Zheheng Luo Chenhan Yuan Qianqian Xie Sophia Ananiadou ELM AI4MH LM&MA 41 0 0 17 Jun 2024
LawGPT: A Chinese Legal Knowledge-Enhanced Large Language Model Zhi-Hua Zhou Jiang-Xin Shi Peng-Xiao Song Xiao-Wen Yang Yi-Xuan Jin Lan-Zhe Guo Yu-Feng Li ELM AILaw 34 15 0 07 Jun 2024
Octopus: On-device language model for function calling of software APIs Wei Chen Zhiyuan Li Mingyuan Ma LLMAG 27 14 0 02 Apr 2024
Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Models Yixin Liu Kai Zhang Yuan Li Zhiling Yan Chujie Gao ... Yue Huang Hanchi Sun Jianfeng Gao Lifang He Lichao Sun VLM VGen EGVM 75 259 0 27 Feb 2024
CPSDBench: A Large Language Model Evaluation Benchmark and Baseline for Chinese Public Security Domain Xin Tong Bo Jin Zhi Lin Binjun Wang Ting Yu Qiang Cheng ELM 17 0 0 11 Feb 2024
Aalap: AI Assistant for Legal & Paralegal Functions in India Aman Tiwari Prathamesh Kalamkar Atreyo Banerjee S. Karn V. Hemachandran Smita Gupta AILaw ELM VLM 24 1 0 30 Jan 2024
Large Legal Fictions: Profiling Legal Hallucinations in Large Language Models Matthew Dahl Varun Magesh Mirac Suzgun Daniel E. Ho HILM AILaw 25 73 0 02 Jan 2024
How Good is ChatGPT in Giving Advice on Your Visualization Design? Nam Wook Kim Grace Myers Benjamin Bach 26 20 0 14 Oct 2023
Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificity Cunxiang Wang Xiaoze Liu Yuanhao Yue Xiangru Tang Tianhang Zhang ... Linyi Yang Jindong Wang Xing Xie Zheng-Wei Zhang Yue Zhang HILM KELM 51 184 0 11 Oct 2023
Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts Jian Xie Kai Zhang Jiangjie Chen Renze Lou Yu-Chuan Su RALM 209 155 0 22 May 2023
Large Language Models are Built-in Autoregressive Search Engines Noah Ziems W. Yu Zhihan Zhang Meng-Long Jiang KELM 64 40 0 16 May 2023
xPQA: Cross-Lingual Product Question Answering across 12 Languages Xiaoyu Shen Akari Asai Bill Byrne Adria de Gispert 22 7 0 16 May 2023
GLM-130B: An Open Bilingual Pre-trained Model Aohan Zeng Xiao Liu Zhengxiao Du Zihan Wang Hanyu Lai ... Jidong Zhai Wenguang Chen Peng-Zhen Zhang Yuxiao Dong Jie Tang BDL LRM 250 1,073 0 05 Oct 2022
Generate rather than Retrieve: Large Language Models are Strong Context Generators W. Yu Dan Iter Shuohang Wang Yichong Xu Mingxuan Ju Soumya Sanyal Chenguang Zhu Michael Zeng Meng-Long Jiang RALM AIMat 226 321 0 21 Sep 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 313 11,953 0 04 Mar 2022
LexGLUE: A Benchmark Dataset for Legal Language Understanding in English Ilias Chalkidis Abhik Jana D. Hartung M. Bommarito Ion Androutsopoulos Daniel Martin Katz Nikolaos Aletras AILaw ELM 130 248 0 03 Oct 2021
CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation Shuai Lu Daya Guo Shuo Ren Junjie Huang Alexey Svyatkovskiy ... Nan Duan Neel Sundaresan Shao Kun Deng Shengyu Fu Shujie Liu ELM 198 1,105 0 09 Feb 2021
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 240 4,469 0 23 Jan 2020
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 297 6,959 0 20 Apr 2018