Skip to content

Dataset · nguha

LegalBench legal reasoning benchmark

nguha/legalbench

162 English tasks for evaluating LLM legal reasoning across classification and question answering.

What's inside

LegalBench is an open collaborative benchmark for evaluating legal reasoning in English LLMs. It comprises 162 tasks sourced from 40 origins, featuring text and tabular data for classification and question answering. The dataset card links to the project page, GitHub, and an arXiv paper.

What you can do with it

  • Evaluating legal LLMs across 162 tasks
  • Testing text-classification and QA models in the legal domain
  • Comparing models on legal reasoning
Tasks
Text classification, Question answering
Languages
English
Size
10K–100K rows
Downloads this month
41.4K
Likes
200

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("nguha/legalbench")