Dataset · HuggingFaceTB
Math educational corpus from CommonCrawl
HuggingFaceTB/finemath
34-54B tokens of math educational texts filtered from CommonCrawl for model training.
What's inside
Contains math educational content curated from CommonCrawl. A classifier was trained on Llama-3.1-70B-Instruct annotations for filtering, keeping clear explanations and step-by-step problem solutions. The volume is 34B tokens in FineMath-3+ and 54B tokens together with InfiMM-WebMath-3+. The language is not specified in the card; metadata classifies the data as tabular and text.
What you can do with it
- Continued pretraining of a mathematical LLM
- SFT on step-by-step mathematical explanations
- Training a mathematical content classifier
- Size
- 10M–100M rows
- Downloads this month
- 70.1K
- Likes
- 400
Models trained on it
- dmis-lab/UltraBERT-150MFill mask 13.4K
- dmis-lab/UltraBERT-380MFill mask 9.9K
- marin-community/marin-8b-baseText generation 2.9K
- openeurollm/datamix-2b-80-20 2.9K
- MatterWaveAI/grt-30mText generation 2.7K
- mradermacher/Marco-Mini-Global-Base-i1-GGUF 2.2K
- marin-community/marin-32b-baseText generation 1.8K
- BananaMind/BananaMind-2-MoEText generation 1.5K
How to load it
from datasets import load_dataset
ds = load_dataset("HuggingFaceTB/finemath")