Dataset · Locutusque
Large corpus of synthetic and human textbooks
Locutusque/UltraTextbooks-2.0
A million-scale English text dataset with educational materials and code for training language models.
What's inside
The dataset collects English texts and program code with a volume of 1 to 10 million records. According to the description, the corpus combines both generated (synthetic) texts and human-written materials. Suitable for text generation, classification, and fill-mask tasks.
What you can do with it
- Pre-training or continued training of LLMs on quality educational texts and code
- Fine-tuning models to generate explanations and educational materials
- Tasks
- Text generation, Text classification, Fill mask
- Languages
- English
- Size
- 1M–10M rows
- Downloads this month
- 303
- Likes
- 53
Models trained on it
How to load it
from datasets import load_dataset
ds = load_dataset("Locutusque/UltraTextbooks-2.0")