Skip to content

Dataset · Locutusque

Large corpus of synthetic and human textbooks

Locutusque/UltraTextbooks-2.0

A million-scale English text dataset with educational materials and code for training language models.

What's inside

The dataset collects English texts and program code with a volume of 1 to 10 million records. According to the description, the corpus combines both generated (synthetic) texts and human-written materials. Suitable for text generation, classification, and fill-mask tasks.

What you can do with it

  • Pre-training or continued training of LLMs on quality educational texts and code
  • Fine-tuning models to generate explanations and educational materials
Tasks
Text generation, Text classification, Fill mask
Languages
English
Size
1M–10M rows
Downloads this month
303
Likes
53

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("Locutusque/UltraTextbooks-2.0")