Skip to content

Dataset · nampdn-ai

Compact English short text corpus

nampdn-ai/mini-en

Filtered short texts from RefinedWeb and MiniPile for training compact language models.

What's inside

Contains filtered short texts in English, with a dataset size ranging from 100k to 1 million records. Data is selected from the open Falcon-RefinedWeb and MiniPile corpora with a focus on content diversity and quality. Data is presented in text and tabular formats.

What you can do with it

  • Pre-training or fine-tuning compact English language models
  • Rapid experiments with text generation architectures on a small yet diverse corpus
Tasks
Text generation
Languages
English
Size
100K–1M rows
Downloads this month
19
Likes
14
Access
on request on Hugging Face

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("nampdn-ai/mini-en")