Dataset · nampdn-ai
Compact English short text corpus
nampdn-ai/mini-en
Filtered short texts from RefinedWeb and MiniPile for training compact language models.
What's inside
Contains filtered short texts in English, with a dataset size ranging from 100k to 1 million records. Data is selected from the open Falcon-RefinedWeb and MiniPile corpora with a focus on content diversity and quality. Data is presented in text and tabular formats.
What you can do with it
- Pre-training or fine-tuning compact English language models
- Rapid experiments with text generation architectures on a small yet diverse corpus
- Tasks
- Text generation
- Languages
- English
- Size
- 100K–1M rows
- Downloads this month
- 19
- Likes
- 14
- Access
- on request on Hugging Face
Models trained on it
How to load it
from datasets import load_dataset
ds = load_dataset("nampdn-ai/mini-en")