Skip to content

Dataset · Digitaluz

Cleaned Uzbek language corpus

Digitaluz/uzbek-language-corpus

Large cleaned Uzbek language corpus in Latin and Cyrillic scripts for model pre-training.

What's inside

The dataset contains 5,638,325 documents (over 6 billion words) in the Uzbek language using Latin and Cyrillic scripts. Texts were collected from books (including OCR-scanned ones), newspapers, archival documents, legal texts, Wikipedia, web pages, and Telegram posts, and have undergone filtering and domain-based annotation.

What you can do with it

  • Pre-training language models for the Uzbek language
  • Training text generation and masked language modeling models
Tasks
Text generation, Fill mask
Languages
Uzbek
Size
1M–10M rows
Downloads this month
2K
Likes
101

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("Digitaluz/uzbek-language-corpus")