Dataset · Digitaluz
Cleaned Uzbek language corpus
Digitaluz/uzbek-language-corpus
Large cleaned Uzbek language corpus in Latin and Cyrillic scripts for model pre-training.
What's inside
The dataset contains 5,638,325 documents (over 6 billion words) in the Uzbek language using Latin and Cyrillic scripts. Texts were collected from books (including OCR-scanned ones), newspapers, archival documents, legal texts, Wikipedia, web pages, and Telegram posts, and have undergone filtering and domain-based annotation.
What you can do with it
- Pre-training language models for the Uzbek language
- Training text generation and masked language modeling models
- Tasks
- Text generation, Fill mask
- Languages
- Uzbek
- Size
- 1M–10M rows
- Downloads this month
- 2K
- Likes
- 101
Models trained on it
How to load it
from datasets import load_dataset
ds = load_dataset("Digitaluz/uzbek-language-corpus")