Dataset · latam-gpt
Open text corpus for Latin American models
latam-gpt/LatamGPT-Corpus-1.0
A large-scale open corpus in Spanish, Portuguese, and English for fine-tuning large LLMs.
What's inside
The repository is the open part of the corpus used for continued pretraining of the Llama-3.1-70B-LatamGPT-SFT-1.0 model. It contains between 100 million and 1 billion records (text and graphic modalities specified) in Spanish, Portuguese, and English.
What you can do with it
- Continued pretraining of language models for Spanish and Portuguese
- Preparing multilingual datasets for regional LLMs
- Tasks
- Text generation
- Languages
- Spanish, Portuguese, English
- Size
- 100M–1B rows
- Downloads this month
- 1.8K
- Likes
- 70
- Access
- on request on Hugging Face
Models trained on it
How to load it
from datasets import load_dataset
ds = load_dataset("latam-gpt/LatamGPT-Corpus-1.0")