Skip to content

Dataset · latam-gpt

Open text corpus for Latin American models

latam-gpt/LatamGPT-Corpus-1.0

A large-scale open corpus in Spanish, Portuguese, and English for fine-tuning large LLMs.

What's inside

The repository is the open part of the corpus used for continued pretraining of the Llama-3.1-70B-LatamGPT-SFT-1.0 model. It contains between 100 million and 1 billion records (text and graphic modalities specified) in Spanish, Portuguese, and English.

What you can do with it

  • Continued pretraining of language models for Spanish and Portuguese
  • Preparing multilingual datasets for regional LLMs
Tasks
Text generation
Languages
Spanish, Portuguese, English
Size
100M–1B rows
Downloads this month
1.8K
Likes
70
Access
on request on Hugging Face

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("latam-gpt/LatamGPT-Corpus-1.0")