Dataset · Open-Orca
Cleaned instructions with GPT-4 answers
Open-Orca/SlimOrca
About 500k GPT-4 answers filtered by FLAN annotations for training instruction models.
What's inside
An English-language text dataset of instructions and answers, being a cleaned sub-sample of OpenOrca. It contains about 500k GPT-4 answers; an additional GPT-4 pass removed answers deemed incorrect based on human FLAN annotations. Tasks include question answering, summarization, classification, and others.
What you can do with it
- SFT of instruction LLMs
- LoRA fine-tuning for QA and summarization
- Comparison with the full OpenOrca
- Tasks
- Text classification, Token classification, Table question answering, Question answering, Zero shot classification, Summarization
- Languages
- English
- Size
- 100K–1M rows
- Downloads this month
- 3.1K
- Likes
- 311
Models trained on it
- rombodawg/rombos_Replete-Coder-Llama3-8BText generation 9.5K
- Weyaxi/Einstein-v6.1-Llama3-8BText generation 9.3K
- jondurbin/bagel-dpo-34b-v0.2Text generation 9.2K
- jondurbin/bagel-dpo-34b-v0.5Text generation 9.2K
- jondurbin/bagel-8b-v1.0Text generation 9.2K
- mradermacher/bagel-dpo-34b-v0.5-i1-GGUF 2.6K
- mradermacher/bagel-34b-v0.5-i1-GGUF 2.5K
- mradermacher/SpydazWeb_AI_LCARS_Humanization_003-i1-GGUF 1.9K
How to load it
from datasets import load_dataset
ds = load_dataset("Open-Orca/SlimOrca")