Supra2.5-Pro-Instruct
ultra-compact 65M parameter LLM
2 min readupdated
Supra2.5-Pro-Instruct is a tiny English language model from SupraLabs, fine-tuned for conversation and basic instruction following. Built on the Supra2.5-Pro-Base foundation model, it has just 65 million parameters (roughly 0.07B). Unlike larger models, this release focuses on ultra-lightweight local inference (running the model directly on your device) and supports the standard ChatML chat template. It is well-suited for developers and enthusiasts experimenting with ultra-small models or running AI on low-end hardware.
Key features
- Minimal footprint: At just 65M parameters, it runs locally with minimal resource overhead.
- Trained on synthetic data: The model underwent 2 epochs of fine-tuning on nearly 9,000 synthetic conversations generated by DeepSeek V4.1 Flash 1017 using prompts from SmolTalk2.
- Ready-to-use quantizations: Alongside the original weights, optimized GGUF formats (F16, Q8_0, and Q4_K_M) are available for fast execution via llama.cpp and compatible clients.
- Uncensored and unaligned: The authors note that the model has not undergone safety alignment or preference optimization.
What you can do
- Run a local chatbot on a low-end PC: Use the GGUF Q4_K_M or Q8_0 builds for simple, everyday English chats without needing a GPU.
- Test basic code and math: Use the model as an ultra-fast drafting tool for elementary coding tasks and simple calculations within its capabilities.
- Embed into a custom pipeline: Integrate it as a lightweight ChatML-compatible component, provided you add an external safety filter before displaying outputs to users.
Example
This sample conversation from the model card highlights both its conversational style and its tendency to hallucinate facts due to its small size:
User: How are you?
Supra: I'm running well, thanks for asking! As a compact language model, I don't have feelings or memory across separate chats. What can I help you with today?
Read more
DetailsParameters: 65M (0.07B), English language.
Training: 2 epochs on ~9,000 dialogues from DeepSeek V4.1 Flash 1017 (using the SmolTalk2 prompt base).
Formats and runtime: Compatible with transformers and the ChatML template; available in GGUF F16, Q8_0, and Q4_K_M.
Limitations: No safety alignment; prone to factual errors due to its small size (such as inaccuracies in Einstein's biography in the model card examples).










Comments