PocketLLM Model Collection
local LLMs curated for Android
2 min readupdated
This repository is an official collection of compact language models optimized to run directly on Android smartphones without an internet connection or cloud servers. Developer Amaresh Hebbar put this bundle together specifically for the PocketLLM mobile app, though the files also work with other local inference engines. Inside, you will find popular open models (Qwen 2.5, Gemma 1.1 and 3, Llama 3.2, SmolLM2, Phi-3.5 Mini) ranging from 0.5B to 4B parameters. Unlike desktop releases, all weights are pre-converted into lightweight GGUF (Q4_K_M quantization for llama.cpp) and MediaPipe (.bin with CPU and GPU support) formats, allowing them to run even on budget phones with 2 GB of RAM.
Key features
- Three hardware tiers: ranges from ultra-light models under 1 GB (Qwen 2.5 0.5B, Gemma 3 1B) for low-end devices to larger Phi-3.5 Mini and Gemma 3 4B options for phones with 5–6+ GB of RAM.
- Two mobile formats: includes
.gguffiles forllama.cpp(llama.rn) and.binbinaries for Google MediaPipe LLM Inference with CPU or GPU acceleration (Vulkan/OpenCL). - Ready-to-use selection guide: the model card provides a compatibility table matching models to device memory, from 2 to 8 GB of RAM.
- Upcoming fine-tunes: the author announced upcoming custom fine-tunes of Llama 3.2 1B and Gemma 3 1B tailored for short chats and a 2,048-token context window.
What you can do
- Run a chatbot in PocketLLM: download your chosen weights straight from the built-in Model Store and chat with the AI model offline.
- Integrate into mobile projects: embed ready-made
.ggufor.binfiles into Android apps built onllama.rnorreact-native-llm-mediapipe. - Match the model to your task: pick Qwen 2.5 0.5B for maximum speed on an older phone, or go with Phi-3.5 Mini for coding tasks on an 8 GB flagship.
Example
To download any file from the collection directly, use a standard link formatted like this:
[https://huggingface.co/AmareshHebbar/pocketllm-models/resolve/main/](https://huggingface.co/AmareshHebbar/pocketllm-models/resolve/main/);
Read more
DetailsFile sizes: from 0.4 GB (Qwen 2.5 0.5B) to 2.8 GB (Gemma 3 4B).
Smartphone RAM requirements: at least 2 GB for entry-level models, 4+ GB for mid-range, and 5–6+ GB for larger models.
Licenses vary by base model: Apache 2.0 (Qwen, SmolLM2), MIT (Phi-3.5), plus specific terms for Google Gemma and Meta Llama 3.2.










Comments