MiniCPM5 1B SFT
MiniCPM5 1B SFT is an Apache-2.0 licensed, text-generation model from openbmb/MiniCPM5-1B-SFT. It is an SFT-only checkpoint (before RL/OPD) in the MiniCPM5 series, supporting English and Chinese. The model is a dense 1B Transformer with a LlamaForCausalLM architecture, 1,080,632,832 parameters (679,552,512 non-embedding), 24 layers, GQA with 16 Q heads and 2 KV heads, and a 131,072 token context length. It includes a hybrid reasoning chat template with a `thinking` mode activated via `enable_thinking`, and is intended for on-device, local deployment, and resource-constrained scenarios.
At a glance
- Parameters
- 1.08B
- Architecture
- llama
- Context length
- 131,072
- License
- apache-2.0
- Disk space
- 2 GB
- Software
- llama.cpp, SGLang, vLLM
Will it run on your machine?
Save your machine to see a personalized rating and its reasoning.
Add my hardwareBest for
- Local assistants on edge or on-device environments
- Coding agents
- Tool-use workflows
- Reasoning scenarios where a compact model is preferred
- Long-context text generation with English and Chinese
Tradeoffs
- It is an SFT-only checkpoint and does not include RL or OPD post-training.
- No performance benchmarks or numerical hardware requirements are provided.
- No evaluation results or testing claims are included.
- The model card does not specify compatibility with specific inference backends or formats.
- No purchasable recommendations or deployment guarantees are provided.
Ways to run it
llama.cpp · Windows, macOS, Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
llama-server -m MiniCPM5-2B-F16.gguf -a MiniCPM5-2B --port 8080 -ngl 99 -c 8192 --jinjaSGLang · Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
python -m sglang.launch_server --model-path openbmb/MiniCPM5-2B --port 30000vLLM · Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
vllm serve openbmb/MiniCPM5-2B --port 8000Explore its uses
Keep exploring
Bonsai 2 · 27B
A compressed 27B-class reasoning model with publisher-provided GGUF packs and a dedicated llama.cpp fork for CUDA, Metal, and CPU.
DeepSeek V4.1 Flash
A multimodal reasoning model with a compressed key-value cache, published as open weights.
Qwen3.8
Explore 4 versions of Qwen3.8. Compare model sizes, packages, hardware requirements, and available setups.