MiniCPM5 2B Midtrain
MiniCPM5 2B Midtrain is the second model in the MiniCPM5 series, a dense 2B Transformer from OpenBMB built for on-device, local deployment, and resource-constrained scenarios. It scales up the same training recipe used for MiniCPM5-1B and is released under the apache-2.0 license. The model card describes it as reaching 2B-class open-source SOTA within its comparison set and remaining competitive with 4B-class models overall, with reported advantages over comparable-size models in coding, mathematics, long-context understanding, tool use, and agentic tasks. Languages listed are English and Chinese, and the model is associated with the transformers library and text-generation pipeline. Training data includes openbmb Ultra-FineWeb, UltraX-Preview, Ultra-FineWeb-L3, UltraData-Math, UltraData-Code, UltraData-SFT-2605, UltraData-SFT-Agent-2609, and UltraData-RL-2609.
At a glance
- Parameters
- 2.52B
- Architecture
- llama
- Context length
- 131,072
- License
- apache-2.0
- Disk space
- 4.7 GB
- Software
- llama.cpp, SGLang, vLLM
Will it run on your machine?
Save your machine to see a personalized rating and its reasoning.
Add my hardwareBest for
- On-device or local text generation in resource-constrained settings.
- Coding-related tasks.
- Mathematics-related tasks.
- Long-context understanding.
- Tool use and agentic tasks.
Tradeoffs
- Dense 2B Transformer only; no larger variants are described in the supplied facts.
- Model card languages are limited to English and Chinese.
- No numerical hardware requirements are provided in the source data.
- No compatibility, performance benchmarks, or testing results are provided in the source data.
- Dataset details are listed only as names; no licensing, quality, or content limitations of datasets are provided.
Ways to run it
llama.cpp · Windows, macOS, Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
llama-server -m MiniCPM5-2B-F16.gguf -a MiniCPM5-2B --port 8080 -ngl 99 -c 8192 --jinjaSGLang · Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
python -m sglang.launch_server --model-path openbmb/MiniCPM5-2B --port 30000vLLM · Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
vllm serve openbmb/MiniCPM5-2B --port 8000Explore its uses
Keep exploring
Bonsai 2 · 27B
A compressed 27B-class reasoning model with publisher-provided GGUF packs and a dedicated llama.cpp fork for CUDA, Metal, and CPU.
DeepSeek V4.1 Flash
A multimodal reasoning model with a compressed key-value cache, published as open weights.
Qwen3.8
Explore 4 versions of Qwen3.8. Compare model sizes, packages, hardware requirements, and available setups.