Text / openbmb

MiniCPM5 2B GGUF

MiniCPM5 2B GGUF is a GGUF-formatted text-generation model from OpenBMB, licensed under Apache-2.0. It is described as a dense 2B Transformer, the second model in the MiniCPM5 series after MiniCPM5-1B, and is intended for on-device, local deployment, and resource-constrained scenarios. The model card lists English and Chinese language support and tags for long-context, tool-calling, on-device, and edge-ai use. Training data references include the Ultra-FineWeb, UltraX-Preview, Ultra-FineWeb-L3, UltraData-Math, UltraData-Code, UltraData-SFT-2605, UltraData-SFT-Agent-2609, and UltraData-RL-2609 datasets.

EstimatedRepository opened Sep 5, 2026Source checked 9/27/2026Version: 2079a22f

LOCALRENTED GPUOPEN WEIGHTS

Freshness 86 out of 100. Repository age: 40 days old, Sep 5, 2026. Measures age, not quality.

Popularity 71 out of 100. 209,975 downloads in 30 days; 372 lifetime likes. Checked Oct 15, 2026. Measures adoption, not quality.

What do these scores mean?

Two ways to compare models. Neither score measures answer quality, benchmark performance, or whether a model fits your machine.

Freshness · release age

A new release starts at 100. The score halves every 180 days: 100 × 2^(−age in days / 180). When the release date is unavailable, a repository date is a fallback—not proof of when the model was released. Missing dates stay unscored.

Check the date source

Popularity · adoption

Downloads over the past 30 days carry 80% of the score; lifetime likes carry 20%. Both use a logarithmic scale, capped at 10 million downloads and 100,000 likes. If likes are unavailable, downloads carry all the weight. Missing download statistics stay unscored.

round(80 × min(1, log10(1 + downloads) / 7) + 20 × min(1, log10(1 + likes) / 5))

Check the statistics source

Scores as of Oct 15, 2026. Statistics checked Oct 15, 2026. Statistics are marked for refresh after 72 hours.Full scoring method

WORKFLOWS FOR THIS MODEL 2

What do you want to do?

Choose a task. Get the software, files, settings, and steps to run it.

MAKE IT PERSONALChoose your hardware

Private chat

openbmb/MiniCPM5-2B-GGUF

Publisher GGUF repository with F16, Q8_0, and Q4_K_M files for MiniCPM5 2B. Q4_K_M is about 1.56 GB; F16 is about 5.04 GB.

Freshness 86 out of 100. Repository age: 40 days old, Sep 5, 2026. Measures age, not quality.

llama.cpp

2 packagesmacOS / Windows / LinuxUncensored option

Open chat guide

Private chat

Chat locally with MiniCPM5 · 2B

Run the official MiniCPM5 2B GGUF on Windows, Mac, or Linux with Ollama for a simple private chat. An advanced GPTQ/vLLM route is available for Linux NVIDIA, plus a separately labelled community uncensored MLX package for Apple Silicon.

Freshness 86 out of 100. Repository age: 40 days old, Sep 5, 2026. Measures age, not quality.

OllamavLLM

1 packagemacOS / Windows / Linux

Opens with MiniCPM5 2B · official GGUF Q4_K_MOpen chat guide

Open a guide for its software, hardware requirements, and setup steps.

At a glance

Architecture: unknown
License: apache-2.0
Disk space: 1.5 GB
Software: llama.cpp, SGLang, vLLM

View the model source

MY HARDWARE

Will it run on your machine?

Save your machine to see a personalized rating and its reasoning.

Add my hardware

Best for

On-device or local text generation
Resource-constrained deployment scenarios
Long-context understanding tasks
Tool-calling tasks
Agentic tasks

Tradeoffs

Only English and Chinese language support is listed
No numerical hardware requirements or compatibility details are provided
No performance benchmarks or comparisons beyond model card claims are supplied
Not described as supporting languages beyond English and Chinese
No inference, testing, or purchase guidance is provided

Ways to run it

llama.cpp · Windows, macOS, Linux

Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.

llama-server -m MiniCPM5-2B-F16.gguf -a MiniCPM5-2B --port 8080 -ngl 99 -c 8192 --jinja

Official instructions

SGLang · Linux

Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.

python -m sglang.launch_server --model-path openbmb/MiniCPM5-2B --port 30000

Official instructions

vLLM · Linux

Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.

vllm serve openbmb/MiniCPM5-2B --port 8000

Official instructions

Explore its uses

GGUFTEXT-GENERATION

Keep exploring

Text

Prism ML

Bonsai 2 · 27B

A compressed 27B-class reasoning model with publisher-provided GGUF packs and a dedicated llama.cpp fork for CUDA, Metal, and CPU.

Freshness 90 out of 100. Release age: 28 days old, Sep 17, 2026. Measures age, not quality.

MODEL SIZE27.36B

LOCALRENTED GPU

Released Sep 17, 2026

Text

DeepSeek

DeepSeek V4.1 Flash

A multimodal reasoning model with a compressed key-value cache, published as open weights.

Freshness 87 out of 100. Repository age: 35 days old, Sep 10, 2026. Measures age, not quality.

Arena Open Source Text: rank 5 of 225. Ranked model: deepseek-v4.1-flash-max. Export dated Oct 13, 2026. Source checked Oct 15, 2026. Human preference ranking, not hardware suitability.+3

LOCALRENTED GPU

Repository opened Sep 10, 2026

Text

Qwen

Qwen3.8

Explore 4 versions of Qwen3.8. Compare model sizes, packages, hardware requirements, and available setups.

4 versionsCompare sizes & formats

LOCALRENTED GPU

Compare versions →