LFM2.5 VL 3B DSpark GGUF
LFM2.5 VL 3B DSpark GGUF is a GGUF build of LiquidAI/LFM2.5-VL-3B-DSpark for llama.cpp. It is a standalone draft sidecar containing only a drafter with 4 attention layers, a Markov head, a confidence head, and block size 9, used for speculative decoding with a compatible LFM2.5-VL-3B-GGUF target model. Token embeddings and the LM head are shared from the target model at load time, so pairing with the target file is required. The supplied F16 drafter file is 567 MB. Speculative decoding is described as exact under greedy decoding because the target verifies every proposed token.
At a glance
- Architecture
- unknown
- License
- lfm1.0
- Software
- llama.cpp
Will it run on your machine?
Save your machine to see a personalized rating and its reasoning.
Add my hardwareBest for
- Running speculative decoding with a paired LFM2.5-VL-3B-GGUF target model in llama.cpp.
- Serving image-text-to-text tasks with the target plus drafter setup in llama.cpp.
- Using the drafter as a sidecar for the LFM2.5-VL-3B-GGUF target model.
- Testing draft acceptance rate through llama.cpp timing logs when paired with a compatible target.
- Using the GGUF drafter on Apple silicon with recommended block size 8 via --spec-draft-n-max 8.
Tradeoffs
- Not a standalone model; it must be paired with the LFM2.5-VL-3B-GGUF target file, which supplies token embeddings and the LM head.
- Requires a compatible LFM2.5-VL-3B-GGUF target; other target models are not stated as supported.
- It is a draft sidecar for speculative decoding, not a full vision-language model by itself.
- The supplied file is an F16 drafter only; no other quantization files are listed.
- Performance, compatibility, hardware requirements beyond the provided run command, and purchase suitability are not stated in the supplied facts.
Ways to run it
llama.cpp · Windows, macOS, Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
llama-server -hf LiquidAI/LFM2.5-VL-3B-GGUF:F16 -hfd LiquidAI/LFM2.5-VL-3B-DSpark-GGUF:F16 --spec-type draft-dspark --spec-draft-n-max 8 --spec-draft-n-min 0 -ngl 99 -ngld 99 -fa onExplore its uses
Keep exploring
Bonsai 2 · 27B
A compressed 27B-class reasoning model with publisher-provided GGUF packs and a dedicated llama.cpp fork for CUDA, Metal, and CPU.
DeepSeek V4.1 Flash
A multimodal reasoning model with a compressed key-value cache, published as open weights.
Qwen3.8
Explore 4 versions of Qwen3.8. Compare model sizes, packages, hardware requirements, and available setups.