LFM2.5 VL 3B DSpark
LFM2.5-VL-3B-DSpark is an experimental speculative-decoding draft model for the vision-language target model LiquidAI/LFM2.5-VL-3B. It is intended to enable faster decoding while preserving the target model's output. The source lists compatibility with LFM2.5-VL-3B and its GGUF counterpart, and describes draft model details such as 279.5M BF16 parameters, a specified backbone configuration, Markov and confidence heads, and a vocabulary of 128,000.
At a glance
- Parameters
- 0.28B
- Architecture
- qwen3
- Context length
- 128,000
- License
- lfm1.0
- Disk space
- 0.5 GB
- Software
- SGLang
Will it run on your machine?
Save your machine to see a personalized rating and its reasoning.
Add my hardwareBest for
- Speculative decoding as a draft model for LiquidAI/LFM2.5-VL-3B
- Faster decoding of vision-language tasks without changing target outputs under greedy decoding
- Use with SGLang on a single H100, where the source reports faster decoding
- Use with MLX-VLM on Apple silicon at block size 8
- Use with llama.cpp via the LFM2.5-VL-3B-GGUF target and its corresponding GGUF drafter
Tradeoffs
- Requires pairing with the corresponding target model, such as LFM2.5-VL-3B or its GGUF version
- Experimental draft model intended for speculative decoding, not standalone use
- On Apple silicon the drafter uses block size 8 rather than 9
- Acceptance and speedup depend on hardware and runtime overhead
- No broad general-purpose or cross-model use is established by the supplied facts
Ways to run it
SGLang · Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
python -m sglang.launch_server --model-path LiquidAI/LFM2.5-VL-3B --speculative-algorithm DSPARK --speculative-draft-model-path LiquidAI/LFM2.5-VL-3B-DSpark --speculative-draft-attention-backend flashinfer --speculative-dspark-block-size 9 --disable-radix-cache --mem-fraction-static 0.8 --port 30000Explore its uses
Keep exploring
Bonsai 2 · 27B
A compressed 27B-class reasoning model with publisher-provided GGUF packs and a dedicated llama.cpp fork for CUDA, Metal, and CPU.
DeepSeek V4.1 Flash
A multimodal reasoning model with a compressed key-value cache, published as open weights.
Qwen3.8
Explore 4 versions of Qwen3.8. Compare model sizes, packages, hardware requirements, and available setups.