LFM2.5 8B A1B DSpark
LFM2.5-8B-A1B-DSpark is a speculative-decoding draft model from Liquid AI that adapts DSpark for the LFM2.5 architecture. It is designed to work with the target model LiquidAI/LFM2.5-8B-A1B, enabling faster decoding without degrading output quality. The draft model has 327.7M parameters in BF16 precision, a backbone of 5 full attention layers, a Markov head (rank 256), and a confidence head, with a block size of 9 and a vocabulary of 128,000. It is intended for use with SGLang and can run on Apple silicon via the Metal backend. The model card reports acceleration in SGLang decoding and on-device inference metrics, but these figures are provided as source claims and are not independently verified here.
At a glance
- Parameters
- 0.33B
- Architecture
- qwen3
- Context length
- 128,000
- License
- lfm1.0
- Disk space
- 0.6 GB
- Software
- SGLang
Will it run on your machine?
Save your machine to see a personalized rating and its reasoning.
Add my hardwareBest for
- Accelerating text generation with the LFM2.5-8B-A1B target model in SGLang
- On-device inference on Apple silicon through the Metal backend
- Speculative decoding for code generation tasks
- Speculative decoding for mathematical reasoning tasks
- Speculative decoding for general chat and instruction-following tasks
Tradeoffs
- Designed as a draft model for LiquidAI/LFM2.5-8B-A1B and not a standalone generation model
- Requires a build of SGLang with DSpark support for LFM2/LFM2-MoE targets
- Licensed under lfm1.0 (other), which may impose restrictions on use
- Performance depends on the target model and specific inference setup
- Reported speedups and acceptance rates are from the model card and not independently tested here
Ways to run it
SGLang · Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
python -m sglang.launch_server --model-path LiquidAI/LFM2.5-8B-A1B --speculative-algorithm DSPARK --speculative-draft-model-path LiquidAI/LFM2.5-8B-A1B-DSpark --speculative-draft-attention-backend flashinfer --disable-radix-cache --mem-fraction-static 0.75 --port 30000Explore its uses
Keep exploring
Bonsai 2 · 27B
A compressed 27B-class reasoning model with publisher-provided GGUF packs and a dedicated llama.cpp fork for CUDA, Metal, and CPU.
DeepSeek V4.1 Flash
An open-weight model for reasoning, coding, agents, and image understanding. DeepSeek V4.1 Flash combines a 552B backbone with sparse activation and up to one million tokens of context. Choose the original checkpoint or a community uncensored variant below.
Qwen3.8
Explore 4 versions of Qwen3.8. Compare model sizes, packages, hardware requirements, and available setups.