LFM2.5 VL 3B
LFM2.5-VL-3B is a multimodal variant of the LFM2.5 hybrid model family designed for on-device deployment. It processes text and images, using LFM2.5-2.6B as its language backbone and a SigLIP2 NaFlex vision encoder. The model reports improved grounding and object detection with natural language queries, full-page OCR with layout annotation, and efficient inference (reported 228 tok/s on Apple M5 Max and 116 tok/s on AMD Ryzen AI Max+ 395, under 3.3 GB memory). It supports 16 languages and a 32,768-token context length, with native resolution processing that splits large images into non-overlapping 512x512 patches plus a resized whole-image thumbnail. The model is available under the LFM 1.0 license and is tagged for image-text-to-text, with exports including GGUF, ONNX, and MLX variants.
At a glance
- Parameters
- 3.12B
- Architecture
- lfm2_vl
- License
- lfm1.0
- Disk space
- 5.8 GB
- Software
- Transformers
Will it run on your machine?
Save your machine to see a personalized rating and its reasoning.
Add my hardwareBest for
- Image understanding and visual question answering with text and images
- Grounding and object detection using natural language queries
- Full-page optical character recognition (OCR) with layout annotation
- Multilingual multimodal interactions across 16 supported languages
- On-device deployment scenarios with native, GGUF, ONNX, or MLX formats
Tradeoffs
- License is LFM 1.0 (other), not an open-source or permissive license
- The source does not specify hardware requirements beyond reported inference metrics; no compatibility or performance guarantees are provided
- No claims of testing or evaluation are made in the supplied data
- The source does not include information on fine-tuning support, quantization details, or numerical accuracy
- No recommendations for purchase or comparisons with other models are provided in the source content
Ways to run it
Transformers · See official guide
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
import torch
from transformers import AutoModelForImageTextToText, AutoProcessor
model_id = "LiquidAI/LFM2.5-VL-3B"
model = AutoModelForImageTextToText.from_pretrained(model_id, dtype=torch.bfloat16)
processor = AutoProcessor.from_pretrained(model_id)
messages = [
{
"role": "user",
"content": [
{"type": "image", "url": "https://placecats.com/300/200"},
{"type": "text", "text": "Describe this image."},
],
}
]
inputs = processor.apply_chat_template(
messages,
add_generation_prompt=True,
tokenize=True,
return_dict=True,
return_tensors="pt",
).to(model.device)
with torch.inference_mode():
output_ids = model.generate(
**inputs,
do_sample=True,
temperature=0.2,
top_k=50,
repetition_penalty=1.0,
max_new_tokens=256,
)
generated_ids = output_ids[:, inputs["input_ids"].shape[1] :]
print(processor.batch_decode(generated_ids, skip_special_tokens=True)[0])Explore its uses
Keep exploring
Bonsai 2 · 27B
A compressed 27B-class reasoning model with publisher-provided GGUF packs and a dedicated llama.cpp fork for CUDA, Metal, and CPU.
DeepSeek V4.1 Flash
A multimodal reasoning model with a compressed key-value cache, published as open weights.
Qwen3.8
Explore 4 versions of Qwen3.8. Compare model sizes, packages, hardware requirements, and available setups.