DeepSeek V4 Flash 0731
DeepSeek V4 Flash 0731 from deepseek-ai. Source-based hardware guidance from its published configuration.
At a glance
- Parameters
- 304.18B
- Architecture
- deepseek_v4
- Context length
- 1,048,576
- License
- mit
- Software
- SGLang, vLLM, Publisher PyTorch reference
Will it run on your machine?
Save your machine to see a personalized rating and its reasoning.
Add my hardwareWays to run it
SGLang · Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
sglang serve --trust-remote-code --model-path deepseek-ai/DeepSeek-V4-Flash-0731 --tp 4 --moe-runner-backend flashinfer_mxfp4 --speculative-algorithm DSPARK --mem-fraction-static 0.90 --chunked-prefill-size 4096 --swa-full-tokens-ratio 0.1vLLM · Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
vllm serve deepseek-ai/DeepSeek-V4-Flash-0731 --trust-remote-code --kv-cache-dtype fp8 --block-size 256 --data-parallel-size 4 --enable-expert-parallel --moe-backend deep_gemm_mega_moe --attention-config '{"use_fp4_indexer_cache": true}' --speculative-config '{"method":"dspark","num_speculative_tokens":7,"draft_sample_method":"greedy"}'Publisher PyTorch reference · Linux / rented GPU
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
torchrun --nproc-per-node ${MP} generate.py --ckpt-path ${SAVE_PATH} --config ${CONFIG} --interactiveExplore its uses
Keep exploring
Bonsai 2 · 27B
A compressed 27B-class reasoning model with publisher-provided GGUF packs and a dedicated llama.cpp fork for CUDA, Metal, and CPU.
DeepSeek V4.1 Flash
A multimodal reasoning model with a compressed key-value cache, published as open weights.
Qwen3.8-Flash-Next
An experimental open-weight multimodal model with sparse attention and 262K native context.