DeepSeek V4 Pro
DeepSeek V4 Pro is a preview Mixture-of-Experts text-generation model from the DeepSeek-V4 series, released under the MIT license with Safetensors and Transformers compatibility. It has 1.6T total parameters with 49B activated and supports a context length of one million tokens. The model card describes a hybrid attention architecture combining Compressed Sparse Attention and Heavily Compressed Attention, Manifold-Constrained Hyper-Connections, and Muon optimizer training. It was pre-trained on more than 32T tokens and post-trained with a two-stage paradigm involving domain-specific SFT and RL with GRPO followed by on-policy distillation. A DeepSeek-V4-Pro-Max mode is described as offering maximum reasoning effort.
At a glance
- Parameters
- 1598.84B
- Architecture
- deepseek_v4
- Context length
- 1,048,576
- License
- mit
- Disk space
- 805.3 GB
- Software
- Publisher PyTorch reference
Will it run on your machine?
Save your machine to see a personalized rating and its reasoning.
Add my hardwareBest for
- Long-context text generation
- Coding tasks
- Reasoning tasks
- Agentic tasks
- Knowledge-intensive applications
Tradeoffs
- Only a preview version is presented
- Detailed compatibility and runtime requirements are not specified in the supplied facts
- Performance figures are self-reported in the model card and not independently verified
- The model card is truncated, so complete details are unavailable
- No information is provided about ethical, safety, or bias considerations
Ways to run it
Publisher PyTorch reference · Linux / rented GPU
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
torchrun --nproc-per-node ${MP} generate.py --ckpt-path ${SAVE_PATH} --config ${CONFIG} --interactiveExplore its uses
Keep exploring
Bonsai 2 · 27B
A compressed 27B-class reasoning model with publisher-provided GGUF packs and a dedicated llama.cpp fork for CUDA, Metal, and CPU.
DeepSeek V4.1 Flash
A multimodal reasoning model with a compressed key-value cache, published as open weights.
Qwen3.8
Explore 4 versions of Qwen3.8. Compare model sizes, packages, hardware requirements, and available setups.