Check the machine before downloading
Check 192 GB unified memory free for the full model, runtime and a short context. This is a conservative capacity starting point, not a measured speed claim.
Exact Ollama packageUse the base Qwen3.8-Flash-Next checkpoint with VS Code and Cline, review a real code change, and test it. This is separate from the Strata derivative.
Full package footprint matters more than six active parameters.
| Machine | Qwen3.8-Flash-Next · 125B MLX | Qwen3.8-Flash-Next · 125B Q4 |
|---|---|---|
| NVIDIA GPU · 32 GB VRAM | No MLX NVIDIA route; use the Linux package on a larger server. | Below the 120 GB weight file; use a multi-GPU host. |
| NVIDIA GPUs · 160 GB aggregate VRAM | No MLX NVIDIA route; choose Q4 Linux package. | Capacity candidate; confirm Ollama distributes the model and leaves context headroom. |
| AMD GPUs · 160 GB aggregate VRAM | No MLX AMD route; choose a supported Linux GPU runtime. | Ollama backend compatibility and distribution need verification for these exact cards. |
| Intel GPUs · 160 GB aggregate VRAM | No MLX Intel route; choose the supported Mac package. | No verified multi-Arc distribution route for this package. |
| Apple Silicon Mac · 128 GB unified memory | Weight file is 105 GB; runtime headroom is tight and this is not a recommended start. | Q4 is the Linux route here; choose the MLX package on Mac. |
| Apple Silicon Mac · 192 GB unified memory | Capacity candidate with headroom for 8K context; measure memory pressure. | Choose the MLX package instead of Linux Q4 on Mac. |
| CPU only · 192 GB RAM | No MLX CPU route here; use a supported high-memory Mac. | May load through offload but agent steps are not a practical recommendation. |
| RunPod · NVIDIA GPUs · 160 GB aggregate VRAM | No MLX rental route; choose Q4 Linux. | Capacity candidate; validate model distribution and runtime before a long rental. |
Package sizes are published; fit and speed ratings are estimates. Multi-GPU distribution must be confirmed on the chosen rental.
Choose the official Mac or Linux package, connect its private Ollama endpoint to Cline, then review and test a code change. This guide does not use Strata.
Select the weights you want. The instructions, downloads and settings change with your choice.
Save your machine in My Hardware to get an automatic starting choice. You can always choose any package yourself.
Start at 8,192 tokens on 192 GB unified memory; the 105 GB file is only weights. Longer context consumes more memory.
Choose where you want to run it. The instructions below update to match your selection.
Windows: This package is MLX for Apple Silicon, not a Windows binary. Windows can use the Q4 package as a client to Linux instead. Compatibility source
Linux: This exact package is MLX for Apple Silicon; the separate official Q4 package is the Linux multi-GPU route. Compatibility source
Check 192 GB unified memory free for the full model, runtime and a short context. This is a conservative capacity starting point, not a measured speed claim.
Exact Ollama packageDownload Ollama for macOS and open it. In Terminal, confirm the app is running before the model download. Ollama manages the package files, so no manual model folder tree is needed.
Download Ollama for this operating system Official model packageIn Terminal, pull qwen3.8-flash-next:125b-mlx. Start with 8,192 tokens when connecting the agent; the published maximum context is not a safe default for every machine. The download is large and can take time.
Package identity and disk sizeOn your own Windows, Mac or Linux computer, install VS Code and the Cline extension. Keep approval required for file writes and terminal commands.
Download VS Code Install Cline extensionIn Cline choose the OpenAI-compatible provider, Base URL http://127.0.0.1:11434/v1, and exact Ollama Model ID qwen3.8-flash-next:125b-mlx. Start at 8,192 context. Keep Ollama running locally. Confirm a short response before allowing repository access.
Cline custom model settingsOpen a disposable project in VS Code. Ask Cline to add a small button and a test. Review the proposed diff and any Terminal command before approval, run the test, and open the app to confirm the button. If this exact large package fails at tool calls, do not present the route as a verified coding assistant.
Keep the reviewed code change or discard the disposable project. Check the actual test result and app behavior, then stop the model server or rented GPU when done.
Cline edited the disposable repository with your approval; the diff is relevant, the test passes, and the changed behavior works. A chat response or file-reading probe does not pass.
The agent route is source-backed but has not been benchmarked by YouRunAI. The Linux multi-GPU fit is a capacity estimate, not a tested deployment.
Use the exact package size, leave runtime and context headroom, begin at 8K–16K context, and choose a larger machine or a smaller model if it still offloads heavily.
Check the selected Ollama package has tool support, update Ollama, then retry the bounded script. Do not promote plain chat to a working agent path.
Keep Ollama running, check http://127.0.0.1:11434/v1, and use an SSH tunnel for a rental. Never expose the unauthenticated port publicly.
Original instructions, model files, and compatibility notes behind this setup.
Source-backed package and platform-route plan for private local chat with Qwen3.5 · 9B. Preserves the official Ollama 9B package, a smaller 4B family fallback, and a clearly labeled community uncensored GGUF option.
Run Qwen3.8 27B with Ollama, connect it to Cline in VS Code, and make one reviewable code change in a tiny local project.
Generate images from text prompts in ComfyUI with the fast distilled or more adjustable base 4B model. Save your results and reuse the visual workflow.