GLM-5.3 Flash Abliterated
Huihui’s abliterated GGUF of Z.ai’s GLM-5.3-Flash, a 321B mixture-of-experts model for coding and agents. Builds from 93 GB to 292 GB for machines with 128–256 GB of memory and up.
What do you want to do?
Choose a task. Get the software, files, settings, and steps to run it.
Open a guide for its software, hardware requirements, and setup steps.
At a glance
- Parameters
- 321B total · about 18B active per token
- Architecture
- Mixture of experts (glm5-next) · text and image in, text out
- Context length
- Huihui’s command uses 262,144 · the agent guide starts at 65,536
- License
- MIT
- Software
- llama.cpp
Will it run on your machine?
Save your machine to see a personalized rating and its reasoning.
Add my hardwareBest for
- Run a local Hermes agent that reads and writes files with your approval.
- Private coding and long tasks with fewer refusals on a 128–256 GB Mac Studio or workstation.
- Ask about images by loading the vision file alongside the model.
Tradeoffs
- Huihui ablated only layers 15 to 35 and left the expert modules untouched, and its card reports no refusal test, so some refusals may remain.
- The files are abliterated copies of Unsloth’s GLM-5.3-Flash GGUFs, not a new quantization from full precision.
- Downloads are 93–292 GB and split into several parts.
- A 2-bit or 3-bit build of a model this size loses precision; no quality measurements are published for these files.
- A different model from the dealignai GLM-5.3 Uncensored page on YouRunAI, which covers the larger GLM-5.3.
Ways to run it
llama.cpp · Windows, macOS, Linux
The tag from Huihui’s model page. Used by the Hermes agent guide on this page, which also offers the smaller UD-Q2_K_XL and UD-Q3_K_XL builds.
llama-server -hf huihui-ai/Huihui-GLM-5.3-Flash-abliterated-GGUF:UD-Q4_K_XL --jinja -c 65536What to expect
The pick for 128–256 GB of memory. On a 128 GB machine use UD-Q2_K_XL and expect a tight fit; with 256 GB use UD-Q4_K_XL.
Explore its uses
Sources and files
Primary sources and files behind this model page.
Keep exploring
GLM 5.3
Explore 2 versions of GLM 5.3. Compare model sizes, packages, hardware requirements, and available setups.
Kimi K3
An open-weight multimodal model for long-running coding, reasoning, and knowledge work.
Gemma 4
Explore 6 versions of Gemma 4. Compare model sizes, packages, hardware requirements, and available setups.