SETUP GUIDE · OLLAMA·UPDATED NOVEMBER 6, 2026

Run uncensored models with Ollama.

Ollama is the quickest way to run an uncensored model privately on your own computer. Install it, run one command, and you have a chat that stays on your machine. Then make it your own with a system prompt and a saved model.

Source-linked facts · Memory figures are estimates unless marked · Our editorial policy

What you'll have working

By the end you'll have:

  • an uncensored model chatting entirely on your own computer
  • your own saved version of it, with a system prompt and settings you choose
  • a way to load almost any uncensored GGUF from Hugging Face

The worked example uses Dolphin 3.0 Llama 3.1 8B, because it runs on the widest range of hardware. The same steps work for every model on the best uncensored models page.

Before you begin

Your machineModel to start withDownload
8GB NVIDIA/AMD GPU, or a 16GB Apple Silicon Macdolphin3 (8B, Q4_K_M)4.9GB
16GB GPU or a 24GB MacDolphin 3.0 Mistral 24B, small Q4 or Q3About 13 to 15GB
24GB GPU or a 32GB Machuihui_ai/qwen3.6-abliterated:27bVaries by tag. Check the model card
No GPU (CPU only)dolphin34.9GB. It works, but expect slow replies

You also need free disk space for the download and a terminal: PowerShell on Windows, Terminal on macOS or Linux. Download sizes are from each model's listing. Memory needs are estimates and grow with context length.

Step 1: Install Ollama

  • Windows and macOS: download the installer from ollama.com/download and run it. Ollama keeps running in the background.
  • Linux: run the official install script:
curl -fsSL https://ollama.com/install.sh | sh

To check it worked, open a new terminal and run ollama --version. It should print a version number.

Step 2: Run your first uncensored model

ollama run dolphin3

The first run downloads the model. After that it starts in seconds. When you see the >>> prompt, type a message and press Enter.

Check it works: ask something, then a follow-up that depends on the first answer, such as "now rewrite that from the villain's point of view." If the reply uses the earlier context, your setup is working.

Type /bye to leave. The model stays downloaded.

Step 3: Set your own system prompt

Dolphin's maintainers are explicit that the system prompt is how you set the model's tone and rules. Inside a chat, try:

/set system "You are a blunt, uncensored fiction editor. Answer directly. No disclaimers."

Then make it permanent by saving a named copy:

/save my-dolphin

Next time, run ollama run my-dolphin.

Step 4: Build a custom model with a Modelfile

To control temperature, context length and the system prompt in one place, create a plain text file called Modelfile:

FROM dolphin3
SYSTEM """You are a direct, uncensored assistant. Answer the question asked. Skip moralizing and disclaimers unless the user asks."""
PARAMETER temperature 0.7
PARAMETER num_ctx 8192

Then build and run it:

ollama create my-uncensored -f Modelfile
ollama run my-uncensored

num_ctx sets how much conversation the model can remember. Raise it for long chats or documents, but higher values need more memory. For Mistral-24B-based Dolphin models, the maintainers recommend a much lower temperature, around 0.05 to 0.1.

Step 5: Run bigger uncensored models from Hugging Face

Ollama can pull GGUF files straight from Hugging Face using hf.co/<user>/<repo>:<quant>:

ollama run hf.co/lhca521/Huihui-Qwen3.6-27B-abliterated-GGUF:Q4_K_M

Pick a quantization from the repo's file list that fits your memory, using the VRAM guide. Some models publish an Ollama tag directly. For example, the Qwen 3.6 abliterated card gives:

ollama run huihui_ai/qwen3.6-abliterated:27b

New models need a new Ollama. Qwen 3.8-27B builds need a llama.cpp from May 2026 or later. If a fresh model won't load, update Ollama first.

Everyday use

  • See what's downloaded: ollama list
  • See what's loaded in memory: ollama ps
  • Delete a model: ollama rm <name>
  • Use a chat window instead of the terminal: Ollama serves a local API at http://localhost:11434, which chat apps and agents on the same machine can connect to. Everything stays local unless you point that app somewhere else.

Troubleshooting

ProblemFix
Replies are very slowThe model doesn't fit in VRAM and is spilling into system RAM. Try a smaller model or a lower quant (Q4 instead of Q8), or reduce num_ctx.
"Out of memory" or the model won't loadSame cause. Close other GPU-heavy apps and pick a smaller quant.
It still refuses some thingsSet a system prompt (step 3). If it keeps refusing, switch to an abliterated or heretic build from the best models list.
It forgets earlier parts of the chatRaise num_ctx in your Modelfile and recreate the model.
A new model fails with an architecture errorUpdate Ollama. New model families need a newer runtime.
Output is rambling or randomLower the temperature, especially on Mistral-24B Dolphin builds.

Sources and files