Install Ollama for macOS
Download the Mac application from Ollama, move it to Applications, and open it so the local service starts.
Download Ollama for MacUse Gemma 4 12B through Ollama to answer questions about a local image without uploading it to a hosted model. Check its answer against the visible photo.
Memory starting points for one 7.6 GB Gemma 4 12B image question at short context. The vision encoder and image processing use more memory than text-only chat; these are estimates.
| Machine | Gemma 4 12B · vision |
|---|---|
| NVIDIA GPU · 8 GB | Use CPU offload with enough system RAM; expect slow image answers. |
| NVIDIA GPU · 12 GB | May run with CPU offload; image input leaves little GPU headroom. |
| NVIDIA GPU · 16 GB | Runs a short image question; verify GPU offload. |
| NVIDIA GPU · 24 GB | Runs with more headroom; verify the GPU backend. |
| NVIDIA GPU · 32 GB | Runs with more headroom; verify the GPU backend. |
| AMD Radeon · 8 GB | Use CPU offload with enough system RAM; expect slow image answers. |
| AMD Radeon · 16 GB | Runs a short image question; verify GPU offload. |
| AMD Radeon · 24 GB | Runs with more headroom; verify the GPU backend. |
| AMD Radeon · 32 GB | Runs with more headroom; verify the GPU backend. |
| Intel Arc · 8 GB | Use CPU offload with enough system RAM; expect slow image answers. |
| Intel Arc · 16 GB | Runs a short image question; verify GPU offload. |
| Intel Arc · 24 GB | Runs with more headroom; verify the GPU backend. |
| Intel Arc · 32 GB | Runs with more headroom; verify the GPU backend. |
| Apple Silicon · 16 GB unified | Possible with memory pressure; use a 24 GB-plus Mac for a reliable start. |
| Apple Silicon · 24 GB unified | Runs one short image question; limited headroom. |
| Apple Silicon · 32 GB unified | Runs one short image question with more headroom. |
| Apple Silicon · 64 GB unified | Runs one short image question with more headroom. |
| CPU-only · 16 GB RAM | May need more RAM for image input; choose a larger machine. |
| CPU-only · 32 GB RAM | Can run in RAM; expect slow image answers. |
| CPU-only · 64 GB RAM | Can run in RAM; expect slow image answers. |
AMD and Intel need a working Ollama GPU backend; run ollama ps to confirm actual placement. Larger images and longer context raise memory use. Only a local image file is sent to Ollama.
Install the 12B vision package, save a sample cat photo locally, ask one specific question through Ollama and compare the reply with the picture. Choose the instructions for your operating system.
This setup uses the package documented for this task. Review its source and supported platforms before starting.
Save your machine in My Hardware to get an automatic starting choice. You can always choose any package yourself.
Start with 4K text context and one ordinary JPEG on 16 GB GPU memory or 24 GB Apple Silicon unified memory. A 12 GB GPU may spill into system RAM; use ollama ps to check. Larger images and longer context increase memory use. This is an estimate, not a benchmark.
Choose where you want to run it. The instructions below update to match your selection.
Use Terminal on Apple Silicon. Ollama for macOS is available from the official download page.
Download the Mac application from Ollama, move it to Applications, and open it so the local service starts.
Download Ollama for MacOpen a new Terminal window and confirm the command-line tool is available.
ollama --versionDownload the exact 12B tag from the official Ollama library. This is the same package used in the image command below.
ollama pull gemma4:12bOpen the linked example cat photo from Ollama’s vision guide and save it as cat.jpg in your current working folder. You can substitute another permitted JPEG after the sample succeeds.
Download the sample cat photo Read Ollama vision instructionsIn Terminal, run the vision command with local cat.jpg and save its text answer to image-answer.txt in this folder. Ask which animal appears and describe one visible detail. Open the JPEG and read the saved answer to check it; do not trust details the image does not show.
ollama run gemma4:12b ./cat.jpg "Which animal is in this image? Describe one visible detail." | tee image-answer.txtIn a second Terminal window, verify that the selected package is installed locally.
ollama listGemma 4 returns a description of the sample cat photo. Open the same JPEG and check that the main subject and visible setting match the reply; the model may still miss subtle details.
Only use images you are allowed to process. The example photo comes from the official Ollama vision documentation. An image increases memory use beyond a text-only 4K chat estimate.
Save the image as cat.jpg in the folder where your Terminal or PowerShell is open, then use the platform-specific relative path shown in the guide. Confirm the extension is .jpg, not a web page.
Use a smaller JPEG, close other GPU apps, keep the question short, then check ollama ps for CPU offload. Move to a larger GPU or 24 GB-plus Mac if this remains too slow.
Compare the reply with the visible image. Ask one focused question at a time and treat uncertain or small details as unverified.
Original instructions, model files, and compatibility notes behind this setup.
Source-backed package and platform-route plan for private local chat with Qwen3.5 · 9B. Preserves the official Ollama 9B package, a smaller 4B family fallback, and a clearly labeled community uncensored GGUF option.
Run Qwen3.8 27B with Ollama, connect it to Cline in VS Code, and make one reviewable code change in a tiny local project.
Generate images from text prompts in ComfyUI with the fast distilled or more adjustable base 4B model. Save your results and reuse the visual workflow.