Cheapest box to run Gemma-4-12B at Q3_K_M
Google’s Gemma-4-12B is 11.95B parameters, dense. The number below is computed from that and each vendor’s published specs, not asserted. Switch the quant or the context and it recomputes in place.
Gemma-4-12B at Q3_K_M needs 8GB.
Cheapest Config that fits: Mac mini, M6, 16GB. Fits, 5GB headroom. Est. 18.9 tok/s.
Best offer today: $1,099 at Apple — in stock, checked 32 minutes ago.
Price history: 34 days recorded.
Dense. 8 of 48 layers are global attention; the sliding-window layers stop growing past 1024 tokens.
Offers — Mac mini, M6, 16GB, 512GB
- Applelist pricein stockchecked 32 minutes ago$1,099
- Mac mini, M6, 16GB$1,099Fits5GB headroomest. 18.9 tok/s
- Mac mini, M6, 24GB$1,299Fits13GB headroomest. 18.9 tok/s
- Mac mini, M6, 32GB$1,499Fits21GB headroomest. 18.9 tok/s
- Mac mini, M5 Pro, 24GB$1,699Fits13GB headroomest. 34.2 tok/s
- Mac mini, M5 Pro, 48GB$2,499Fits37GB headroomest. 34.2 tok/s
- Mac Studio, M5 Max, 36GB$2,499Fits25GB headroomest. 51.2 tok/s
- Mac mini, M5 Pro, 64GB$2,899Fits51GB headroomest. 34.2 tok/s
- GeForce RTX 5090, 32GB$2,999.99+hostFits23GB headroomest. 199 tok/s
- Fits51GB headroomest. 60.8 tok/s
- Mac Studio, M5 Max, 48GB$3,099Fits37GB headroomest. 68.3 tok/s
- Mac Studio, M5 Max, 64GB$3,499Fits51GB headroomest. 68.3 tok/s
- Fits113GB headroomest. 30.4 tok/s
- Fits81GB headroomest. 91.1 tok/s
- Fits112GB headroomest. 60.8 tok/s
- Fits113GB headroomest. 30.4 tok/s
- Fits112GB headroomest. 68.3 tok/s
- Fits81GB headroomest. 134 tok/s
- Fits240GB headroomest. 91.1 tok/s
- Fits240GB headroomest. 134 tok/s
- Fits496GB headroomest. 134 tok/s
| Config | Memory | Price | $/GB | Fit | Headroom | Est. speed |
|---|---|---|---|---|---|---|
| Mac mini, M6 | 16GB | $1,099 | $69 | Fits | 5GB | 18.9 tok/s |
| Mac mini, M6 | 24GB | $1,299 | $54 | Fits | 13GB | 18.9 tok/s |
| Mac mini, M6 | 32GB | $1,499 | $47 | Fits | 21GB | 18.9 tok/s |
| Mac mini, M5 Pro | 24GB | $1,699 | $71 | Fits | 13GB | 34.2 tok/s |
| Mac mini, M5 Pro | 48GB | $2,499 | $52 | Fits | 37GB | 34.2 tok/s |
| Mac Studio, M5 Max | 36GB | $2,499 | $69 | Fits | 25GB | 51.2 tok/s |
| Mac mini, M5 Pro | 64GB | $2,899 | $45 | Fits | 51GB | 34.2 tok/s |
| GeForce RTX 5090 | 32GB | $2,999.99+host | $94 | Fits | 23GB | 199 tok/s |
| Mac Studio, M4 Max, refurb | 64GB | $3,049 | $48 | Fits | 51GB | 60.8 tok/s |
| Mac Studio, M5 Max | 48GB | $3,099 | $65 | Fits | 37GB | 68.3 tok/s |
| Mac Studio, M5 Max | 64GB | $3,499 | $55 | Fits | 51GB | 68.3 tok/s |
| Ascent GX10, GB10 Grace Blackwell | 128GB | $3,999.99 | $31 | Fits | 113GB | 30.4 tok/s |
| Mac Studio, M3 Ultra, refurb | 96GB | $4,329 | $45 | Fits | 81GB | 91.1 tok/s |
| Mac Studio, M4 Max, refurb | 128GB | $4,409 | $34 | Fits | 112GB | 60.8 tok/s |
| DGX Spark, GB10 Grace Blackwell | 128GB | $4,699 | $37 | Fits | 113GB | 30.4 tok/s |
| Mac Studio, M5 Max | 128GB | $5,099 | $40 | Fits | 112GB | 68.3 tok/s |
| Mac Studio, M5 Ultra | 96GB | $5,499 | $57 | Fits | 81GB | 134 tok/s |
| Mac Studio, M3 Ultra, refurb | 256GB | $7,729 | $30 | Fits | 240GB | 91.1 tok/s |
| Mac Studio, M5 Ultra | 256GB | $9,499 | $37 | Fits | 240GB | 134 tok/s |
| Mac Studio, M5 Ultra | 512GB | — | — | Fits | 496GB | 134 tok/s |
GeForce RTX 5090 is a card, not a computer: every price shown for it is the cheapest listing we found plus $1,000 for the minimum host machine.
memory = 11.95B × 0.489 B/param (3.91 bits) + 0.067 GB/1K × 8K K/V + 1.2 GB runtime
speed = bandwidth × 0.65 ÷ (11.95B active × 0.489 B/param) = 5.8 GB read per token
usable = memory − operating system reserve (8% on a Mac, 6% on a DGX Spark, 4% on a card)
Bandwidth is the vendor’s published figure. Every speed is an estimate and says so. Methodology.
What else Mac mini M6 16GB runs
- gpt-oss-20bQ3_K_M, est. 48.3 tok/s
- Phi-4Q5_K_M, est. 11.1 tok/s
- Gemma-4-12BQ6_K, est. 11.3 tok/s
- Qwen3-VL-8B-InstructQ8_0, est. 13.0 tok/s
- Gemma-3n-E4BQ8_0, est. 26.0 tok/s
- Qwen3-4BBF16, est. 13.8 tok/s
Best quant that still fits at 8K context, largest model first. Full list on the Config page.
Bandwidth 170GB/s, usable memory 13GB of 16GB.