Local AI Deals

Cheapest box to run gpt-oss-20b at BF16

OpenAI’s gpt-oss-20b is 21B parameters, 3.6B of them read per token. The number below is computed from that and each vendor’s published specs, not asserted. Switch the quant or the context and it recomputes in place.

Fit finderprices checked 10 hours ago
Quant
Context

gpt-oss-20b at BF16 needs 44GB.

Cheapest Config that fits: Mac mini, M5 Pro, 64GB. Fits, 15GB headroom. Est. 21.3 tok/s.

Best offer today: $2,899 at Apple in stock, checked 10 hours ago.

Collecting price history — 2 of 90 days. No timing verdict yet.

Offers — Mac mini, M5 Pro, 64GB, 512GB

  • B&H Photoout of stockchecked 10 hours ago$2,699
  • Applelist pricein stockchecked 10 hours ago$2,899

GeForce RTX 5090 is a card, not a computer: every price shown for it is the cheapest listing we found plus $1,000 for the minimum host machine.

memory = 21B × 2.000 B/param (16 bits) + 0.049 GB/1K × 8K K/V + 1.2 GB runtime
speed = bandwidth × 0.5 ÷ (3.6B active × 2.000 B/param) = 7.2 GB read per token
usable = memory − operating system reserve (8% on a Mac, 6% on a DGX Spark, 4% on a card)

Bandwidth is the vendor’s published figure. Every speed is an estimate and says so. Methodology.

Email me when Mac mini, M5 Pro, 64GB drops. One email, then we stop.

Pre-filled at the lowest price we have recorded, $2,899.

What else Mac mini M5 Pro 64GB runs

Best quant that still fits at 8K context, largest model first. Full list on the Config page.

Bandwidth 307GB/s, usable memory 59GB of 64GB.