Local AI Deals

Cheapest box to run gpt-oss-120b at Q8_0

OpenAI’s gpt-oss-120b is 117B parameters, 5.1B of them read per token. The number below is computed from that and each vendor’s published specs, not asserted. Switch the quant or the context and it recomputes in place.

Fit finderprices checked 9 hours ago
Quant
Context

gpt-oss-120b at Q8_0 needs 126GB.

Cheapest Config that fits: Mac Studio, M5 Ultra, 256GB. Fits, 122GB headroom. Est. 111 tok/s.

Best offer today: $9,499 at Apple in stock, checked 9 hours ago.

Collecting price history — 1 of 90 days. No timing verdict yet.

Offers — Mac Studio, M5 Ultra, 256GB, 1TB

  • Applelist pricein stockchecked 9 hours ago$9,499

GeForce RTX 5090 is a card, not a computer: its price is the US street median plus $1,000 for the minimum host machine. NVIDIA's $1,999 MSRP is not a price anyone pays.

memory = 117B × 1.063 B/param (8.5 bits) + 0.074 GB/1K × 8K K/V + 1.2 GB runtime
speed = bandwidth × 0.5 ÷ (5.1B active × 1.063 B/param) = 5.4 GB read per token
usable = memory − operating system reserve (8% on a Mac, 6% on a DGX Spark, 4% on a card)

Bandwidth is the vendor’s published figure. Every speed is an estimate and says so. Methodology.

Email me when Mac Studio, M5 Ultra, 256GB drops. One email, then we stop.

Pre-filled at the lowest price we have recorded, $9,499.

What else Mac Studio M5 Ultra 256GB runs

Best quant that still fits at 8K context, largest model first. Full list on the Config page.

Bandwidth 1.2TB/s, usable memory 248GB of 256GB.