Local AI Hardware Just Got Way More Expensive Than You Think
Kai
0:00 / 0:00
Local AI Hardware Just Got Way More Expensive Than You Think
30 006 просмотров · 11 часов назад
Kai
40,6 тыс. подписчиков
30 006 просмотров · 11 часов назад
The DGX Spark went from $3,999 to $6,950 in a year and RAM prices went through the roof, but the model it was built to run got 57% cheaper to rent. This is the local AI hardware math almost nobody is doing.
A year ago I had a spreadsheet that said buy the hardware and own your AI. I didn't buy, and that turned out to be the smartest thing I did all year. Everyone is comparing the new DGX Spark price to the old one. The real comparison is the box against the token it replaces. In October 2025, gpt-oss-120b cost 40 cents per million output tokens on OpenRouter. Today it's about 17 cents. At the 58.72 tokens per second llama.cpp measures on a Spark, that moves the payback from about five and a half years of nonstop use to over 22.
The chip didn't change. The memory did. A 64GB DDR5 kit went from $191 to $1,118 in a year. The worst 128GB kits went from $329 to $3,399. Framework's 128GB Strix Halo desktop went from $1,999 to $2,459, and Framework blamed the memory. A used RTX 3090 with 24GB sells for about three times what a 10GB 3080 does. Whether you're weighing DGX Spark vs Mac Studio, a Strix Halo mini PC, or a 128GB build of your own, you're mostly paying for RAM in the middle of a shortage.
So why didn't cloud token prices go up too? Batching. A datacenter H100 serves dozens of people from every trip through memory, while the box on your desk serves one. Even when a vendor raises prices, open weights keep it honest: when DeepSeek's V4.1 Flash came in at $1.20 per million at peak, dozens of other endpoints kept serving the same weights for far less.
There's still one place where local AI hardware wins: dense models. Qwen3.8-27B costs at least $1.25 per million tokens hosted, and an RTX 3090 runs it locally at around 66 tokens per second. I also cover the Strata workaround (and why it moves the bill onto RAM), who should still buy hardware anyway, and a 5-minute check to run before you spend anything.
CHAPTERS
0:00 I almost bought one
1:21 $3,999 to $6,950 in one year
2:35 The comparison everyone gets wrong
3:28 Payback went from 5.5 years to 22
4:34 Memory, not the chip
6:09 Why tokens got cheaper (batching)
7:51 What if the cloud raises prices?
9:10 What about Strata?
10:30 Where an RTX 3090 still wins
11:51 Who should buy anyway
13:01 Do this before you buy
SOURCES
The Register: 128GB DGX Spark jumps to $6,950: https://www.theregister.com/systems/2...
NVIDIA DGX Spark hardware specs: https://docs.nvidia.com/dgx/dgx-spark...
llama.cpp DGX Spark benchmarks: https://github.com/ggml-org/llama.cpp...
OpenRouter gpt-oss-120b (today): https://openrouter.ai/openai/gpt-oss-...
OpenRouter gpt-oss-120b (October 2025, Internet Archive): https://web.archive.org/web/202510081...
Hardware Busters: DDR5 up 500% in a year: https://hwbusters.com/news/ddr5-memor...
PCWorld: Framework raises prices as memory costs go up: https://www.pcworld.com/article/30315...
SemiAnalysis InferenceX, gpt-oss 120B on H100: https://inferencex.semianalysis.com/c...
DeepSeek V4.1 Flash release: https://api-docs.deepseek.com/news/ne...
DeepSeek API pricing: https://api-docs.deepseek.com/quick_s...
OpenRouter DeepSeek V4.1 Flash endpoints: https://openrouter.ai/deepseek/deepse...
OpenRouter Qwen3.8-27B endpoints: https://openrouter.ai/qwen/qwen3.8-27b
Qwen3.8-27B on one RTX 3090 with MTP: https://hackmd.io/@thc1006/qwen3-8-27...
Strata: https://github.com/Niko1221/Strata
Do the math yourself on OpenRouter's model pages: https://openrouter.ai/models
Payback figures assume nonstop generation and exclude electricity, which only makes local look better than it is. Used-card prices are individual listings and eBay medians, not averages.
#DGXSpark #LocalAI #LocalLLM