NVIDIA’s 748GB AI Desktop Has a Catch

NVIDIA’s DGX Spark and DGX Station promise something local-AI builders have wanted for years: much larger shared memory pools on the desk. Spark combines the GB10 Grace Blackwell Superchip with 128GB of unified memory, while Station moves to the GB300 Grace Blackwell Ultra Desktop Superchip with 748GB of coherent memory and a claimed peak of up to 20 petaFLOPS of AI compute. This episode compares what those figures actually mean for inference, model development, fine-tuning, agents, and open-model workflows. We also examine the catch: memory capacity does not automatically equal discrete-GPU memory bandwidth, peak FP4 figures do not describe every workload, and a model fitting in memory does not guarantee a fast or frictionless experience. Runtime support, ARM64 compatibility on Spark, quantization, context length, power, cooling, storage, and total system cost still matter. NVIDIA says Spark supports models up to 200 billion parameters, or 405 billion with two connected systems. It positions DGX Station for models up to one trillion parameters and for long-running professional workloads. These are vendor workload claims, not promises that every model of that size will run at the speed or quality you expect. Sources and further reading: NVIDIA DGX Station: https://www.nvidia.com/en-us/products... NVIDIA DGX Spark hardware guide: https://docs.nvidia.com/dgx/dgx-spark... NVIDIA DGX announcement: https://nvidianews.nvidia.com/news/nv... NVIDIA open-model blog: https://blogs.nvidia.com/blog/dgx-spa... Simon Willison’s DGX Spark reality note: https://simonwillison.net/2025/Oct/14... Reference video:    • NVIDIA'S 748GB Ram Desktop Makes Local AI ...   The practical conclusion: Spark is a compact development machine with an unusually large shared memory pool. Station is a substantially more ambitious workstation for labs, teams, and developers whose workloads can justify its scale. Neither makes model architecture, software optimization, or performance tradeoffs disappear. Sources used: Reference video supplied by user:    • NVIDIA'S 748GB Ram Desktop Makes Local AI ...   NVIDIA DGX Station product page: https://www.nvidia.com/en-us/products... NVIDIA DGX Spark hardware guide: https://docs.nvidia.com/dgx/dgx-spark... NVIDIA announcement for DGX Spark and DGX Station: https://nvidianews.nvidia.com/news/nv... NVIDIA blog: DGX Spark and Station power open-source frontier models: https://blogs.nvidia.com/blog/dgx-spa... Simon Willison DGX Spark reality note: https://simonwillison.net/2025/Oct/14... Subscribe to CodeMotion for visual explainers about local AI, AI agents, model architecture, developer tools, and the systems behind modern AI.