How to serve DeepSeek-R1 & v3 on NVIDIA GH200 Grace Hopper Superchip (400 tok/sec throughput, 10 tok/sec/query)

Guest post from Luke Miles, a San-Francisco-based engineer who develops an MLP training accelerator (ohmchip.com). We've invited him to share the ...