Nvidia dominates the high-performance GPU space, but AMD’s strong CPU offerings make it a competitor. AMD’s ability to sell CPUs and GPUs as a unit has led to wins in consoles and supercomputers, like Oak Ridge National Laboratory’s Frontier. Nvidia has the NVLink interconnect but is now pushing for high-performance CPUs with GPUs, like the Grace Hopper series. GH200 combines a Neoverse V2 CPU with an H100 GPU, offering impressive specs like 480 GB of LPDDR5X memory. Benchmarking shows potential for parallel workloads, but issues with latency and performance need to be addressed. Overall, GH200 is a promising but complex system.
https://chipsandcheese.com/2024/07/31/grace-hopper-nvidias-halfway-apu/