The NVIDIA H100 is the latest craze in GPU clusters, but finding reliable consumer reports on them isn’t easy. To help you make an informed decision, we delved into the world of renting a 256 H100 cluster, focusing on factors like price, interconnect reliability, node location, support, and environmental impact. Our findings revealed surprising facts, such as the impactful role of interconnect type, the necessity of spare nodes, and the significant CO2 emissions associated with running a cluster. Ultimately, we chose Genesis Cloud for its Infiniband cluster powered by CO2-free hydroelectricity. Our hope is for companies to consider environmental aspects in their GPU cluster decisions.
https://www.photoroom.com/inside-photoroom/so-you-want-to-rent-an-nvidia-h100-cluster-2024-consumer-guide?slug=inside-photoroom/so-you-want-to-rent-an-nvidia-h100-cluster-2024-consumer-guide&_storyblok_published=511470179&