The author shares photos and details about the computers used to train TorToiSe. They mention that the servers were built over a period of several years, starting with the purchase of six RTX 3090s at launch. The author claims to have bought all 16 GPUs at MSRP. They maintain two servers, one of which is rented out, while the other is used for deep learning projects. The author built and maintains the rigs themselves and prioritized maximum GPU density per server. They discuss the specifications of the deep learning server, including the CPU, GPUs, motherboard, memory, storage, case, and other components. The author also shares details about power, cooling, and thermals.
https://nonint.com/2022/05/30/my-deep-learning-rig/