AMD has entered the AI market with its Instinct series accelerators. The launch of the Instinct MI300 series accelerator, which showcases their advanced CDNA 3 architecture, has the potential to challenge NVIDIA’s market dominance for cloud AI workloads. AMD’s Achilles heel has been its lagging software ecosystem, but there have been recent improvements in supporting AMD hardware on popular AI frameworks. MK1 Flywheel, an inference engine, has achieved comparable performance on AMD Instinct MI210 as on NVIDIA hardware. AMD’s ROCm software stack has improved, but there are still some features missing compared to the CUDA stack. Overall, the results show that AMD Instinct Series is a serious contender for cloud inference workloads.
https://mkone.ai/blog/mk1-flywheel-amd