“Algorithms for Modern Hardware” by Sergey Slotin is a forthcoming book targeting everyone from performance engineers to undergraduate computer science students seeking practical ways to optimize programs beyond traditional algorithms. Available on GitHub, the book covers various topics including computer architecture, SIMD, and pipelining, offering case studies achieving significant speedups. The author highlights a shift in algorithm design towards leveraging hardware parallelism. Readers are encouraged to contribute bug fixes and translations. The upcoming parts include parallel algorithms, distributed computing, and software/hardware topics. Notably, the book aims to reshape how modern performance engineering is taught in colleges. The book is a comprehensive effort to address the gap between theoretical knowledge and practical application on modern hardware.
https://en.algorithmica.org/hpc/