I have written a draft of a book on entropy, exploring what it is and how it relates to information. Originally inspired by tweets on Twitter, this book delves into various topics such as Shannon entropy, Gibbs entropy, the Boltzmann distribution, and more. Avoiding the second law of thermodynamics and the role of entropy in biology or black hole physics, I focus on the core concepts of entropy without getting too technical. While the content is math-heavy, the key information is highlighted in boxes throughout the book. This unique approach to explaining entropy aims to make the subject more accessible to readers.
https://johncarlosbaez.wordpress.com/2024/07/20/what-is-entropy/