It’s a fascinating subject. here is the series by Gabriele Carcassi. The process of deriving Shannon Entropy formula is quite similar to the process described in previous blog about Boltmann Distribution.