(For the record: I don’t understand entropy, and I’ve kind of made my peace with it. I 100% don’t get how information has entropy.)
Part of the reason entropy is hard to teachis that it started as people tried to figure out steam engines (hence a bunch of heat-related explanations), tied to a bunch of woo-woo but also grounded in massive, giant entropy tables for steam. Add in the ability of computers to do massive statistics, and the love of physicists to tie seemingly-unrelated branches of knowledge together, and you get kind of a mess.
Not only is it hard, but it’s hard with a long history.
Latest Answers