Follow

oblique fact: when the monty hall host reveals the door that contains the goat, they are technically revealing 1/3 bits of information about which door the car is behind.

that information allows you to improve your odds of winning the car, and it just so happens that switching is how you act on this information

I'm thinking now about how you can compare the entropy of a prior and posterior distribution, and the difference will be the number of bits of information gained between them. I'm not sure if this is valid 🤔

if you believe that you have a 90% likelihood of winning a lottery, and then 100 of your friends lose and you use bayes rule to update your likelihood to 50%, did you just lose information

(I didn't actually do the calculation to see what bayes theorem tells us what the posterior likelihood would be I just took 50% for examples sake lmao)

@SuricrasiaOnline this is what clicked for me yesterday

@SuricrasiaOnline I think I would like to learn more about information theory

@SuricrasiaOnline taking information and THROWING IT RIGHT IN THE TRASH HELL YEAH 🚮

@gdkar @SuricrasiaOnline breaking conservation of information

@SuricrasiaOnline One way I've tried to explain this... suppose there are 1000 doors. You pick one. The host opens 998 wrong doors. Do you still think of the two doors he didn't open, both are equally likely to contain the prize? You know he has to avoi the door you picked and the door with the goat.

People often still don't get it when you put it this way, though.

Suricrasia Online@SuricrasiaOnline@cybre.spacewhat is a fractional bit? it's a bit with uncertainty.

For example, if you ask me a yes/no question and you know that half of the time I just answer randomly, and the other half I tell the truth, then my answer will contain 1/2 bits of information.