ENTROPY Entropy comes from information theory. The higher the entropy the more the information content.
{"Image DocumentName": "ENTROPYEntropy comes from information theory. The higher the entropy the more the information content.", "Image ImageDescription": "Entropy = pi is the probability of event i. Compute it as the proportion of event i in the set. 16/30 are green circles; 14/30 are pink crosses. log2(16/30) = -.9; log2(14/30) = Entropy = -(16/30)(-.9) \u2013(14/30)(-1.1) = .99.", "Image XResolution": "37", "Image YResolution": "37", "Image ResolutionUnit": "Pixels/Centimeter", "Image Software": "SlidePlayer", "Image YCbCrPositioning": "Centered"}