Pattern Classification Chapter 2 (Part 2)19 Entropy Entropy Measure the fundamental uncertainty in the values of points selected randomly Measure the fundamental uncertainty in the values of points selected randomly Measured in nats, bit, Measured in nats, bit, Normal distribution has max entropy of all distributions having a given mean and variance Normal distribution has max entropy of all distributions having a given mean and variance
{}