If I tell you something you already know, then that's not very informative. So perhaps information should be measured in terms of unexpectedness, or surprise?