Color vs. Non-Color data

I was always under the assumption that turning an image to "Non-Color data" that is was converting it to greyscale. Playing around with normal maps it doesn't seem to be doing that at all. So what is