Here’s a wonderful little post by James Gleick about the meaning of the word “information,” according to the OED. A palace indeed. This reminds of of one of my favorite books, Jeremy Campbell’s Grammatical Man: Information, Entropy, Language, and Life