Friday, April 20, 2007

LAB10

Shannon's entropy factors in probability while Hartley does not. Shannon's entropy is basically asking how many yes or no questions does it take to get to the root of the question. It factors in probability unlike Hartley's, though through some research on wikipedia I found that the two are very closely related and have joint theorems (entitled the Shannon-Hartley theorem) which ironically is what I've been studying in my Physics of Sound course, as it relates to the Nyquist theorem, which states how much information could travel through a telegram.

No comments: