Start Geo Dictionary | Overview | Topics | Groups | Categories | Bookmark this page.

 Full text search :
 A B C D E F G H I J K L M N O P Q R S T U V W X Y Z #

# information theory

A mathematical approach in communication science which attempts to measure the amount of information or the degree of organization in a system. The theory and its associated methods have been used to describe settlement and population distributions in geographical space. Its mathematical formulation exhibits a close relationship to the mathematics of entropy in statistical thermodynamics.

The basic equation is due to Shannon (Shannon and Weaver, 1949):

{img src=show_image.php?name=bkhumgeofm16.gif }

Where {img src=show_image.php?name=bkhumgeofm40.gif } and H is the information statistic.

The individual xis might therefore be the probabilities of N possible outcomes of a stochastic experiment, proportions of a population in N census tracts, proportion of land in N counties, etc. It can be shown, by both example and mathematical proof, that H approaches zero as one of the xi approaches unity (statistically as one of the outcomes approaches a near certainty). On the other hand if all the xi are approximately equal (at 1Ã£N) then H approaches a maximum given by log N.

In information studies these results are used to define an index R:

{img src=show_image.php?name=bkhumgeofm15.gif }

which is variously termed a measure of redundancy (Shannon and Weaver, 1949) and order (von Foerster). Ambiguities in interpretation arise in geography because a highly concentrated spatial pattern (H = 0, R = 1) and a uniform spatial pattern (H = Hmax R = 0) both suggest order, albeit of quite different kinds.

Marchand (1972) pointed out that in cartography a choropleth map conveys maximum information if each of the class intervals has approximately the same number of mapping units, i.e. H is maximized. He also shows that the maximum amount of information carried by such a map is controlled by the number of mapping units and the number of classes utilized â€” however much raw data may have been used in the compilation. A similar approach uses the H statistic to partition within group from between group information as an aid to classification.Â (AMH)

References and Suggested Reading Marchand, B. 1972: Information theory and geography. Geographical Analysis 4: 234-57.Â Shannon, C.E. and Weaver, W. 1949: The mathematical theory of communication. Campaign, IL: University of Illinois Press.Â Thomas, R.W. 1981: Information statistics in geography. Concepts and techniques in modern geography 31. Norwich: Geo Books.

##### informational city

Other Terms : possibilism | tragedy of the commons | Alonso model
Home |  Add new article  |  Your List |  Tools |  Become an Editor |  Tell a Friend |  Links |  Awards |  Testimonials |  Press |  News |  About