The Quantitative Theory of Information

Research output: Chapter in Book/Report/Conference proceedingBook chapterResearch

Information Theory as developed by Shannon and followers is becoming more and more important in a number of sciences. The concepts appear to be just the right ones with intuitively appealing operational interpretations. Furthermore, the information theoretical quantities are connected by powerful identities and inequalities. The article introduces the concepts code, entropy, divergence, redundancy and mutual information which are considered to be the most important ones.
Original languageEnglish
Title of host publicationPhilosophy of Information
EditorsPieter Adriaans, Johan van Benthem
Number of pages36
Volume8
Place of PublicationAmsterdam
PublisherElsevier
Publication date2008
Pages171-216
ISBN (Print)978-0-444-51726-5
Publication statusPublished - 2008
SeriesHandbook of the Philosophy of Science

ID: 8875984