This book is an introduction to the mathematical description of information in science and engineering. The necessary mathematical theory will be treated in a more vivid way than in the usual theorem-proof structure. This enables the reader to develop an idea of the connections between different information measures and to understand the trains of thoughts in their derivation. As there exist a great number of different possible ways to describe information, these measures are presented in a coherent manner. Some examples of the information measures examined are: Shannon information, applied in coding theory; Akaike information criterion, used in system identification to determine auto-regressive models and in neural networks to identify the number of neu-rons; and Cramer-Rao bound or Fisher information, describing the minimal variances achieved by unbiased estimators. This softcover edition addresses researchers and students in electrical engineering, particularly in control and communications, physics, and applied mathematics.
Information Measures introduces the mathematical description of information in science and engineering, treating the necessary mathematical theory in a more vivid way than in the usual theoretical proof structure. This enables readers to develop an idea of the connections between different information measures and to understand the trains of thoughts in their derivation. As there exist a great number of different possible ways to describe information, these measures are presented in a coherent manner. Examples of the measures treated: Shannon information, applied in coding theory; Akaike information criterion, used in system identification to determine auto-regressive models and in neural networks to identify the number of neurons; and Cramer-Rao bound or Fisher information, describing the minimal variances achieved by unbiased estimators. "A tool [to show] bioinformaticians… how to handle immense amounts of raw data, such as are generated from genome mapping, make sense of them, and render them accessible to scientists." IEEE Engineering in Medicine and Biology
Christoph Arndt
Regression Shannon Transformation coding theory communication electrical engineering information information theory thermodynamics complexity
"Bioinformaticians are facing the challenge of how to handle immense amounts of raw data, such as are generated from genome mapping, make sense of them, and render them accessible to scientists working on a wide variety of problems. "Information Measures: Information and its Description in Science and Engineering" can be such a tool."
IEEE Engineering in Medicine and Biology