Information Theory: An Exploration Across Disciplines

This monograph explores the interdisciplinary applications of information theory, focusing on the concepts of entropy, mutual information, and their implications in various fields. It explains the fundamental differences between entropy and Shannon’s Measure of Information (SMI), presents the application of information theory to living systems and psychology, and also discusses the role of entropy in art. It critically overviews the definition of correlations and multivariate mutual informa...