Entropy 2001, 3[3], 162-190
Entropy
ISSN 1099-4300
http://www.mdpi.org/entropy/
Basic Concepts, Identities and Inequalities - the Toolkit of Information Theory

F. Topsøe

Department of Mathematics; University of Copenhagen; Denmark
E-mail: [email protected]

Received: 12 September 2001 / Accepted: 18 September 2001 / Published: 30 September 2001

Abstract: Basic concepts and results of that part of Information Theory which is often referred to as "Shannon Theory" are discussed with focus mainly on the discrete case. The paper is expository with some new proofs and extensions of results and concepts.

Keywords: entropy; divergence; mutual information; concavity; convexity; data reduction.

Full text in PDF form, 346 K; Tex, 72 K
© 2001 by MDPI (http://www.mdpi.org). Reproduction for noncommercial purposes permitted.