Entropy 2001, 3[4], 280-292
Entropy
ISSN 1099-4300
http://www.mdpi.org/entropy/

A Possible Extension of Shannon's Information Theory

Takuya Yamano

Institut für Theoretische Physik, Universität zu Köln, Zülpicher Str.77, D-50937 Köln, Germany
and
Department of Applied Physics, Faculty of Science, Tokyo Institute of Technology, Oh-okayama, Meguro-ku, Tokyo,152-8551, Japan.
E-mail: [email protected]

Received: 7 August 2001/ Accepted: 31 October 2001/ Published: 21 November 2001

Abstract: As a possible generalization of Shannon's information theory, we review the formalism based on the non-logarithmic information content parametrized by a real number q, which exhibits nonadditivity of the associated uncertainty. Moreover it is shown that the establishment of the concept of the mutual information is of importance upon the generalization.

Keywords: information theory; Tsallis entropy; nonadditivity; source coding theorem; mutual information.


Full text in PDF form, 116 K; DVI, 45 K; Postscript, 316 K; Tex, 34 K
© 2001 by MDPI (http://www.mdpi.org). Reproduction for noncommercial purposes permitted.