Entropy 2001, 3[2], 58-63
Entropy
ISSN 1099-4300
http://www.mdpi.org/entropy/

Maximum Entropy: Clearing up Mysteries

Marian Grendár, jr1,* and Marian Grendár2

1 Institute of Measurement Science, Slovak Academy of Sciences, Dúbravska cestá 9, 842 19 Bratislava, Slovakia.
Tel: +(421 7) 54773269 2407, Fax: +(421 7) 54775943, E-mail: [email protected]
2 E-mail: [email protected]
* Author to whom correspondence should be addressed.

Received: 29 November 2000 / Accepted: 31 March 2001 / Published: 8 April 2001

Abstract: There are several mystifications and a couple of mysteries pertinent to MaxEnt. The mystifications, pitfalls and traps are set up mainly by an unfortunate formulation of Jaynes' die problem, the cause célèbre of MaxEnt. After discussing the mystifications a new formulation of the problem is proposed. Then we turn to the mysteries. An answer to the recurring question 'Just what are we accomplishing when we maximize entropy?' [8], based on MaxProb rationale of MaxEnt [6], is recalled. A brief view on the other mystery: 'What is the relation between MaxEnt and the Bayesian method?' [9], in light of the MaxProb rationale of MaxEnt suggests that there is not and cannot be a conflict between MaxEnt and Bayes Theorem.

Keywords: maximum entropy; maximum probability; Jaynes' die problem; maximum likelihood; minimax entropy.


Full text in PDF form, 98 K
© 2001 by MDPI (http://www.mdpi.org). Reproduction for noncommercial purposes permitted.