Yun Gao 1, Ioannis Kontoyiannis 2,* and Elie Bienenstock 31 Knight Equity Markets, L.P., Jersey City, NJ 07310, USA
2 Department of Informatics, Athens University of Economics and Business, Athens 10434, Greece
3 Division of Applied Mathematics and Department of Neuroscience, Brown University, Providence, RI 02912, USA
E-Mails:
[email protected];
[email protected];
[email protected]* Author to whom correspondence should be addressed.
Received: 6 March 2008; in revised form: 9 June 2008 / Accepted: 17 June 2008 / Published: 17 June 2008
Article: Estimating the Entropy of Binary Time Series: Methodology, Some Theory and a Simulation StudyEntropy 2008,
10, 71-99 (PDF format 354 K); DOI:
10.3390/entropy-e10020071
Angelo Plastino 1,*, Angel R. Plastino 2, Evaldo M. F. Curado 3 and Montse Casas 41 Exact Sciences Faculty, National University La Plata (UNLP), IFLP-CCT-CONICET, Argentinia; E-mail:
[email protected]2
CREG-UNLP and Conicet, Argentina; Department of Physics, University of
Pretoria, South Africa; Instituto Carlos I de Fisica Teorica y
Computacional, Universidad de Granada, Spain; E-mail:
[email protected]3 CBPF, Rio de Janeiro, Brazil; E-mail:
[email protected]4 Departament de Fisica and IFISC, Universitat de les Illes Balears, 07122 Palma de Mallorca, Spain; E-mail:
[email protected]* Author to whom correspondence should be addressed.
Received: 5 March 2008; in revised form: 14 June 2008 / Accepted: 22 June 2008 / Published: 24 June 2008Article: Incremental Entropy Relation as an Alternative to MaxEntEntropy 2008,
10, 124-130 (PDF format 158 K); DOI:
10.3390/entropy-e10020124
Jan Naudts
Department of Physics, University of Antwerpen, Groenenborgerlaan 171,
2020 Antwerpen, Belgium; E-mail:
[email protected]
Received: 26 February 2008; in
revised form: 1 July 2008 / Accepted: 14 July 2008 / Published: 28 July
2008
Article: Generalised
Exponential Families and Associated Entropy Functions
Entropy 2008,
10, 131-149 (PDF format 206
K); DOI:
10.3390/entropy-e10030131
Gian Paolo BerettaUniversitŕ di Brescia, via Branze 38, Brescia, I-25123, Italy, E-mail:
[email protected]Temporary address: Massachusetts Institute of Technology, Room 3-237, Cambridge, MA 01239, USA
Received: 17 December 2007; in revised form: 30 July 2008 / Accepted: 30 July 2008 / Published: 14 August 2008
Article: Modeling
Non-Equilibrium Dynamics of a Discrete Probability Distribution:
General Rate Equation for Maximal Entropy Generation in a
Maximum-Entropy Landscape with Time-Dependent ConstraintsEntropy 2008,
10, 160-182 (PDF format 235
K); DOI:
10.3390/entropy-e10030160
Gustavo L. Ferri 1, Fernando Olivares 2, Flavia Pennini 2,3, Angel Plastino 3, Anel R. Plastino 4,5,6,* and Montserrat Casas 7
1 Facultad de Ciencias Exactas, Universidad Nacional de La Pampa, Peru y Uruguay, Santa Rosa, La Pampa, Argentina
2 Departamento de Fısica, Universidad Catolica del Norte, Av. Angamos 0610, Antofagasta, Chile
3
Exact Sciences Fac., National University La Plata and IFLP-CCT-CONICET,
C.C. 727, 1900 La Plata, Argentina; E-Mail:
[email protected]4 Instituto Carlos I de Fısica Teorica y Computacional, Universidad de Granada, Granada, Spain
5 CREG-National, University La Plata and CONICET, Argentina
6 Physics Department, University of Pretoria, Pretoria 0002, South Africa
7 Departament de Fısica and IFISC, Universitat de les Illes Balears, 07122 Palma de Mallorca, Spain
* Author to whom correspondence should be addressed; E-Mail:
[email protected]Received: 5 March 2008; in revised form: 25 August 2008 / Accepted: 25 August 2008 / Published: 19 September 2008Article: Deformed Generalization of the Semiclassical EntropyEntropy 2008,
10, 240-247 (PDF format 168 K); DOI:
10.3390/e10030240
Imre CsiszárRényi Institute of Mathematics, Hungarian Academy of Sciences, P.O.Box 127, H1364 Budapest, Hungary. E-mail:
[email protected]Received: 1 September 2008 / Accepted: 12 September 2008 / Published: 19 September 2008
Article: Axiomatic Characterizations of Information MeasuresEntropy 2008,
10, 261-273 (PDF format 187 K); DOI:
10.3390/e10030261Manuscript
ID: Entropy-12-01
Type: Full Research Paper
Title: Possible
roles for thermodynamic laws in a cosmic genesis
Author: Akinbo Ojo
Affiliation: Standard Science
Centre, P.O. Box 3501, Surulere, Lagos, Nigeria
Abstract:
Thermodynamic laws have been found applicable to many systems within
the universe. But are they applicable to the universe itself as a whole
system? Based on the assumption that they are, we are able to propose a
modality rooted in quantum physics which can permit astronomical
increases in the entropy, phase-space volume and thus the number of
position and momentum coordinates that are available in a system, in
spite of any prevailing adiabatic conditions. We conclude that a study
of the thermodynamic consequences of energy introduction into a state
at low or absolute zero temperature may increase our understanding of
any possible cosmic genesis.
Manuscript ID: Entropy-12-03
Type: Full Research Paper
Title: On a Connection between Entropy, Extensive Measurement
and Memoryless Characterization
Author: Peter Sunehag
Affiliation: Statistical
Machine Learning Program, NICTA, Locked bag 8001, 2601 ACT, Australia
Abstract:
We define an entropy based on a chosen governing probability
distribution. If a certain kind of measurements follow such a
distribution it also gives us a suitable scale to study it with. This
scale will appear as a link function that is applied to the
measurements. A link function can also be used to define an alternative
structure on a set. We will see that generalized entropies are
equivalent to using a different scale for the phenomenon that is
studied compared to the scale the measurements arrive on. An extensive
measurement scale is here a scale for which measurements fulfill a
memoryless property. We conclude that the alternative algebraic
structure defined by the link function must be used if we continue to
work on the original scale. We derive Tsallis entropy by using a
generalized log-logistic governing distribution. Typical applications
of Tsallis entropy are related to phenomena with power-law behaviour.
Manuscript ID: Entropy-12-09
Type of the Paper: Full Research Paper
Title: Additive Composed Quantum Statistical Entropy
Authors: Philipp Dedié, Wolfgang Muschik
Abstract:
The incompatibility between the quantum statistical description of
isolated undecomposed systems by the subadditive VON NEUMANN entropy
and the irreversible behavior of the corresponding subdivided two-part
composed system is discussed. An entropy definition for the composed
system is offered. This composed quantum statistical entropy is
additive and describes in contrast to the VON NEUMANN entropy the
irreversibility of the composed system. This entropy definition
dissolves another incompatibility, namely the one using the VON NEUMANN
entropy for any isolated undecomposed system and the thermodynamic
axiom testifying that any reversible composed system can only consist
of reversible subsystems. Moreover, the proposed composed entropy
definition yields an endoreversible description of the composed system
in consideration.
Manuscript ID: Entropy-12-10
Type of the Paper: Full Research Paper
Title: Maximum Entropy Parameter Learning at Elevated Training Temperature
Authors: Ronny Melz
Abstract:
ForMaximum Entropy (ME) parameter inference, the Improved Iterative
Scaling algorithm (IIS) is often preferred over Generalized Iterative
Scaling (GIS) due to its better convergence properties. But
effectively, IIS requires the feature sum for each training event to be
drawn from quite a limited, finite set of discrete values to allow for
an efficiently computable parameter update step. Quite some generality
of ME models is lost by requiring the feature functions to sum to
discrete values. We re-interpret the maximum feature sum (originally
determined by the GIS convergence proof) as an inverse “training
temperature”, i.e. an additional free hyper parameter of the model. We
provide empirical evidence that GIS outperforms IIS for suitable values
of the training temperature, especially in the most interesting early
iterations, despite its less complex implementation.
Manuscript ID: Entropy-12-11
Type of the Paper: Full Research Paper
Title: Graph Entropy and Conditioning
Authors: Arthur Ramer and Marian Grendar
Abstract:
How to perform conditioning when certain letters/outcomes are not
distinguishable? Distinguishability being specified by a graph, we
apply K¨orner’s graph entropy and related information divergence on
graphs to address this question.