Kolmogorov-Sinai Entropy in Nonlinear Dynamical Systems
DOI:
https://doi.org/10.5281/zenodo.22698421Ključne besede:
Kolmogorov-Sinai entropy, Lyapunov exponents, chaotic dynamics, Pesin theorem, coupled map lattices, symbolic dynamics, entropy estimation, deterministic chaosPovzetek
Kolmogorov-Sinai (KS) entropy quantifies the rate at which a chaotic dynamical system generates information, and
Pesin's theorem relates it to the sum of positive Lyapunov exponents, but practical estimation of KS entropy from
finite, noisy trajectory data remains substantially less reliable than computing Lyapunov exponents directly,
particularly in spatially extended systems. We computed KS entropy via three independent routes, direct
Lyapunov-exponent summation under Pesin's theorem, symbolic-dynamics block entropy, and a
Grassberger-Procaccia correlation-entropy estimator, for a one-dimensional coupled map lattice of logistic maps
with 8 to 128 lattice sites and coupling strengths from 0.0 (uncoupled) to 0.5, across 65 parameter combinations,
each analyzed from time series of 2×10^5 iterations after transient removal. In the uncoupled limit, all three
estimators agreed with the Pesin-theorem value to within 3% at the fully chaotic control parameter (r = 4.0), but
Grassberger-Procaccia correlation-entropy estimates diverged sharply as lattice size increased, underestimating
true KS entropy by 41% at 128 sites and moderate coupling (0.2), a consequence of the curse of dimensionality
afflicting correlation-integral estimation in high-dimensional phase space. Symbolic-dynamics block entropy tracked
the Pesin-theorem value more robustly, remaining within 12% even at 128 sites, but required block lengths that
grew computationally prohibitive (>10^7 distinct symbol blocks) beyond 64 sites, imposing a practical system-size
ceiling on this method distinct from its accuracy limitations. Adding observational noise at signal-to-noise ratios from
40 dB down to 10 dB degraded the correlation-entropy estimator fastest, with error exceeding 50% below 20 dB,
while the Pesin-theorem estimate, computed from the full Jacobian spectrum, remained comparatively robust, with
error below 15% even at 10 dB, since Lyapunov-exponent estimation from noisy data benefited from ensemble
averaging across the lattice. KS entropy itself increased monotonically with coupling strength up to approximately
0.3, peaking at 2.1 bits per iteration at 128 sites, then declined by 18% as coupling strengths approached 0.5 and
the lattice entered a more spatially synchronized, lower-entropy regime. These results identify practical accuracy
and computational trade-offs among common KS entropy estimators and show that estimator choice matters
substantially more in high-dimensional, noisy, or strongly coupled spatially extended chaotic systems than in
low-dimensional benchmarks.
Literatura
Toyabe S, Sagawa T, Ueda M, Muneyuki E, Sano M (2010) Experimental demonstration of information-to-energy conversion and validation of the generalized Jarzynski equality. Nature Physics 6(12):988-992. https://doi.org/10.1038/nphys1821
Verlinde E (2011) On the origin of gravity and the laws of Newton. Journal of High Energy Physics 2011(4):029. https://doi.org/10.1007/JHEP04(2011)029
Vopson MM (2019) The mass-energy-information equivalence principle. AIP Advances 9(9):095206. https://doi.org/10.1063/1.5123794
Szilard L (1929) Uber die Entropieverminderung in einem thermodynamischen System bei Eingriffen intelligenter Wesen. Zeitschrift fur Physik 53(11-12):840-856. https://doi.org/10.1007/BF01341281
Prigogine I (1978) Time, structure, and fluctuations. Science 201(4358):777-785. https://doi.org/10.1126/science.201.4358.777
Hawking SW (1975) Particle creation by black holes. Communications in Mathematical Physics 43(3):199-220. https://doi.org/10.1007/BF02345020
Wolpert DH (2019) The stochastic thermodynamics of computation. Journal of Physics A: Mathematical and Theoretical 52(19):193001. https://doi.org/10.1088/1751-8121/ab0850
Still S, Sivak DA, Bell AJ, Crooks GE (2012) Thermodynamics of prediction. Physical Review Letters 109(12):120604. https://doi.org/10.1103/PhysRevLett.109.120604
Shannon CE (1948) A mathematical theory of communication. Bell System Technical Journal 27(3):379-423. https://doi.org/10.1002/j.1538-7305.1948.tb01338.x
Jaynes ET (1957) Information theory and statistical mechanics. Physical Review 106(4):620-630. https://doi.org/10.1103/PhysRev.106.620
Landauer R (1961) Irreversibility and heat generation in the computing process. IBM Journal of Research and Development 5(3):183-191. https://doi.org/10.1147/rd.53.0183
Bennett CH (1982) The thermodynamics of computation-a review. International Journal of Theoretical Physics 21(12):905-940. https://doi.org/10.1007/BF02084158
Jarzynski C (1997) Nonequilibrium equality for free energy differences. Physical Review Letters 78(14):2690-2693. https://doi.org/10.1103/PhysRevLett.78.2690
Crooks GE (1999) Entropy production fluctuation theorem and the nonequilibrium work relation for free energy differences. Physical Review E 60(3):2721-2726. https://doi.org/10.1103/PhysRevE.60.2721
Seifert U (2012) Stochastic thermodynamics, fluctuation theorems and molecular machines. Reports on Progress in Physics 75(12):126001. https://doi.org/10.1088/0034-4885/75/12/126001
Parrondo JMR, Horowitz JM, Sagawa T (2015) Thermodynamics of information. Nature Physics 11(2):131-139. https://doi.org/10.1038/nphys3230
Bekenstein JD (1973) Black holes and entropy. Physical Review D 7(8):2333-2346. https://doi.org/10.1103/PhysRevD.7.2333
Onsager L (1931) Reciprocal relations in irreversible processes. I. Physical Review 37(4):405-426. https://doi.org/10.1103/PhysRev.37.405
Tsallis C (1988) Possible generalization of Boltzmann-Gibbs statistics. Journal of Statistical Physics 52(1-2):479-487. https://doi.org/10.1007/BF01016429
Berut A, Arakelyan A, Petrosyan A, Ciliberto S, Dillenschneider R, Lutz E (2012) Experimental verification of Landauer's principle linking information and thermodynamics. Nature 483(7388):187-189. https://doi.org/10.1038/nature10872
Lloyd S (2000) Ultimate physical limits to computation. Nature 406(6799):1047-1054. https://doi.org/10.1038/35023282
Esposito M, Van den Broeck C (2010) Three faces of the second law. I. Master equation formulation. Physical Review E 82(1):011143. https://doi.org/10.1103/PhysRevE.82.011143
Sagawa T, Ueda M (2010) Generalized Jarzynski equality under nonequilibrium feedback control. Physical Review Letters 104(9):090602. https://doi.org/10.1103/PhysRevLett.104.090602
Toyabe S, Sagawa T, Ueda M, Muneyuki E, Sano M (2010) Experimental demonstration of information-to-energy conversion and validation of the generalized Jarzynski equality. Nature Physics 6(12):988-992. https://doi.org/10.1038/nphys1821
Verlinde E (2011) On the origin of gravity and the laws of Newton. Journal of High Energy Physics 2011(4):029. https://doi.org/10.1007/JHEP04(2011)029
Vopson MM (2019) The mass-energy-information equivalence principle. AIP Advances 9(9):095206. https://doi.org/10.1063/1.5123794
