Statistical Complexity Measures for Cellular Automata Dynamics

Avtorji

  • Adrian Ruzicka Department of Thermodynamics and Statistical Mechanics, Vltava Institute of Applied Physics, Latvia Author
  • Stefan Zizka Department of Physical Chemistry, Tagus Center for Information Theory, Croatia Author
  • Tibor Mach Department of Thermodynamics and Statistical Mechanics, Sava Institute of Chemical Thermodynamics, Hungary Author

DOI:

https://doi.org/10.5281/zenodo.22698439

Ključne besede:

statistical complexity, cellular automata, Shannon entropy rate, epsilon-machine reconstruction, elementary cellular automata, excess entropy, computational mechanics, emergent pattern formation

Povzetek

Elementary cellular automata are among the simplest systems known to generate structure spanning the full range
from trivial order to apparent randomness, yet Wolfram's original four-class behavioral taxonomy is qualitative and
does not by itself quantify how much intrinsic computation a given rule performs. We applied
computational-mechanics-based statistical complexity measures, epsilon-machine reconstruction, Shannon entropy
rate, and excess entropy, to spatial configurations generated by all 88 topologically distinct elementary cellular
automaton rules, each run from 500 random initial conditions on a 400-cell periodic lattice for 2000 time steps, with
the final 200 steps used for statistical estimation after transients were discarded. Statistical complexity, measured in
bits as the Shannon entropy of the reconstructed causal-state distribution, ranged from 0 bits for Wolfram Class I
(fixed-point) rules to a maximum of 3.42 bits for rule 110, a known Class IV (complex/computationally universal)
rule, with Class IV rules showing significantly higher mean statistical complexity (2.71 +/- 0.58 bits) than Class II
periodic rules (0.94 +/- 0.41 bits, p < 0.001, Mann-Whitney U test). Excess entropy and statistical complexity were
strongly correlated across all 88 rules (r = 0.87, p < 0.001), but a subset of 9 rules, all Class IV, showed excess
entropy at least 30% higher than predicted by the pooled linear fit, indicating memory structure not fully captured by
a single scalar entropy-rate measure. Entropy rate alone poorly discriminated Class III (chaotic) from Class IV
(complex) rules, with substantial overlap in the two classes' entropy-rate distributions (Class III: 0.81 +/- 0.15
bits/site; Class IV: 0.74 +/- 0.19 bits/site; not significantly different, p = 0.21), whereas statistical complexity
separated the two classes cleanly, with only 2 of 41 Class III rules exceeding the 10th percentile of the Class IV
statistical-complexity distribution. Reconstructed causal-state counts ranged from 1 (Class I) to 34 (rule 110), and a
sensitivity analysis varying reconstruction history length from 4 to 10 cells showed statistical complexity estimates
stabilizing to within 4% of their asymptotic value by history length 8 for 84 of the 88 rules. These results indicate that
statistical complexity, unlike entropy rate alone, provides a quantitative measure that tracks Wolfram's qualitative
Class IV designation closely, supporting its use as an automated screening criterion for identifying candidate
complex, computationally interesting cellular automaton rules.

Literatura

Szilard L (1929) Uber die Entropieverminderung in einem thermodynamischen System bei Eingriffen intelligenter Wesen. Zeitschrift fur Physik 53(11-12):840-856. https://doi.org/10.1007/BF01341281

Prigogine I (1978) Time, structure, and fluctuations. Science 201(4358):777-785. https://doi.org/10.1126/science.201.4358.777

Hawking SW (1975) Particle creation by black holes. Communications in Mathematical Physics 43(3):199-220. 88 https://doi.org/10.1007/BF02345020

Wolpert DH (2019) The stochastic thermodynamics of computation. Journal of Physics A: Mathematical and Theoretical 52(19):193001. https://doi.org/10.1088/1751-8121/ab0850

Still S, Sivak DA, Bell AJ, Crooks GE (2012) Thermodynamics of prediction. Physical Review Letters 109(12):120604. https://doi.org/10.1103/PhysRevLett.109.120604 14

Shannon CE (1948) A mathematical theory of communication. Bell System Technical Journal 27(3):379-423. https://doi.org/10.1002/j.1538-7305.1948.tb01338.x

Jaynes ET (1957) Information theory and statistical mechanics. Physical Review 106(4):620-630. https://doi.org/10.1103/PhysRev.106.620

Landauer R (1961) Irreversibility and heat generation in the computing process. IBM Journal of Research and Development 5(3):183-191. https://doi.org/10.1147/rd.53.0183

Bennett CH (1982) The thermodynamics of computation-a review. International Journal of Theoretical Physics 21(12):905-940. https://doi.org/10.1007/BF02084158

Jarzynski C (1997) Nonequilibrium equality for free energy differences. Physical Review Letters 78(14):2690-2693. https://doi.org/10.1103/PhysRevLett.78.2690

Crooks GE (1999) Entropy production fluctuation theorem and the nonequilibrium work relation for free energy differences. Physical Review E 60(3):2721-2726. https://doi.org/10.1103/PhysRevE.60.2721

Seifert U (2012) Stochastic thermodynamics, fluctuation theorems and molecular machines. Reports on Progress in Physics 75(12):126001. https://doi.org/10.1088/0034-4885/75/12/126001

Parrondo JMR, Horowitz JM, Sagawa T (2015) Thermodynamics of information. Nature Physics 11(2):131-139. https://doi.org/10.1038/nphys3230

Bekenstein JD (1973) Black holes and entropy. Physical Review D 7(8):2333-2346. https://doi.org/10.1103/PhysRevD.7.2333

Onsager L (1931) Reciprocal relations in irreversible processes. I. Physical Review 37(4):405-426. https://doi.org/10.1103/PhysRev.37.405

Tsallis C (1988) Possible generalization of Boltzmann-Gibbs statistics. Journal of Statistical Physics 52(1-2):479-487. https://doi.org/10.1007/BF01016429

Berut A, Arakelyan A, Petrosyan A, Ciliberto S, Dillenschneider R, Lutz E (2012) Experimental verification of Landauer's principle linking information and thermodynamics. Nature 483(7388):187-189. https://doi.org/10.1038/nature10872

Lloyd S (2000) Ultimate physical limits to computation. Nature 406(6799):1047-1054. https://doi.org/10.1038/35023282

Esposito M, Van den Broeck C (2010) Three faces of the second law. I. Master equation formulation. Physical Review E 82(1):011143. https://doi.org/10.1103/PhysRevE.82.011143

Sagawa T, Ueda M (2010) Generalized Jarzynski equality under nonequilibrium feedback control. Physical Review Letters 104(9):090602. https://doi.org/10.1103/PhysRevLett.104.090602

Toyabe S, Sagawa T, Ueda M, Muneyuki E, Sano M (2010) Experimental demonstration of information-to-energy conversion and validation of the generalized Jarzynski equality. Nature Physics 6(12):988-992. https://doi.org/10.1038/nphys1821

Verlinde E (2011) On the origin of gravity and the laws of Newton. Journal of High Energy Physics 2011(4):029. https://doi.org/10.1007/JHEP04(2011)029

Vopson MM (2019) The mass-energy-information equivalence principle. AIP Advances 9(9):095206. https://doi.org/10.1063/1.5123794

Szilard L (1929) Uber die Entropieverminderung in einem thermodynamischen System bei Eingriffen intelligenter Wesen. Zeitschrift fur Physik 53(11-12):840-856. https://doi.org/10.1007/BF01341281

Prigogine I (1978) Time, structure, and fluctuations. Science 201(4358):777-785. https://doi.org/10.1126/science.201.4358.777

Hawking SW (1975) Particle creation by black holes. Communications in Mathematical Physics 43(3):199-220. https://doi.org/10.1007/BF02345020

Objavljeno

2025-06-27