Information Entropy Approaches to Climate Model Uncertainty Quantification

Authors

  • Natalia Sikora Department of Applied Mathematics and Information Theory, Prut Institute of Physical Chemistry and Entropy Studies, North Macedonia Author
  • Filip Vanek Department of Physical Chemistry, Vistula Institute of Thermodynamics, Lithuania Author
  • David Hruska Department of Thermodynamics and Statistical Mechanics, Vistula Institute of Thermodynamics, Croatia Author

DOI:

https://doi.org/10.5281/zenodo.22698537

Keywords:

information entropy, climate model uncertainty, ensemble spread, Shannon entropy, model intercomparison, relative entropy, probabilistic forecasting, uncertainty quantification

Abstract

Climate projections are conventionally summarized by ensemble mean and variance, but these moments can
obscure structural disagreement between models when projected distributions are multimodal or skewed. We
applied information-theoretic entropy measures, Shannon entropy of binned projection distributions and
Kullback-Leibler (relative) entropy between individual models and a multi-model reference distribution, to an
ensemble of 34 CMIP-class climate models projecting end-of-century (2081-2100) surface temperature and
precipitation change under a high-emissions scenario across 22 land regions. Shannon entropy of the cross-model
temperature-change distribution varied more than twofold across regions, from 1.42 bits over the Amazon basin to
3.05 bits over the Arctic, with the five highest-entropy regions all located at high latitudes or in regions with strong
land-atmosphere feedback processes, indicating that model disagreement is concentrated in physically specific
regions rather than distributed uniformly across the globe. Relative entropy between individual models and the
multi-model mean distribution ranged from 0.09 to 1.87 bits across the 34 models, and the eight models identified
as high-relative-entropy outliers (top quartile, mean KL divergence 1.31 bits) disagreed with the ensemble mean
particularly strongly in Arctic amplification magnitude, contributing disproportionately, 61% of total ensemble
variance in Arctic temperature projections despite representing only 24% of the ensemble membership. A
regression of regional Shannon entropy against six candidate physical predictors identified sea-ice feedback
strength and land-atmosphere coupling strength as the strongest joint predictors of projection entropy (adjusted R^2
= 0.68, p < 0.001, n = 22), outperforming a baseline model using only mean warming magnitude (adjusted R^2 =
0.31). Cross-validated removal of the eight high-entropy outlier models reduced overall ensemble Shannon entropy
by 34% on average across regions while shifting the ensemble-mean projection by less than 0.15°C, showing that a
substantial share of headline model spread can be attributed to a structurally distinct minority of models without
materially changing the central estimate. These results argue for reporting information-entropy diagnostics
alongside conventional ensemble statistics to better communicate where, physically, climate projection uncertainty
is concentrated and which models drive it.

References

Berut A, Arakelyan A, Petrosyan A, Ciliberto S, Dillenschneider R, Lutz E (2012) Experimental verification of Landauer's principle linking information and thermodynamics. Nature 483(7388):187-189. https://doi.org/10.1038/nature10872

Lloyd S (2000) Ultimate physical limits to computation. Nature 406(6799):1047-1054. https://doi.org/10.1038/35023282

Esposito M, Van den Broeck C (2010) Three faces of the second law. I. Master equation formulation. Physical Review E 82(1):011143. https://doi.org/10.1103/PhysRevE.82.011143

Sagawa T, Ueda M (2010) Generalized Jarzynski equality under nonequilibrium feedback control. Physical Review Letters 104(9):090602. https://doi.org/10.1103/PhysRevLett.104.090602

Toyabe S, Sagawa T, Ueda M, Muneyuki E, Sano M (2010) Experimental demonstration of information-to-energy conversion and validation of the generalized Jarzynski equality. Nature Physics 6(12):988-992. https://doi.org/10.1038/nphys1821

Verlinde E (2011) On the origin of gravity and the laws of Newton. Journal of High Energy Physics 2011(4):029. https://doi.org/10.1007/JHEP04(2011)029

Vopson MM (2019) The mass-energy-information equivalence principle. AIP Advances 9(9):095206. https://doi.org/10.1063/1.5123794

Szilard L (1929) Uber die Entropieverminderung in einem thermodynamischen System bei Eingriffen intelligenter Wesen. Zeitschrift fur Physik 53(11-12):840-856. https://doi.org/10.1007/BF01341281

Prigogine I (1978) Time, structure, and fluctuations. Science 201(4358):777-785. https://doi.org/10.1126/science.201.4358.777

Hawking SW (1975) Particle creation by black holes. Communications in Mathematical Physics 43(3):199-220. https://doi.org/10.1007/BF02345020

Wolpert DH (2019) The stochastic thermodynamics of computation. Journal of Physics A: Mathematical and Theoretical 52(19):193001. https://doi.org/10.1088/1751-8121/ab0850

Still S, Sivak DA, Bell AJ, Crooks GE (2012) Thermodynamics of prediction. Physical Review Letters 109(12):120604. https://doi.org/10.1103/PhysRevLett.109.120604

Shannon CE (1948) A mathematical theory of communication. Bell System Technical Journal 27(3):379-423. https://doi.org/10.1002/j.1538-7305.1948.tb01338.x

Jaynes ET (1957) Information theory and statistical mechanics. Physical Review 106(4):620-630. https://doi.org/10.1103/PhysRev.106.620

Landauer R (1961) Irreversibility and heat generation in the computing process. IBM Journal of Research and Development 5(3):183-191. https://doi.org/10.1147/rd.53.0183

Bennett CH (1982) The thermodynamics of computation-a review. International Journal of Theoretical Physics 21(12):905-940. https://doi.org/10.1007/BF02084158

Jarzynski C (1997) Nonequilibrium equality for free energy differences. Physical Review Letters 78(14):2690-2693. https://doi.org/10.1103/PhysRevLett.78.2690

Crooks GE (1999) Entropy production fluctuation theorem and the nonequilibrium work relation for free energy differences. Physical Review E 60(3):2721-2726. https://doi.org/10.1103/PhysRevE.60.2721

Seifert U (2012) Stochastic thermodynamics, fluctuation theorems and molecular machines. Reports on Progress in Physics 75(12):126001. https://doi.org/10.1088/0034-4885/75/12/126001

Parrondo JMR, Horowitz JM, Sagawa T (2015) Thermodynamics of information. Nature Physics 11(2):131-139. https://doi.org/10.1038/nphys3230

Bekenstein JD (1973) Black holes and entropy. Physical Review D 7(8):2333-2346. https://doi.org/10.1103/PhysRevD.7.2333

Onsager L (1931) Reciprocal relations in irreversible processes. I. Physical Review 37(4):405-426. https://doi.org/10.1103/PhysRev.37.405

Tsallis C (1988) Possible generalization of Boltzmann-Gibbs statistics. Journal of Statistical Physics 52(1-2):479-487. https://doi.org/10.1007/BF01016429

Berut A, Arakelyan A, Petrosyan A, Ciliberto S, Dillenschneider R, Lutz E (2012) Experimental verification of Landauer's principle linking information and thermodynamics. Nature 483(7388):187-189. https://doi.org/10.1038/nature10872

Lloyd S (2000) Ultimate physical limits to computation. Nature 406(6799):1047-1054. https://doi.org/10.1038/35023282

Esposito M, Van den Broeck C (2010) Three faces of the second law. I. Master equation formulation. Physical Review E 82(1):011143. https://doi.org/10.1103/PhysRevE.82.011143

Downloads

Published

2024-12-01