Information Entropy Approaches to Climate Model Uncertainty Quantification
DOI:
https://doi.org/10.5281/zenodo.22698537Keywords:
information entropy, climate model uncertainty, ensemble spread, Shannon entropy, model intercomparison, relative entropy, probabilistic forecasting, uncertainty quantificationAbstract
Climate projections are conventionally summarized by ensemble mean and variance, but these moments can
obscure structural disagreement between models when projected distributions are multimodal or skewed. We
applied information-theoretic entropy measures, Shannon entropy of binned projection distributions and
Kullback-Leibler (relative) entropy between individual models and a multi-model reference distribution, to an
ensemble of 34 CMIP-class climate models projecting end-of-century (2081-2100) surface temperature and
precipitation change under a high-emissions scenario across 22 land regions. Shannon entropy of the cross-model
temperature-change distribution varied more than twofold across regions, from 1.42 bits over the Amazon basin to
3.05 bits over the Arctic, with the five highest-entropy regions all located at high latitudes or in regions with strong
land-atmosphere feedback processes, indicating that model disagreement is concentrated in physically specific
regions rather than distributed uniformly across the globe. Relative entropy between individual models and the
multi-model mean distribution ranged from 0.09 to 1.87 bits across the 34 models, and the eight models identified
as high-relative-entropy outliers (top quartile, mean KL divergence 1.31 bits) disagreed with the ensemble mean
particularly strongly in Arctic amplification magnitude, contributing disproportionately, 61% of total ensemble
variance in Arctic temperature projections despite representing only 24% of the ensemble membership. A
regression of regional Shannon entropy against six candidate physical predictors identified sea-ice feedback
strength and land-atmosphere coupling strength as the strongest joint predictors of projection entropy (adjusted R^2
= 0.68, p < 0.001, n = 22), outperforming a baseline model using only mean warming magnitude (adjusted R^2 =
0.31). Cross-validated removal of the eight high-entropy outlier models reduced overall ensemble Shannon entropy
by 34% on average across regions while shifting the ensemble-mean projection by less than 0.15°C, showing that a
substantial share of headline model spread can be attributed to a structurally distinct minority of models without
materially changing the central estimate. These results argue for reporting information-entropy diagnostics
alongside conventional ensemble statistics to better communicate where, physically, climate projection uncertainty
is concentrated and which models drive it.
References
Berut A, Arakelyan A, Petrosyan A, Ciliberto S, Dillenschneider R, Lutz E (2012) Experimental verification of Landauer's principle linking information and thermodynamics. Nature 483(7388):187-189. https://doi.org/10.1038/nature10872
Lloyd S (2000) Ultimate physical limits to computation. Nature 406(6799):1047-1054. https://doi.org/10.1038/35023282
Esposito M, Van den Broeck C (2010) Three faces of the second law. I. Master equation formulation. Physical Review E 82(1):011143. https://doi.org/10.1103/PhysRevE.82.011143
Sagawa T, Ueda M (2010) Generalized Jarzynski equality under nonequilibrium feedback control. Physical Review Letters 104(9):090602. https://doi.org/10.1103/PhysRevLett.104.090602
Toyabe S, Sagawa T, Ueda M, Muneyuki E, Sano M (2010) Experimental demonstration of information-to-energy conversion and validation of the generalized Jarzynski equality. Nature Physics 6(12):988-992. https://doi.org/10.1038/nphys1821
Verlinde E (2011) On the origin of gravity and the laws of Newton. Journal of High Energy Physics 2011(4):029. https://doi.org/10.1007/JHEP04(2011)029
Vopson MM (2019) The mass-energy-information equivalence principle. AIP Advances 9(9):095206. https://doi.org/10.1063/1.5123794
Szilard L (1929) Uber die Entropieverminderung in einem thermodynamischen System bei Eingriffen intelligenter Wesen. Zeitschrift fur Physik 53(11-12):840-856. https://doi.org/10.1007/BF01341281
Prigogine I (1978) Time, structure, and fluctuations. Science 201(4358):777-785. https://doi.org/10.1126/science.201.4358.777
Hawking SW (1975) Particle creation by black holes. Communications in Mathematical Physics 43(3):199-220. https://doi.org/10.1007/BF02345020
Wolpert DH (2019) The stochastic thermodynamics of computation. Journal of Physics A: Mathematical and Theoretical 52(19):193001. https://doi.org/10.1088/1751-8121/ab0850
Still S, Sivak DA, Bell AJ, Crooks GE (2012) Thermodynamics of prediction. Physical Review Letters 109(12):120604. https://doi.org/10.1103/PhysRevLett.109.120604
Shannon CE (1948) A mathematical theory of communication. Bell System Technical Journal 27(3):379-423. https://doi.org/10.1002/j.1538-7305.1948.tb01338.x
Jaynes ET (1957) Information theory and statistical mechanics. Physical Review 106(4):620-630. https://doi.org/10.1103/PhysRev.106.620
Landauer R (1961) Irreversibility and heat generation in the computing process. IBM Journal of Research and Development 5(3):183-191. https://doi.org/10.1147/rd.53.0183
Bennett CH (1982) The thermodynamics of computation-a review. International Journal of Theoretical Physics 21(12):905-940. https://doi.org/10.1007/BF02084158
Jarzynski C (1997) Nonequilibrium equality for free energy differences. Physical Review Letters 78(14):2690-2693. https://doi.org/10.1103/PhysRevLett.78.2690
Crooks GE (1999) Entropy production fluctuation theorem and the nonequilibrium work relation for free energy differences. Physical Review E 60(3):2721-2726. https://doi.org/10.1103/PhysRevE.60.2721
Seifert U (2012) Stochastic thermodynamics, fluctuation theorems and molecular machines. Reports on Progress in Physics 75(12):126001. https://doi.org/10.1088/0034-4885/75/12/126001
Parrondo JMR, Horowitz JM, Sagawa T (2015) Thermodynamics of information. Nature Physics 11(2):131-139. https://doi.org/10.1038/nphys3230
Bekenstein JD (1973) Black holes and entropy. Physical Review D 7(8):2333-2346. https://doi.org/10.1103/PhysRevD.7.2333
Onsager L (1931) Reciprocal relations in irreversible processes. I. Physical Review 37(4):405-426. https://doi.org/10.1103/PhysRev.37.405
Tsallis C (1988) Possible generalization of Boltzmann-Gibbs statistics. Journal of Statistical Physics 52(1-2):479-487. https://doi.org/10.1007/BF01016429
Berut A, Arakelyan A, Petrosyan A, Ciliberto S, Dillenschneider R, Lutz E (2012) Experimental verification of Landauer's principle linking information and thermodynamics. Nature 483(7388):187-189. https://doi.org/10.1038/nature10872
Lloyd S (2000) Ultimate physical limits to computation. Nature 406(6799):1047-1054. https://doi.org/10.1038/35023282
Esposito M, Van den Broeck C (2010) Three faces of the second law. I. Master equation formulation. Physical Review E 82(1):011143. https://doi.org/10.1103/PhysRevE.82.011143
