Replicability of the EC-Earth3 Earth system model under a change in computing environment

• Published in: Geoscientific Model Development
• Main Authors: Massonnet, François, Menegoz, Martín, Acosta Cobos, Mario César, Yepes-Arbós, Xavier, Exarchou, Eleftheria, Doblas Reyes, Francisco
• Other Authors: Universitat Politècnica de Catalunya. Departament d'Arquitectura de Computadors, Barcelona Supercomputing Center
• Format: Article in Journal/Newspaper
• Language: English
• Published: 2020
• Subjects: Àrees temàtiques de la UPC::Desenvolupament humà i sostenible::Degradació ambiental::Canvi climàtic; Àrees temàtiques de la UPC::Matemàtiques i estadística::Matemàtica aplicada a les ciències; Weather forecasting > Mathematical models; Climatic changes > Mathematical models; High performance computing; Previsió del temps > Models matemàtics; Canvis climàtics > Models matemàtics; Càlcul intensiu (Informàtica); Antarctic; Antarc*; Arctic
• Online Access: http://hdl.handle.net/2117/193046; https://doi.org/10.5194/gmd-13-1165-2020

Most Earth system models (ESMs) are running under different high-performance computing (HPC) environments. This has several advantages, from allowing different groups to work with the same tool in parallel to leveraging the burden of ensemble climate simulations, but it also offers alternative solutions in the case of shutdown (expected or not) of any of the environments. However, for obvious scientific reasons, it is critical to ensure that ESMs provide identical results under changes in computing environment. While strict bit-for-bit reproducibility is not always guaranteed with ESMs, it is desirable that results obtained under one computing environment are at least statistically indistinguishable from those obtained under another environment, which we term a “replicability” condition following the metrology nomenclature. Here, we develop a protocol to assess the replicability of the EC-Earth ESM. Using two versions of EC-Earth, we present one case of non-replicability and one case of replicability. The non-replicable case occurs with the older version of the model and likely finds its origin in the treatment of river runoff along Antarctic coasts. By contrast, the more recent version of the model provides replicable results. The methodology presented here has been adopted as a standard test by the EC-Earth consortium (27 institutions in Europe) to evaluate the replicability of any new model version across platforms, including for CMIP6 experiments. To a larger extent, it can be used to assess whether other ESMs can safely be ported from one HPC environment to another for studying climate-related questions. Our results and experience with this work suggest that the default assumption should be that ESMs are not replicable under changes in the HPC environment, until proven otherwise. This research has been supported by the EU Commission – H2020 (grant nos. 727862: APPLICATE, 312979: IS-ENES2, 675191: ESiWACE, and 641727: PRIMAVERA) and the Spanish Ministerio de Economía y Competitividad (MINECO) (grant no. CGL2015-70353-R: HIATUS). Peer Reviewed Postprint (published version)