A fast input/output library for high-resolution climate models

• Published in: Geoscientific Model Development
• Main Authors: Huang, X. M., Wang, W. C., Fu, H. H., Yang, G. W., Wang, B., Zhang, C.
• Format: Article in Journal/Newspaper
• Language: English
• Published: Copernicus Publications 2014
• Subjects: article; Verlagsveröffentlichung; Sea ice
• Online Access: https://doi.org/10.5194/gmd-7-93-2014; https://noa.gwlb.de/receive/cop_mods_00020727; https://noa.gwlb.de/servlets/MCRFileNodeServlet/cop_derivate_00020682/gmd-7-93-2014.pdf; https://gmd.copernicus.org/articles/7/93/2014/gmd-7-93-2014.pdf

We describe the design and implementation of climate fast input/output (CFIO), a fast input/output (I/O) library for high-resolution climate models. CFIO provides a simple method for modelers to overlap the I/O phase with the computing phase automatically, so as to shorten the running time of numerical simulations. To minimize the code modifications required for porting, CFIO provides similar interfaces and features to parallel Network Common Data Form (PnetCDF), which is one of the most widely used I/O libraries in climate models. We deployed CFIO in three high-resolution climate models, including two ocean models (POP and LICOM) and one sea ice model (CICE). The experimental results show that CFIO improves the performance of climate models significantly versus the original serial I/O approach. When running with CFIO at 0.1° resolution with about 1000 CPU cores, we managed to reduce the running time by factors of 7.9, 4.6 and 2.0 for POP, CICE, and LICOM, respectively. We also compared the performance of CFIO against two existing libraries, PnetCDF and parallel I/O (PIO), in different scenarios. For scenarios with both data output and computations, CFIO decreases the I/O overhead compared to PnetCDF and PIO.