Improving scalability of Earth system models through coarse-grained component concurrency – a case study with the ICON v2.6.5 modelling system
In the era of exascale computing, machines with unprecedented computing power are available. Making efficient use of these massively parallel machines, with millions of cores, presents a new challenge. Multi-level and multi-dimensional parallelism will be needed to meet this challenge. Coarse-graine...
Published in: | Geoscientific Model Development |
---|---|
Main Authors: | , , , , , , |
Format: | Article in Journal/Newspaper |
Language: | English |
Published: |
Copernicus Publications
2022
|
Subjects: | |
Online Access: | https://doi.org/10.5194/gmd-15-9157-2022 https://noa.gwlb.de/receive/cop_mods_00064112 https://noa.gwlb.de/servlets/MCRFileNodeServlet/cop_derivate_00062983/gmd-15-9157-2022.pdf https://gmd.copernicus.org/articles/15/9157/2022/gmd-15-9157-2022.pdf |
id |
ftnonlinearchiv:oai:noa.gwlb.de:cop_mods_00064112 |
---|---|
record_format |
openpolar |
spelling |
ftnonlinearchiv:oai:noa.gwlb.de:cop_mods_00064112 2023-05-15T16:41:20+02:00 Improving scalability of Earth system models through coarse-grained component concurrency – a case study with the ICON v2.6.5 modelling system Linardakis, Leonidas Stemmler, Irene Hanke, Moritz Ramme, Lennart Chegini, Fatemeh Ilyina, Tatiana Korn, Peter 2022-12 electronic https://doi.org/10.5194/gmd-15-9157-2022 https://noa.gwlb.de/receive/cop_mods_00064112 https://noa.gwlb.de/servlets/MCRFileNodeServlet/cop_derivate_00062983/gmd-15-9157-2022.pdf https://gmd.copernicus.org/articles/15/9157/2022/gmd-15-9157-2022.pdf eng eng Copernicus Publications Geoscientific Model Development -- http://www.bibliothek.uni-regensburg.de/ezeit/?2456725 -- http://www.geosci-model-dev.net/ -- 1991-9603 https://doi.org/10.5194/gmd-15-9157-2022 https://noa.gwlb.de/receive/cop_mods_00064112 https://noa.gwlb.de/servlets/MCRFileNodeServlet/cop_derivate_00062983/gmd-15-9157-2022.pdf https://gmd.copernicus.org/articles/15/9157/2022/gmd-15-9157-2022.pdf https://creativecommons.org/licenses/by/4.0/ uneingeschränkt info:eu-repo/semantics/openAccess CC-BY article Verlagsveröffentlichung article Text doc-type:article 2022 ftnonlinearchiv https://doi.org/10.5194/gmd-15-9157-2022 2022-12-26T00:12:59Z In the era of exascale computing, machines with unprecedented computing power are available. Making efficient use of these massively parallel machines, with millions of cores, presents a new challenge. Multi-level and multi-dimensional parallelism will be needed to meet this challenge. Coarse-grained component concurrency provides an additional parallelism dimension that complements typically used parallelization methods such as domain decomposition and loop-level shared-memory approaches. While these parallelization methods are data-parallel techniques, and they decompose the data space, component concurrency is a function-parallel technique, and it decomposes the algorithmic space. This additional dimension of parallelism allows us to extend scalability beyond the limits set by established parallelization techniques. It also offers a way to maintain performance (by using more compute power) when the model complexity is increased by adding components, such as biogeochemistry or ice sheet models. Furthermore, concurrency allows each component to run on different hardware, thus leveraging the usage of heterogeneous hardware configurations. In this work we study the characteristics of component concurrency and analyse its behaviour in a general context. The analysis shows that component concurrency increases the “parallel workload”, improving the scalability under certain conditions. These generic considerations are complemented by an analysis of a specific case, namely the coarse-grained concurrency in the multi-level parallelism context of two components of the ICON modelling system: the ICON ocean model ICON-O and the marine biogeochemistry model HAMOCC. The additional computational cost incurred by the biogeochemistry module is about 3 times that of the ICON-O ocean stand alone model, and data parallelization techniques (domain decomposition and loop-level shared-memory parallelization) present a scaling limit that impedes the computational performance of the combined ICON-O–HAMOCC model. Scaling experiments, ... Article in Journal/Newspaper Ice Sheet Niedersächsisches Online-Archiv NOA Geoscientific Model Development 15 24 9157 9176 |
institution |
Open Polar |
collection |
Niedersächsisches Online-Archiv NOA |
op_collection_id |
ftnonlinearchiv |
language |
English |
topic |
article Verlagsveröffentlichung |
spellingShingle |
article Verlagsveröffentlichung Linardakis, Leonidas Stemmler, Irene Hanke, Moritz Ramme, Lennart Chegini, Fatemeh Ilyina, Tatiana Korn, Peter Improving scalability of Earth system models through coarse-grained component concurrency – a case study with the ICON v2.6.5 modelling system |
topic_facet |
article Verlagsveröffentlichung |
description |
In the era of exascale computing, machines with unprecedented computing power are available. Making efficient use of these massively parallel machines, with millions of cores, presents a new challenge. Multi-level and multi-dimensional parallelism will be needed to meet this challenge. Coarse-grained component concurrency provides an additional parallelism dimension that complements typically used parallelization methods such as domain decomposition and loop-level shared-memory approaches. While these parallelization methods are data-parallel techniques, and they decompose the data space, component concurrency is a function-parallel technique, and it decomposes the algorithmic space. This additional dimension of parallelism allows us to extend scalability beyond the limits set by established parallelization techniques. It also offers a way to maintain performance (by using more compute power) when the model complexity is increased by adding components, such as biogeochemistry or ice sheet models. Furthermore, concurrency allows each component to run on different hardware, thus leveraging the usage of heterogeneous hardware configurations. In this work we study the characteristics of component concurrency and analyse its behaviour in a general context. The analysis shows that component concurrency increases the “parallel workload”, improving the scalability under certain conditions. These generic considerations are complemented by an analysis of a specific case, namely the coarse-grained concurrency in the multi-level parallelism context of two components of the ICON modelling system: the ICON ocean model ICON-O and the marine biogeochemistry model HAMOCC. The additional computational cost incurred by the biogeochemistry module is about 3 times that of the ICON-O ocean stand alone model, and data parallelization techniques (domain decomposition and loop-level shared-memory parallelization) present a scaling limit that impedes the computational performance of the combined ICON-O–HAMOCC model. Scaling experiments, ... |
format |
Article in Journal/Newspaper |
author |
Linardakis, Leonidas Stemmler, Irene Hanke, Moritz Ramme, Lennart Chegini, Fatemeh Ilyina, Tatiana Korn, Peter |
author_facet |
Linardakis, Leonidas Stemmler, Irene Hanke, Moritz Ramme, Lennart Chegini, Fatemeh Ilyina, Tatiana Korn, Peter |
author_sort |
Linardakis, Leonidas |
title |
Improving scalability of Earth system models through coarse-grained component concurrency – a case study with the ICON v2.6.5 modelling system |
title_short |
Improving scalability of Earth system models through coarse-grained component concurrency – a case study with the ICON v2.6.5 modelling system |
title_full |
Improving scalability of Earth system models through coarse-grained component concurrency – a case study with the ICON v2.6.5 modelling system |
title_fullStr |
Improving scalability of Earth system models through coarse-grained component concurrency – a case study with the ICON v2.6.5 modelling system |
title_full_unstemmed |
Improving scalability of Earth system models through coarse-grained component concurrency – a case study with the ICON v2.6.5 modelling system |
title_sort |
improving scalability of earth system models through coarse-grained component concurrency – a case study with the icon v2.6.5 modelling system |
publisher |
Copernicus Publications |
publishDate |
2022 |
url |
https://doi.org/10.5194/gmd-15-9157-2022 https://noa.gwlb.de/receive/cop_mods_00064112 https://noa.gwlb.de/servlets/MCRFileNodeServlet/cop_derivate_00062983/gmd-15-9157-2022.pdf https://gmd.copernicus.org/articles/15/9157/2022/gmd-15-9157-2022.pdf |
genre |
Ice Sheet |
genre_facet |
Ice Sheet |
op_relation |
Geoscientific Model Development -- http://www.bibliothek.uni-regensburg.de/ezeit/?2456725 -- http://www.geosci-model-dev.net/ -- 1991-9603 https://doi.org/10.5194/gmd-15-9157-2022 https://noa.gwlb.de/receive/cop_mods_00064112 https://noa.gwlb.de/servlets/MCRFileNodeServlet/cop_derivate_00062983/gmd-15-9157-2022.pdf https://gmd.copernicus.org/articles/15/9157/2022/gmd-15-9157-2022.pdf |
op_rights |
https://creativecommons.org/licenses/by/4.0/ uneingeschränkt info:eu-repo/semantics/openAccess |
op_rightsnorm |
CC-BY |
op_doi |
https://doi.org/10.5194/gmd-15-9157-2022 |
container_title |
Geoscientific Model Development |
container_volume |
15 |
container_issue |
24 |
container_start_page |
9157 |
op_container_end_page |
9176 |
_version_ |
1766031773278404608 |