SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIP

International audience The Sea Ice Evaluation Tool (SITool) described in this paper is a performance metrics and diagnostics tool developed to evaluate the skill of Arctic and Antarctic model reconstructions of sea ice concentration, extent, edge location, drift, thickness, and snow depth. It is a P...

Full description

Bibliographic Details
Published in:Geoscientific Model Development
Main Authors: Lin, Xia, Massonnet, François, Fichefet, Thierry, Vancoppenolle, Martin
Other Authors: Pluralité des langues et des Identités : Didactique, Acquisition, Médiations (PLIDAM EA 4514), Institut National des Langues et Civilisations Orientales (Inalco), Centre Georges Lemaître for Earth and Climate Research Louvain (TECLIM), Earth and Life Institute Louvain-La-Neuve (ELI), Université Catholique de Louvain = Catholic University of Louvain (UCL)-Université Catholique de Louvain = Catholic University of Louvain (UCL), Université Catholique de Louvain = Catholic University of Louvain (UCL), Nucleus for European Modeling of the Ocean (NEMO R&D ), Laboratoire d'Océanographie et du Climat : Expérimentations et Approches Numériques (LOCEAN), Muséum national d'Histoire naturelle (MNHN)-Institut de Recherche pour le Développement (IRD)-Institut national des sciences de l'Univers (INSU - CNRS)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Institut Pierre-Simon-Laplace (IPSL (FR_636)), École normale supérieure - Paris (ENS-PSL), Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-Université de Versailles Saint-Quentin-en-Yvelines (UVSQ)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Institut national des sciences de l'Univers (INSU - CNRS)-École polytechnique (X)-Centre National d'Études Spatiales Toulouse (CNES)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Université Paris Cité (UPCité)-École normale supérieure - Paris (ENS-PSL), Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-Université de Versailles Saint-Quentin-en-Yvelines (UVSQ)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-École polytechnique (X)-Centre National d'Études Spatiales Toulouse (CNES)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Université Paris Cité (UPCité)-Muséum national d'Histoire naturelle (MNHN)-Institut de Recherche pour le Développement (IRD)-Institut national des sciences de l'Univers (INSU - CNRS)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Institut Pierre-Simon-Laplace (IPSL (FR_636)), Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-Université de Versailles Saint-Quentin-en-Yvelines (UVSQ)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-École polytechnique (X)-Centre National d'Études Spatiales Toulouse (CNES)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Université Paris Cité (UPCité)
Format: Article in Journal/Newspaper
Language:English
Published: HAL CCSD 2021
Subjects:
Online Access:https://hal.sorbonne-universite.fr/hal-03419271
https://hal.sorbonne-universite.fr/hal-03419271/document
https://hal.sorbonne-universite.fr/hal-03419271/file/gmd-14-6331-2021.pdf
https://doi.org/10.5194/gmd-14-6331-2021
id ftinsu:oai:HAL:hal-03419271v1
record_format openpolar
institution Open Polar
collection Institut national des sciences de l'Univers: HAL-INSU
op_collection_id ftinsu
language English
topic [SDU.STU.OC]Sciences of the Universe [physics]/Earth Sciences/Oceanography
spellingShingle [SDU.STU.OC]Sciences of the Universe [physics]/Earth Sciences/Oceanography
Lin, Xia
Massonnet, François
Fichefet, Thierry
Vancoppenolle, Martin
SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIP
topic_facet [SDU.STU.OC]Sciences of the Universe [physics]/Earth Sciences/Oceanography
description International audience The Sea Ice Evaluation Tool (SITool) described in this paper is a performance metrics and diagnostics tool developed to evaluate the skill of Arctic and Antarctic model reconstructions of sea ice concentration, extent, edge location, drift, thickness, and snow depth. It is a Python-based software and consists of well-documented functions used to derive various sea ice metrics and diagnostics. Here, SITool version 1.0 (v1.0) is introduced and documented, and is then used to evaluate the performance of global sea ice reconstructions from nine models that provided sea ice output under the experimental protocols of the Coupled Model Intercomparison Project phase 6 (CMIP6) Ocean Model Intercomparison Project with two different atmospheric forcing datasets: the Coordinated Ocean-ice Reference Experiments version 2 (CORE-II) and the updated Japanese 55-year atmospheric reanalysis (JRA55-do). Two sets of observational references for the sea ice concentration, thickness, snow depth, and ice drift are systematically used to reflect the impact of observational uncertainty on model performance. Based on available model outputs and observational references, the ice concentration, extent, and edge location during 1980–2007, as well as the ice thickness, snow depth, and ice drift during 2003–2007 are evaluated. In general, model biases are larger than observational uncertainties, and model performance is primarily consistent compared to different observational references. By changing the atmospheric forcing from CORE-II to JRA55-do reanalysis data, the overall performance (mean state, interannual variability, and trend) of the simulated sea ice areal properties in both hemispheres, as well as the mean ice thickness simulation in the Antarctic, the mean snow depth, and ice drift simulations in both hemispheres are improved. The simulated sea ice areal properties are also improved in the model with higher spatial resolution. For the cross-metric analysis, there is no link between the performance in one ...
author2 Pluralité des langues et des Identités : Didactique, Acquisition, Médiations (PLIDAM EA 4514)
Institut National des Langues et Civilisations Orientales (Inalco)
Centre Georges Lemaître for Earth and Climate Research Louvain (TECLIM)
Earth and Life Institute Louvain-La-Neuve (ELI)
Université Catholique de Louvain = Catholic University of Louvain (UCL)-Université Catholique de Louvain = Catholic University of Louvain (UCL)
Université Catholique de Louvain = Catholic University of Louvain (UCL)
Nucleus for European Modeling of the Ocean (NEMO R&D )
Laboratoire d'Océanographie et du Climat : Expérimentations et Approches Numériques (LOCEAN)
Muséum national d'Histoire naturelle (MNHN)-Institut de Recherche pour le Développement (IRD)-Institut national des sciences de l'Univers (INSU - CNRS)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Institut Pierre-Simon-Laplace (IPSL (FR_636))
École normale supérieure - Paris (ENS-PSL)
Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-Université de Versailles Saint-Quentin-en-Yvelines (UVSQ)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Institut national des sciences de l'Univers (INSU - CNRS)-École polytechnique (X)-Centre National d'Études Spatiales Toulouse (CNES)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Université Paris Cité (UPCité)-École normale supérieure - Paris (ENS-PSL)
Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-Université de Versailles Saint-Quentin-en-Yvelines (UVSQ)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-École polytechnique (X)-Centre National d'Études Spatiales Toulouse (CNES)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Université Paris Cité (UPCité)-Muséum national d'Histoire naturelle (MNHN)-Institut de Recherche pour le Développement (IRD)-Institut national des sciences de l'Univers (INSU - CNRS)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Institut Pierre-Simon-Laplace (IPSL (FR_636))
Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-Université de Versailles Saint-Quentin-en-Yvelines (UVSQ)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-École polytechnique (X)-Centre National d'Études Spatiales Toulouse (CNES)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Université Paris Cité (UPCité)
format Article in Journal/Newspaper
author Lin, Xia
Massonnet, François
Fichefet, Thierry
Vancoppenolle, Martin
author_facet Lin, Xia
Massonnet, François
Fichefet, Thierry
Vancoppenolle, Martin
author_sort Lin, Xia
title SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIP
title_short SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIP
title_full SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIP
title_fullStr SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIP
title_full_unstemmed SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIP
title_sort sitool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to cmip6 omip
publisher HAL CCSD
publishDate 2021
url https://hal.sorbonne-universite.fr/hal-03419271
https://hal.sorbonne-universite.fr/hal-03419271/document
https://hal.sorbonne-universite.fr/hal-03419271/file/gmd-14-6331-2021.pdf
https://doi.org/10.5194/gmd-14-6331-2021
genre Antarc*
Antarctic
Arctic
Sea ice
genre_facet Antarc*
Antarctic
Arctic
Sea ice
op_source ISSN: 1991-962X
Geoscientific Model Development Discussions
https://hal.sorbonne-universite.fr/hal-03419271
Geoscientific Model Development Discussions, 2021, 14 (10), pp.6331 - 6354. ⟨10.5194/gmd-14-6331-2021⟩
op_relation info:eu-repo/semantics/altIdentifier/doi/10.5194/gmd-14-6331-2021
hal-03419271
https://hal.sorbonne-universite.fr/hal-03419271
https://hal.sorbonne-universite.fr/hal-03419271/document
https://hal.sorbonne-universite.fr/hal-03419271/file/gmd-14-6331-2021.pdf
doi:10.5194/gmd-14-6331-2021
WOS: 000710774600001
op_rights info:eu-repo/semantics/OpenAccess
op_doi https://doi.org/10.5194/gmd-14-6331-2021
container_title Geoscientific Model Development
container_volume 14
container_issue 10
container_start_page 6331
op_container_end_page 6354
_version_ 1797573357127860224
spelling ftinsu:oai:HAL:hal-03419271v1 2024-04-28T08:01:45+00:00 SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIP Lin, Xia Massonnet, François Fichefet, Thierry Vancoppenolle, Martin Pluralité des langues et des Identités : Didactique, Acquisition, Médiations (PLIDAM EA 4514) Institut National des Langues et Civilisations Orientales (Inalco) Centre Georges Lemaître for Earth and Climate Research Louvain (TECLIM) Earth and Life Institute Louvain-La-Neuve (ELI) Université Catholique de Louvain = Catholic University of Louvain (UCL)-Université Catholique de Louvain = Catholic University of Louvain (UCL) Université Catholique de Louvain = Catholic University of Louvain (UCL) Nucleus for European Modeling of the Ocean (NEMO R&D ) Laboratoire d'Océanographie et du Climat : Expérimentations et Approches Numériques (LOCEAN) Muséum national d'Histoire naturelle (MNHN)-Institut de Recherche pour le Développement (IRD)-Institut national des sciences de l'Univers (INSU - CNRS)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Institut Pierre-Simon-Laplace (IPSL (FR_636)) École normale supérieure - Paris (ENS-PSL) Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-Université de Versailles Saint-Quentin-en-Yvelines (UVSQ)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Institut national des sciences de l'Univers (INSU - CNRS)-École polytechnique (X)-Centre National d'Études Spatiales Toulouse (CNES)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Université Paris Cité (UPCité)-École normale supérieure - Paris (ENS-PSL) Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-Université de Versailles Saint-Quentin-en-Yvelines (UVSQ)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-École polytechnique (X)-Centre National d'Études Spatiales Toulouse (CNES)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Université Paris Cité (UPCité)-Muséum national d'Histoire naturelle (MNHN)-Institut de Recherche pour le Développement (IRD)-Institut national des sciences de l'Univers (INSU - CNRS)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Institut Pierre-Simon-Laplace (IPSL (FR_636)) Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-Université de Versailles Saint-Quentin-en-Yvelines (UVSQ)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-École polytechnique (X)-Centre National d'Études Spatiales Toulouse (CNES)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Université Paris Cité (UPCité) 2021-10-21 https://hal.sorbonne-universite.fr/hal-03419271 https://hal.sorbonne-universite.fr/hal-03419271/document https://hal.sorbonne-universite.fr/hal-03419271/file/gmd-14-6331-2021.pdf https://doi.org/10.5194/gmd-14-6331-2021 en eng HAL CCSD Copernicus Publ info:eu-repo/semantics/altIdentifier/doi/10.5194/gmd-14-6331-2021 hal-03419271 https://hal.sorbonne-universite.fr/hal-03419271 https://hal.sorbonne-universite.fr/hal-03419271/document https://hal.sorbonne-universite.fr/hal-03419271/file/gmd-14-6331-2021.pdf doi:10.5194/gmd-14-6331-2021 WOS: 000710774600001 info:eu-repo/semantics/OpenAccess ISSN: 1991-962X Geoscientific Model Development Discussions https://hal.sorbonne-universite.fr/hal-03419271 Geoscientific Model Development Discussions, 2021, 14 (10), pp.6331 - 6354. ⟨10.5194/gmd-14-6331-2021⟩ [SDU.STU.OC]Sciences of the Universe [physics]/Earth Sciences/Oceanography info:eu-repo/semantics/article Journal articles 2021 ftinsu https://doi.org/10.5194/gmd-14-6331-2021 2024-04-05T00:36:09Z International audience The Sea Ice Evaluation Tool (SITool) described in this paper is a performance metrics and diagnostics tool developed to evaluate the skill of Arctic and Antarctic model reconstructions of sea ice concentration, extent, edge location, drift, thickness, and snow depth. It is a Python-based software and consists of well-documented functions used to derive various sea ice metrics and diagnostics. Here, SITool version 1.0 (v1.0) is introduced and documented, and is then used to evaluate the performance of global sea ice reconstructions from nine models that provided sea ice output under the experimental protocols of the Coupled Model Intercomparison Project phase 6 (CMIP6) Ocean Model Intercomparison Project with two different atmospheric forcing datasets: the Coordinated Ocean-ice Reference Experiments version 2 (CORE-II) and the updated Japanese 55-year atmospheric reanalysis (JRA55-do). Two sets of observational references for the sea ice concentration, thickness, snow depth, and ice drift are systematically used to reflect the impact of observational uncertainty on model performance. Based on available model outputs and observational references, the ice concentration, extent, and edge location during 1980–2007, as well as the ice thickness, snow depth, and ice drift during 2003–2007 are evaluated. In general, model biases are larger than observational uncertainties, and model performance is primarily consistent compared to different observational references. By changing the atmospheric forcing from CORE-II to JRA55-do reanalysis data, the overall performance (mean state, interannual variability, and trend) of the simulated sea ice areal properties in both hemispheres, as well as the mean ice thickness simulation in the Antarctic, the mean snow depth, and ice drift simulations in both hemispheres are improved. The simulated sea ice areal properties are also improved in the model with higher spatial resolution. For the cross-metric analysis, there is no link between the performance in one ... Article in Journal/Newspaper Antarc* Antarctic Arctic Sea ice Institut national des sciences de l'Univers: HAL-INSU Geoscientific Model Development 14 10 6331 6354