Skill metrics for evaluation and comparison of sea ice models
© The Author(s), 2015. This article is distributed under the terms of the Creative Commons Attribution License. The definitive version was published in Journal of Geophysical Research: Oceans 120 (2015): 5910–5931, doi:10.1002/2015JC010989. Five quantitative methodologies (metrics) that may be used...
Published in: | Journal of Geophysical Research: Oceans |
---|---|
Main Authors: | , , , , |
Format: | Article in Journal/Newspaper |
Language: | English |
Published: |
John Wiley & Sons
2015
|
Subjects: | |
Online Access: | https://hdl.handle.net/1912/7634 |
id |
ftwhoas:oai:darchive.mblwhoilibrary.org:1912/7634 |
---|---|
record_format |
openpolar |
spelling |
ftwhoas:oai:darchive.mblwhoilibrary.org:1912/7634 2023-05-15T18:16:25+02:00 Skill metrics for evaluation and comparison of sea ice models Dukhovskoy, Dmitry S. Ubnoske, Jonathan Blanchard-Wrigglesworth, Edward Hiester, Hannah R. Proshutinsky, Andrey 2015-09-02 application/pdf https://hdl.handle.net/1912/7634 en_US eng John Wiley & Sons https://doi.org/10.1002/2015JC010989 Journal of Geophysical Research: Oceans 120 (2015): 5910–5931 https://hdl.handle.net/1912/7634 doi:10.1002/2015JC010989 Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/ CC-BY-NC-ND Journal of Geophysical Research: Oceans 120 (2015): 5910–5931 doi:10.1002/2015JC010989 Sea ice model Sea ice model validation Model skill assessment Article 2015 ftwhoas https://doi.org/10.1002/2015JC010989 2022-05-28T22:59:27Z © The Author(s), 2015. This article is distributed under the terms of the Creative Commons Attribution License. The definitive version was published in Journal of Geophysical Research: Oceans 120 (2015): 5910–5931, doi:10.1002/2015JC010989. Five quantitative methodologies (metrics) that may be used to assess the skill of sea ice models against a control field are analyzed. The methodologies are Absolute Deviation, Root-Mean-Square Deviation, Mean Displacement, Hausdorff Distance, and Modified Hausdorff Distance. The methodologies are employed to quantify similarity between spatial distribution of the simulated and control scalar fields providing measures of model performance. To analyze their response to dissimilarities in two-dimensional fields (contours), the metrics undergo sensitivity tests (scale, rotation, translation, and noise). Furthermore, in order to assess their ability to quantify resemblance of three-dimensional fields, the metrics are subjected to sensitivity tests where tested fields have continuous random spatial patterns inside the contours. The Modified Hausdorff Distance approach demonstrates the best response to tested differences, with the other methods limited by weak responses to scale and translation. Both Hausdorff Distance and Modified Hausdorff Distance metrics are robust to noise, as opposed to the other methods. The metrics are then employed in realistic cases that validate sea ice concentration fields from numerical models and sea ice mean outlook against control data and observations. The Modified Hausdorff Distance method again exhibits high skill in quantifying similarity between both two-dimensional (ice contour) and three-dimensional (ice concentration) sea ice fields. The study demonstrates that the Modified Hausdorff Distance is a mathematically tractable and efficient method for model skill assessment and comparison providing effective and objective evaluation of both two-dimensional and three-dimensional sea ice characteristics across data sets. U.S. National Science ... Article in Journal/Newspaper Sea ice Woods Hole Scientific Community: WHOAS (Woods Hole Open Access Server) Journal of Geophysical Research: Oceans 120 9 5910 5931 |
institution |
Open Polar |
collection |
Woods Hole Scientific Community: WHOAS (Woods Hole Open Access Server) |
op_collection_id |
ftwhoas |
language |
English |
topic |
Sea ice model Sea ice model validation Model skill assessment |
spellingShingle |
Sea ice model Sea ice model validation Model skill assessment Dukhovskoy, Dmitry S. Ubnoske, Jonathan Blanchard-Wrigglesworth, Edward Hiester, Hannah R. Proshutinsky, Andrey Skill metrics for evaluation and comparison of sea ice models |
topic_facet |
Sea ice model Sea ice model validation Model skill assessment |
description |
© The Author(s), 2015. This article is distributed under the terms of the Creative Commons Attribution License. The definitive version was published in Journal of Geophysical Research: Oceans 120 (2015): 5910–5931, doi:10.1002/2015JC010989. Five quantitative methodologies (metrics) that may be used to assess the skill of sea ice models against a control field are analyzed. The methodologies are Absolute Deviation, Root-Mean-Square Deviation, Mean Displacement, Hausdorff Distance, and Modified Hausdorff Distance. The methodologies are employed to quantify similarity between spatial distribution of the simulated and control scalar fields providing measures of model performance. To analyze their response to dissimilarities in two-dimensional fields (contours), the metrics undergo sensitivity tests (scale, rotation, translation, and noise). Furthermore, in order to assess their ability to quantify resemblance of three-dimensional fields, the metrics are subjected to sensitivity tests where tested fields have continuous random spatial patterns inside the contours. The Modified Hausdorff Distance approach demonstrates the best response to tested differences, with the other methods limited by weak responses to scale and translation. Both Hausdorff Distance and Modified Hausdorff Distance metrics are robust to noise, as opposed to the other methods. The metrics are then employed in realistic cases that validate sea ice concentration fields from numerical models and sea ice mean outlook against control data and observations. The Modified Hausdorff Distance method again exhibits high skill in quantifying similarity between both two-dimensional (ice contour) and three-dimensional (ice concentration) sea ice fields. The study demonstrates that the Modified Hausdorff Distance is a mathematically tractable and efficient method for model skill assessment and comparison providing effective and objective evaluation of both two-dimensional and three-dimensional sea ice characteristics across data sets. U.S. National Science ... |
format |
Article in Journal/Newspaper |
author |
Dukhovskoy, Dmitry S. Ubnoske, Jonathan Blanchard-Wrigglesworth, Edward Hiester, Hannah R. Proshutinsky, Andrey |
author_facet |
Dukhovskoy, Dmitry S. Ubnoske, Jonathan Blanchard-Wrigglesworth, Edward Hiester, Hannah R. Proshutinsky, Andrey |
author_sort |
Dukhovskoy, Dmitry S. |
title |
Skill metrics for evaluation and comparison of sea ice models |
title_short |
Skill metrics for evaluation and comparison of sea ice models |
title_full |
Skill metrics for evaluation and comparison of sea ice models |
title_fullStr |
Skill metrics for evaluation and comparison of sea ice models |
title_full_unstemmed |
Skill metrics for evaluation and comparison of sea ice models |
title_sort |
skill metrics for evaluation and comparison of sea ice models |
publisher |
John Wiley & Sons |
publishDate |
2015 |
url |
https://hdl.handle.net/1912/7634 |
genre |
Sea ice |
genre_facet |
Sea ice |
op_source |
Journal of Geophysical Research: Oceans 120 (2015): 5910–5931 doi:10.1002/2015JC010989 |
op_relation |
https://doi.org/10.1002/2015JC010989 Journal of Geophysical Research: Oceans 120 (2015): 5910–5931 https://hdl.handle.net/1912/7634 doi:10.1002/2015JC010989 |
op_rights |
Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/ |
op_rightsnorm |
CC-BY-NC-ND |
op_doi |
https://doi.org/10.1002/2015JC010989 |
container_title |
Journal of Geophysical Research: Oceans |
container_volume |
120 |
container_issue |
9 |
container_start_page |
5910 |
op_container_end_page |
5931 |
_version_ |
1766190026664706048 |