The Plumbing of Land Surface Models: Is Poor Performance a Result of Methodology or Data Quality?
International audience The Protocol for the Analysis of Land Surface Models (PALS) Land Surface Model Benchmarking Evaluation Project (PLUMBER) illustrated the value of prescribing a priori performance targets in model intercomparisons. It showed that the performance of turbulent energy flux predict...
Published in: | Journal of Hydrometeorology |
---|---|
Main Authors: | , , , , , , , , , , , , , , , , , , , , |
Other Authors: | , , , , , , , |
Format: | Article in Journal/Newspaper |
Language: | English |
Published: |
HAL CCSD
2016
|
Subjects: | |
Online Access: | https://hal.inrae.fr/hal-02985166 https://hal.inrae.fr/hal-02985166/document https://hal.inrae.fr/hal-02985166/file/G%C3%A4deke_2021_Environ._Res._Lett._16_024049.pdf https://doi.org/10.1175/JHM-D-15-0171.1 |
id |
ftuniparissaclay:oai:HAL:hal-02985166v1 |
---|---|
record_format |
openpolar |
institution |
Open Polar |
collection |
Archives ouvertes de Paris-Saclay |
op_collection_id |
ftuniparissaclay |
language |
English |
topic |
Atmosphere Coupling Experiment Energy-balance Closure Soil-moisture Climate Project Co2 Impact Glace Phase permafrost climate change land surface models Arctic transport winter roads ice roads Arctic accessibility [SDE]Environmental Sciences [SDV.EE.ECO]Life Sciences [q-bio]/Ecology environment/Ecosystems [SDV.EE]Life Sciences [q-bio]/Ecology environment |
spellingShingle |
Atmosphere Coupling Experiment Energy-balance Closure Soil-moisture Climate Project Co2 Impact Glace Phase permafrost climate change land surface models Arctic transport winter roads ice roads Arctic accessibility [SDE]Environmental Sciences [SDV.EE.ECO]Life Sciences [q-bio]/Ecology environment/Ecosystems [SDV.EE]Life Sciences [q-bio]/Ecology environment Haughton, Ned Abramowitz, Gab Pitman, Andy, J Or, Dani Best, Martin, J Johnson, Helen, R Balsamo, Gianpaolo Boone, Aaron Cuntz, Matthias Decharme, Bertrand Dirmeyer, Paul, A Dong, Jairui Ek, Michael Guo, Zichang Haverd, Vanessa van den Hurk, Bart, J J Nearing, Grey, S Pak, Bernard Santanello, Joe, A Stevens, Lauren, E Vuichard, Nicolas The Plumbing of Land Surface Models: Is Poor Performance a Result of Methodology or Data Quality? |
topic_facet |
Atmosphere Coupling Experiment Energy-balance Closure Soil-moisture Climate Project Co2 Impact Glace Phase permafrost climate change land surface models Arctic transport winter roads ice roads Arctic accessibility [SDE]Environmental Sciences [SDV.EE.ECO]Life Sciences [q-bio]/Ecology environment/Ecosystems [SDV.EE]Life Sciences [q-bio]/Ecology environment |
description |
International audience The Protocol for the Analysis of Land Surface Models (PALS) Land Surface Model Benchmarking Evaluation Project (PLUMBER) illustrated the value of prescribing a priori performance targets in model intercomparisons. It showed that the performance of turbulent energy flux predictions from different land surface models, at a broad range of flux tower sites using common evaluation metrics, was on average worse than relatively simple empirical models. For sensible heat fluxes, all land surface models were outperformed by a linear regression against downward shortwave radiation. For latent heat flux, all land surface models were outperformed by a regression against downward shortwave radiation, surface air temperature, and relative humidity. These results are explored here in greater detail and possible causes are investigated. It is examined whether particular metrics or sites unduly influence the collated results, whether results change according to timescale aggregation, and whether a lack of energy conservation in flux tower data gives the empirical models an unfair advantage in the intercomparison. It is demonstrated that energy conservation in the observational data is not responsible for these results. It is also shown that the partitioning between sensible and latent heat fluxes in LSMs, rather than the calculation of available energy, is the cause of the original findings. Finally, evidence is presented that suggests that the nature of this partitioning problem is likely shared among all contributing LSMs. While a single candidate explanation for why land surface models perform poorly relative to empirical benchmarks in PLUMBER could not be found, multiple possible explanations are excluded and guidance is provided on where future research should focus. |
author2 |
Department Computational Hydrosystems UFZ Leipzig Helmholtz Zentrum für Umweltforschung = Helmholtz Centre for Environmental Research (UFZ) Laboratoire des Sciences du Climat et de l'Environnement Gif-sur-Yvette (LSCE) Université de Versailles Saint-Quentin-en-Yvelines (UVSQ)-Institut national des sciences de l'Univers (INSU - CNRS)-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Direction de Recherche Fondamentale (CEA) (DRF (CEA)) Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA) Modélisation des Surfaces et Interfaces Continentales (MOSAIC) Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Université de Versailles Saint-Quentin-en-Yvelines (UVSQ)-Institut national des sciences de l'Univers (INSU - CNRS)-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Direction de Recherche Fondamentale (CEA) (DRF (CEA)) Australian Research CouncilCE110001028Joint DECC/Defra Met Office Hadley Centre Climate Programme CA01101United States Department of Energy (DOE)DE-FG02-04ER63917DE-FG02-04ER63911CFCAS Natural Sciences and Engineering Research Council of Canada (NSERC) BIOCAP Environment and Climate Change Canada Natural Resources Canada European Commission FAO-GTOS-TCO iLEAPS Max Planck Institute for Biogeochemistry National Science Foundation (NSF) University of Tuscia Universite Laval United States Department of Energy (DOE) |
format |
Article in Journal/Newspaper |
author |
Haughton, Ned Abramowitz, Gab Pitman, Andy, J Or, Dani Best, Martin, J Johnson, Helen, R Balsamo, Gianpaolo Boone, Aaron Cuntz, Matthias Decharme, Bertrand Dirmeyer, Paul, A Dong, Jairui Ek, Michael Guo, Zichang Haverd, Vanessa van den Hurk, Bart, J J Nearing, Grey, S Pak, Bernard Santanello, Joe, A Stevens, Lauren, E Vuichard, Nicolas |
author_facet |
Haughton, Ned Abramowitz, Gab Pitman, Andy, J Or, Dani Best, Martin, J Johnson, Helen, R Balsamo, Gianpaolo Boone, Aaron Cuntz, Matthias Decharme, Bertrand Dirmeyer, Paul, A Dong, Jairui Ek, Michael Guo, Zichang Haverd, Vanessa van den Hurk, Bart, J J Nearing, Grey, S Pak, Bernard Santanello, Joe, A Stevens, Lauren, E Vuichard, Nicolas |
author_sort |
Haughton, Ned |
title |
The Plumbing of Land Surface Models: Is Poor Performance a Result of Methodology or Data Quality? |
title_short |
The Plumbing of Land Surface Models: Is Poor Performance a Result of Methodology or Data Quality? |
title_full |
The Plumbing of Land Surface Models: Is Poor Performance a Result of Methodology or Data Quality? |
title_fullStr |
The Plumbing of Land Surface Models: Is Poor Performance a Result of Methodology or Data Quality? |
title_full_unstemmed |
The Plumbing of Land Surface Models: Is Poor Performance a Result of Methodology or Data Quality? |
title_sort |
plumbing of land surface models: is poor performance a result of methodology or data quality? |
publisher |
HAL CCSD |
publishDate |
2016 |
url |
https://hal.inrae.fr/hal-02985166 https://hal.inrae.fr/hal-02985166/document https://hal.inrae.fr/hal-02985166/file/G%C3%A4deke_2021_Environ._Res._Lett._16_024049.pdf https://doi.org/10.1175/JHM-D-15-0171.1 |
geographic |
Arctic |
geographic_facet |
Arctic |
genre |
Arctic Climate change Ice permafrost |
genre_facet |
Arctic Climate change Ice permafrost |
op_source |
ISSN: 1525-755X EISSN: 1525-7541 Journal of Hydrometeorology https://hal.inrae.fr/hal-02985166 Journal of Hydrometeorology, 2016, 17 (6), pp.1705-1723. ⟨10.1175/JHM-D-15-0171.1⟩ |
op_relation |
info:eu-repo/semantics/altIdentifier/doi/10.1175/JHM-D-15-0171.1 info:eu-repo/semantics/altIdentifier/pmid/29630073 hal-02985166 https://hal.inrae.fr/hal-02985166 https://hal.inrae.fr/hal-02985166/document https://hal.inrae.fr/hal-02985166/file/G%C3%A4deke_2021_Environ._Res._Lett._16_024049.pdf doi:10.1175/JHM-D-15-0171.1 PUBMED: 29630073 WOS: 000379507800002 |
op_rights |
info:eu-repo/semantics/OpenAccess |
op_doi |
https://doi.org/10.1175/JHM-D-15-0171.1 |
container_title |
Journal of Hydrometeorology |
container_volume |
17 |
container_issue |
6 |
container_start_page |
1705 |
op_container_end_page |
1723 |
_version_ |
1812174822150504448 |
spelling |
ftuniparissaclay:oai:HAL:hal-02985166v1 2024-10-06T13:46:31+00:00 The Plumbing of Land Surface Models: Is Poor Performance a Result of Methodology or Data Quality? Haughton, Ned Abramowitz, Gab Pitman, Andy, J Or, Dani Best, Martin, J Johnson, Helen, R Balsamo, Gianpaolo Boone, Aaron Cuntz, Matthias Decharme, Bertrand Dirmeyer, Paul, A Dong, Jairui Ek, Michael Guo, Zichang Haverd, Vanessa van den Hurk, Bart, J J Nearing, Grey, S Pak, Bernard Santanello, Joe, A Stevens, Lauren, E Vuichard, Nicolas Department Computational Hydrosystems UFZ Leipzig Helmholtz Zentrum für Umweltforschung = Helmholtz Centre for Environmental Research (UFZ) Laboratoire des Sciences du Climat et de l'Environnement Gif-sur-Yvette (LSCE) Université de Versailles Saint-Quentin-en-Yvelines (UVSQ)-Institut national des sciences de l'Univers (INSU - CNRS)-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Direction de Recherche Fondamentale (CEA) (DRF (CEA)) Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA) Modélisation des Surfaces et Interfaces Continentales (MOSAIC) Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Université de Versailles Saint-Quentin-en-Yvelines (UVSQ)-Institut national des sciences de l'Univers (INSU - CNRS)-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Direction de Recherche Fondamentale (CEA) (DRF (CEA)) Australian Research CouncilCE110001028Joint DECC/Defra Met Office Hadley Centre Climate Programme CA01101United States Department of Energy (DOE)DE-FG02-04ER63917DE-FG02-04ER63911CFCAS Natural Sciences and Engineering Research Council of Canada (NSERC) BIOCAP Environment and Climate Change Canada Natural Resources Canada European Commission FAO-GTOS-TCO iLEAPS Max Planck Institute for Biogeochemistry National Science Foundation (NSF) University of Tuscia Universite Laval United States Department of Energy (DOE) 2016-06-01 https://hal.inrae.fr/hal-02985166 https://hal.inrae.fr/hal-02985166/document https://hal.inrae.fr/hal-02985166/file/G%C3%A4deke_2021_Environ._Res._Lett._16_024049.pdf https://doi.org/10.1175/JHM-D-15-0171.1 en eng HAL CCSD American Meteorological Society info:eu-repo/semantics/altIdentifier/doi/10.1175/JHM-D-15-0171.1 info:eu-repo/semantics/altIdentifier/pmid/29630073 hal-02985166 https://hal.inrae.fr/hal-02985166 https://hal.inrae.fr/hal-02985166/document https://hal.inrae.fr/hal-02985166/file/G%C3%A4deke_2021_Environ._Res._Lett._16_024049.pdf doi:10.1175/JHM-D-15-0171.1 PUBMED: 29630073 WOS: 000379507800002 info:eu-repo/semantics/OpenAccess ISSN: 1525-755X EISSN: 1525-7541 Journal of Hydrometeorology https://hal.inrae.fr/hal-02985166 Journal of Hydrometeorology, 2016, 17 (6), pp.1705-1723. ⟨10.1175/JHM-D-15-0171.1⟩ Atmosphere Coupling Experiment Energy-balance Closure Soil-moisture Climate Project Co2 Impact Glace Phase permafrost climate change land surface models Arctic transport winter roads ice roads Arctic accessibility [SDE]Environmental Sciences [SDV.EE.ECO]Life Sciences [q-bio]/Ecology environment/Ecosystems [SDV.EE]Life Sciences [q-bio]/Ecology environment info:eu-repo/semantics/article Journal articles 2016 ftuniparissaclay https://doi.org/10.1175/JHM-D-15-0171.1 2024-09-06T00:30:30Z International audience The Protocol for the Analysis of Land Surface Models (PALS) Land Surface Model Benchmarking Evaluation Project (PLUMBER) illustrated the value of prescribing a priori performance targets in model intercomparisons. It showed that the performance of turbulent energy flux predictions from different land surface models, at a broad range of flux tower sites using common evaluation metrics, was on average worse than relatively simple empirical models. For sensible heat fluxes, all land surface models were outperformed by a linear regression against downward shortwave radiation. For latent heat flux, all land surface models were outperformed by a regression against downward shortwave radiation, surface air temperature, and relative humidity. These results are explored here in greater detail and possible causes are investigated. It is examined whether particular metrics or sites unduly influence the collated results, whether results change according to timescale aggregation, and whether a lack of energy conservation in flux tower data gives the empirical models an unfair advantage in the intercomparison. It is demonstrated that energy conservation in the observational data is not responsible for these results. It is also shown that the partitioning between sensible and latent heat fluxes in LSMs, rather than the calculation of available energy, is the cause of the original findings. Finally, evidence is presented that suggests that the nature of this partitioning problem is likely shared among all contributing LSMs. While a single candidate explanation for why land surface models perform poorly relative to empirical benchmarks in PLUMBER could not be found, multiple possible explanations are excluded and guidance is provided on where future research should focus. Article in Journal/Newspaper Arctic Climate change Ice permafrost Archives ouvertes de Paris-Saclay Arctic Journal of Hydrometeorology 17 6 1705 1723 |