The Plumbing of Land Surface Models: Is Poor Performance a Result of Methodology or Data Quality?

International audience The Protocol for the Analysis of Land Surface Models (PALS) Land Surface Model Benchmarking Evaluation Project (PLUMBER) illustrated the value of prescribing a priori performance targets in model intercomparisons. It showed that the performance of turbulent energy flux predict...

Full description

Bibliographic Details
Published in:Journal of Hydrometeorology
Main Authors: Haughton, Ned, Abramowitz, Gab, Pitman, Andy, J, Or, Dani, Best, Martin, J, Johnson, Helen, R, Balsamo, Gianpaolo, Boone, Aaron, Cuntz, Matthias, Decharme, Bertrand, Dirmeyer, Paul, A, Dong, Jairui, Ek, Michael, Guo, Zichang, Haverd, Vanessa, van den Hurk, Bart, J J, Nearing, Grey, S, Pak, Bernard, Santanello, Joe, A, Stevens, Lauren, E, Vuichard, Nicolas
Other Authors: Department Computational Hydrosystems UFZ Leipzig, Helmholtz Zentrum für Umweltforschung = Helmholtz Centre for Environmental Research (UFZ), Laboratoire des Sciences du Climat et de l'Environnement Gif-sur-Yvette (LSCE), Université de Versailles Saint-Quentin-en-Yvelines (UVSQ)-Institut national des sciences de l'Univers (INSU - CNRS)-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Direction de Recherche Fondamentale (CEA) (DRF (CEA)), Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA), Modélisation des Surfaces et Interfaces Continentales (MOSAIC), Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Université de Versailles Saint-Quentin-en-Yvelines (UVSQ)-Institut national des sciences de l'Univers (INSU - CNRS)-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Direction de Recherche Fondamentale (CEA) (DRF (CEA)), Australian Research CouncilCE110001028Joint DECC/Defra Met Office Hadley Centre Climate Programme CA01101United States Department of Energy (DOE)DE-FG02-04ER63917DE-FG02-04ER63911CFCAS Natural Sciences and Engineering Research Council of Canada (NSERC) BIOCAP Environment and Climate Change Canada Natural Resources Canada European Commission FAO-GTOS-TCO iLEAPS Max Planck Institute for Biogeochemistry National Science Foundation (NSF) University of Tuscia Universite Laval United States Department of Energy (DOE)
Format: Article in Journal/Newspaper
Language:English
Published: HAL CCSD 2016
Subjects:
Co2
Ice
Online Access:https://hal.inrae.fr/hal-02985166
https://hal.inrae.fr/hal-02985166/document
https://hal.inrae.fr/hal-02985166/file/G%C3%A4deke_2021_Environ._Res._Lett._16_024049.pdf
https://doi.org/10.1175/JHM-D-15-0171.1
id ftuniparissaclay:oai:HAL:hal-02985166v1
record_format openpolar
institution Open Polar
collection Archives ouvertes de Paris-Saclay
op_collection_id ftuniparissaclay
language English
topic Atmosphere Coupling Experiment
Energy-balance Closure
Soil-moisture
Climate
Project
Co2
Impact
Glace
Phase
permafrost
climate change
land surface models
Arctic transport
winter roads
ice roads
Arctic accessibility
[SDE]Environmental Sciences
[SDV.EE.ECO]Life Sciences [q-bio]/Ecology
environment/Ecosystems
[SDV.EE]Life Sciences [q-bio]/Ecology
environment
spellingShingle Atmosphere Coupling Experiment
Energy-balance Closure
Soil-moisture
Climate
Project
Co2
Impact
Glace
Phase
permafrost
climate change
land surface models
Arctic transport
winter roads
ice roads
Arctic accessibility
[SDE]Environmental Sciences
[SDV.EE.ECO]Life Sciences [q-bio]/Ecology
environment/Ecosystems
[SDV.EE]Life Sciences [q-bio]/Ecology
environment
Haughton, Ned
Abramowitz, Gab
Pitman, Andy, J
Or, Dani
Best, Martin, J
Johnson, Helen, R
Balsamo, Gianpaolo
Boone, Aaron
Cuntz, Matthias
Decharme, Bertrand
Dirmeyer, Paul, A
Dong, Jairui
Ek, Michael
Guo, Zichang
Haverd, Vanessa
van den Hurk, Bart, J J
Nearing, Grey, S
Pak, Bernard
Santanello, Joe, A
Stevens, Lauren, E
Vuichard, Nicolas
The Plumbing of Land Surface Models: Is Poor Performance a Result of Methodology or Data Quality?
topic_facet Atmosphere Coupling Experiment
Energy-balance Closure
Soil-moisture
Climate
Project
Co2
Impact
Glace
Phase
permafrost
climate change
land surface models
Arctic transport
winter roads
ice roads
Arctic accessibility
[SDE]Environmental Sciences
[SDV.EE.ECO]Life Sciences [q-bio]/Ecology
environment/Ecosystems
[SDV.EE]Life Sciences [q-bio]/Ecology
environment
description International audience The Protocol for the Analysis of Land Surface Models (PALS) Land Surface Model Benchmarking Evaluation Project (PLUMBER) illustrated the value of prescribing a priori performance targets in model intercomparisons. It showed that the performance of turbulent energy flux predictions from different land surface models, at a broad range of flux tower sites using common evaluation metrics, was on average worse than relatively simple empirical models. For sensible heat fluxes, all land surface models were outperformed by a linear regression against downward shortwave radiation. For latent heat flux, all land surface models were outperformed by a regression against downward shortwave radiation, surface air temperature, and relative humidity. These results are explored here in greater detail and possible causes are investigated. It is examined whether particular metrics or sites unduly influence the collated results, whether results change according to timescale aggregation, and whether a lack of energy conservation in flux tower data gives the empirical models an unfair advantage in the intercomparison. It is demonstrated that energy conservation in the observational data is not responsible for these results. It is also shown that the partitioning between sensible and latent heat fluxes in LSMs, rather than the calculation of available energy, is the cause of the original findings. Finally, evidence is presented that suggests that the nature of this partitioning problem is likely shared among all contributing LSMs. While a single candidate explanation for why land surface models perform poorly relative to empirical benchmarks in PLUMBER could not be found, multiple possible explanations are excluded and guidance is provided on where future research should focus.
author2 Department Computational Hydrosystems UFZ Leipzig
Helmholtz Zentrum für Umweltforschung = Helmholtz Centre for Environmental Research (UFZ)
Laboratoire des Sciences du Climat et de l'Environnement Gif-sur-Yvette (LSCE)
Université de Versailles Saint-Quentin-en-Yvelines (UVSQ)-Institut national des sciences de l'Univers (INSU - CNRS)-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Direction de Recherche Fondamentale (CEA) (DRF (CEA))
Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)
Modélisation des Surfaces et Interfaces Continentales (MOSAIC)
Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Université de Versailles Saint-Quentin-en-Yvelines (UVSQ)-Institut national des sciences de l'Univers (INSU - CNRS)-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Direction de Recherche Fondamentale (CEA) (DRF (CEA))
Australian Research CouncilCE110001028Joint DECC/Defra Met Office Hadley Centre Climate Programme CA01101United States Department of Energy (DOE)DE-FG02-04ER63917DE-FG02-04ER63911CFCAS Natural Sciences and Engineering Research Council of Canada (NSERC) BIOCAP Environment and Climate Change Canada Natural Resources Canada European Commission FAO-GTOS-TCO iLEAPS Max Planck Institute for Biogeochemistry National Science Foundation (NSF) University of Tuscia Universite Laval United States Department of Energy (DOE)
format Article in Journal/Newspaper
author Haughton, Ned
Abramowitz, Gab
Pitman, Andy, J
Or, Dani
Best, Martin, J
Johnson, Helen, R
Balsamo, Gianpaolo
Boone, Aaron
Cuntz, Matthias
Decharme, Bertrand
Dirmeyer, Paul, A
Dong, Jairui
Ek, Michael
Guo, Zichang
Haverd, Vanessa
van den Hurk, Bart, J J
Nearing, Grey, S
Pak, Bernard
Santanello, Joe, A
Stevens, Lauren, E
Vuichard, Nicolas
author_facet Haughton, Ned
Abramowitz, Gab
Pitman, Andy, J
Or, Dani
Best, Martin, J
Johnson, Helen, R
Balsamo, Gianpaolo
Boone, Aaron
Cuntz, Matthias
Decharme, Bertrand
Dirmeyer, Paul, A
Dong, Jairui
Ek, Michael
Guo, Zichang
Haverd, Vanessa
van den Hurk, Bart, J J
Nearing, Grey, S
Pak, Bernard
Santanello, Joe, A
Stevens, Lauren, E
Vuichard, Nicolas
author_sort Haughton, Ned
title The Plumbing of Land Surface Models: Is Poor Performance a Result of Methodology or Data Quality?
title_short The Plumbing of Land Surface Models: Is Poor Performance a Result of Methodology or Data Quality?
title_full The Plumbing of Land Surface Models: Is Poor Performance a Result of Methodology or Data Quality?
title_fullStr The Plumbing of Land Surface Models: Is Poor Performance a Result of Methodology or Data Quality?
title_full_unstemmed The Plumbing of Land Surface Models: Is Poor Performance a Result of Methodology or Data Quality?
title_sort plumbing of land surface models: is poor performance a result of methodology or data quality?
publisher HAL CCSD
publishDate 2016
url https://hal.inrae.fr/hal-02985166
https://hal.inrae.fr/hal-02985166/document
https://hal.inrae.fr/hal-02985166/file/G%C3%A4deke_2021_Environ._Res._Lett._16_024049.pdf
https://doi.org/10.1175/JHM-D-15-0171.1
geographic Arctic
geographic_facet Arctic
genre Arctic
Climate change
Ice
permafrost
genre_facet Arctic
Climate change
Ice
permafrost
op_source ISSN: 1525-755X
EISSN: 1525-7541
Journal of Hydrometeorology
https://hal.inrae.fr/hal-02985166
Journal of Hydrometeorology, 2016, 17 (6), pp.1705-1723. ⟨10.1175/JHM-D-15-0171.1⟩
op_relation info:eu-repo/semantics/altIdentifier/doi/10.1175/JHM-D-15-0171.1
info:eu-repo/semantics/altIdentifier/pmid/29630073
hal-02985166
https://hal.inrae.fr/hal-02985166
https://hal.inrae.fr/hal-02985166/document
https://hal.inrae.fr/hal-02985166/file/G%C3%A4deke_2021_Environ._Res._Lett._16_024049.pdf
doi:10.1175/JHM-D-15-0171.1
PUBMED: 29630073
WOS: 000379507800002
op_rights info:eu-repo/semantics/OpenAccess
op_doi https://doi.org/10.1175/JHM-D-15-0171.1
container_title Journal of Hydrometeorology
container_volume 17
container_issue 6
container_start_page 1705
op_container_end_page 1723
_version_ 1812174822150504448
spelling ftuniparissaclay:oai:HAL:hal-02985166v1 2024-10-06T13:46:31+00:00 The Plumbing of Land Surface Models: Is Poor Performance a Result of Methodology or Data Quality? Haughton, Ned Abramowitz, Gab Pitman, Andy, J Or, Dani Best, Martin, J Johnson, Helen, R Balsamo, Gianpaolo Boone, Aaron Cuntz, Matthias Decharme, Bertrand Dirmeyer, Paul, A Dong, Jairui Ek, Michael Guo, Zichang Haverd, Vanessa van den Hurk, Bart, J J Nearing, Grey, S Pak, Bernard Santanello, Joe, A Stevens, Lauren, E Vuichard, Nicolas Department Computational Hydrosystems UFZ Leipzig Helmholtz Zentrum für Umweltforschung = Helmholtz Centre for Environmental Research (UFZ) Laboratoire des Sciences du Climat et de l'Environnement Gif-sur-Yvette (LSCE) Université de Versailles Saint-Quentin-en-Yvelines (UVSQ)-Institut national des sciences de l'Univers (INSU - CNRS)-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Direction de Recherche Fondamentale (CEA) (DRF (CEA)) Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA) Modélisation des Surfaces et Interfaces Continentales (MOSAIC) Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Université de Versailles Saint-Quentin-en-Yvelines (UVSQ)-Institut national des sciences de l'Univers (INSU - CNRS)-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Direction de Recherche Fondamentale (CEA) (DRF (CEA)) Australian Research CouncilCE110001028Joint DECC/Defra Met Office Hadley Centre Climate Programme CA01101United States Department of Energy (DOE)DE-FG02-04ER63917DE-FG02-04ER63911CFCAS Natural Sciences and Engineering Research Council of Canada (NSERC) BIOCAP Environment and Climate Change Canada Natural Resources Canada European Commission FAO-GTOS-TCO iLEAPS Max Planck Institute for Biogeochemistry National Science Foundation (NSF) University of Tuscia Universite Laval United States Department of Energy (DOE) 2016-06-01 https://hal.inrae.fr/hal-02985166 https://hal.inrae.fr/hal-02985166/document https://hal.inrae.fr/hal-02985166/file/G%C3%A4deke_2021_Environ._Res._Lett._16_024049.pdf https://doi.org/10.1175/JHM-D-15-0171.1 en eng HAL CCSD American Meteorological Society info:eu-repo/semantics/altIdentifier/doi/10.1175/JHM-D-15-0171.1 info:eu-repo/semantics/altIdentifier/pmid/29630073 hal-02985166 https://hal.inrae.fr/hal-02985166 https://hal.inrae.fr/hal-02985166/document https://hal.inrae.fr/hal-02985166/file/G%C3%A4deke_2021_Environ._Res._Lett._16_024049.pdf doi:10.1175/JHM-D-15-0171.1 PUBMED: 29630073 WOS: 000379507800002 info:eu-repo/semantics/OpenAccess ISSN: 1525-755X EISSN: 1525-7541 Journal of Hydrometeorology https://hal.inrae.fr/hal-02985166 Journal of Hydrometeorology, 2016, 17 (6), pp.1705-1723. ⟨10.1175/JHM-D-15-0171.1⟩ Atmosphere Coupling Experiment Energy-balance Closure Soil-moisture Climate Project Co2 Impact Glace Phase permafrost climate change land surface models Arctic transport winter roads ice roads Arctic accessibility [SDE]Environmental Sciences [SDV.EE.ECO]Life Sciences [q-bio]/Ecology environment/Ecosystems [SDV.EE]Life Sciences [q-bio]/Ecology environment info:eu-repo/semantics/article Journal articles 2016 ftuniparissaclay https://doi.org/10.1175/JHM-D-15-0171.1 2024-09-06T00:30:30Z International audience The Protocol for the Analysis of Land Surface Models (PALS) Land Surface Model Benchmarking Evaluation Project (PLUMBER) illustrated the value of prescribing a priori performance targets in model intercomparisons. It showed that the performance of turbulent energy flux predictions from different land surface models, at a broad range of flux tower sites using common evaluation metrics, was on average worse than relatively simple empirical models. For sensible heat fluxes, all land surface models were outperformed by a linear regression against downward shortwave radiation. For latent heat flux, all land surface models were outperformed by a regression against downward shortwave radiation, surface air temperature, and relative humidity. These results are explored here in greater detail and possible causes are investigated. It is examined whether particular metrics or sites unduly influence the collated results, whether results change according to timescale aggregation, and whether a lack of energy conservation in flux tower data gives the empirical models an unfair advantage in the intercomparison. It is demonstrated that energy conservation in the observational data is not responsible for these results. It is also shown that the partitioning between sensible and latent heat fluxes in LSMs, rather than the calculation of available energy, is the cause of the original findings. Finally, evidence is presented that suggests that the nature of this partitioning problem is likely shared among all contributing LSMs. While a single candidate explanation for why land surface models perform poorly relative to empirical benchmarks in PLUMBER could not be found, multiple possible explanations are excluded and guidance is provided on where future research should focus. Article in Journal/Newspaper Arctic Climate change Ice permafrost Archives ouvertes de Paris-Saclay Arctic Journal of Hydrometeorology 17 6 1705 1723