A Bayesian framework for verification and recalibration of ensemble forecasts: How uncertain is NAO predictability?
Predictability estimates of ensemble prediction systems are uncertain due to limited numbers of past forecasts and observations. To account for such uncertainty, this paper proposes a Bayesian inferential framework that provides a simple 6-parameter representation of ensemble forecasting systems and...
Published in: | Journal of Climate |
---|---|
Main Authors: | , , , , , |
Format: | Text |
Language: | unknown |
Published: |
2015
|
Subjects: | |
Online Access: | http://arxiv.org/abs/1504.01933 https://doi.org/10.1175/JCLI-D-15-0196.1 |
id |
ftarxivpreprints:oai:arXiv.org:1504.01933 |
---|---|
record_format |
openpolar |
spelling |
ftarxivpreprints:oai:arXiv.org:1504.01933 2023-09-05T13:21:35+02:00 A Bayesian framework for verification and recalibration of ensemble forecasts: How uncertain is NAO predictability? Siegert, Stefan Stephenson, David B. Sansom, Philip G. Scaife, Adam A. Eade, Rosie Arribas, Alberto 2015-04-08 http://arxiv.org/abs/1504.01933 https://doi.org/10.1175/JCLI-D-15-0196.1 unknown http://arxiv.org/abs/1504.01933 doi:10.1175/JCLI-D-15-0196.1 Statistics - Applications text 2015 ftarxivpreprints https://doi.org/10.1175/JCLI-D-15-0196.1 2023-08-16T13:37:07Z Predictability estimates of ensemble prediction systems are uncertain due to limited numbers of past forecasts and observations. To account for such uncertainty, this paper proposes a Bayesian inferential framework that provides a simple 6-parameter representation of ensemble forecasting systems and the corresponding observations. The framework is probabilistic, and thus allows for quantifying uncertainty in predictability measures such as correlation skill and signal-to-noise ratios. It also provides a natural way to produce recalibrated probabilistic predictions from uncalibrated ensembles forecasts. The framework is used to address important questions concerning the skill of winter hindcasts of the North Atlantic Oscillation for 1992-2011 issued by the Met Office GloSea5 climate prediction system. Although there is much uncertainty in the correlation between ensemble mean and observations, there is strong evidence of skill: the 95% credible interval of the correlation coefficient of [0.19,0.68] does not overlap zero. There is also strong evidence that the forecasts are not exchangeable with the observations: With over 99% certainty, the signal-to-noise ratio of the forecasts is smaller than the signal-to-noise ratio of the observations, which suggests that raw forecasts should not be taken as representative scenarios of the observations. Forecast recalibration is thus required, which can be coherently addressed within the proposed framework. Comment: 36 pages, 10 figures Text North Atlantic North Atlantic oscillation ArXiv.org (Cornell University Library) Journal of Climate 29 3 995 1012 |
institution |
Open Polar |
collection |
ArXiv.org (Cornell University Library) |
op_collection_id |
ftarxivpreprints |
language |
unknown |
topic |
Statistics - Applications |
spellingShingle |
Statistics - Applications Siegert, Stefan Stephenson, David B. Sansom, Philip G. Scaife, Adam A. Eade, Rosie Arribas, Alberto A Bayesian framework for verification and recalibration of ensemble forecasts: How uncertain is NAO predictability? |
topic_facet |
Statistics - Applications |
description |
Predictability estimates of ensemble prediction systems are uncertain due to limited numbers of past forecasts and observations. To account for such uncertainty, this paper proposes a Bayesian inferential framework that provides a simple 6-parameter representation of ensemble forecasting systems and the corresponding observations. The framework is probabilistic, and thus allows for quantifying uncertainty in predictability measures such as correlation skill and signal-to-noise ratios. It also provides a natural way to produce recalibrated probabilistic predictions from uncalibrated ensembles forecasts. The framework is used to address important questions concerning the skill of winter hindcasts of the North Atlantic Oscillation for 1992-2011 issued by the Met Office GloSea5 climate prediction system. Although there is much uncertainty in the correlation between ensemble mean and observations, there is strong evidence of skill: the 95% credible interval of the correlation coefficient of [0.19,0.68] does not overlap zero. There is also strong evidence that the forecasts are not exchangeable with the observations: With over 99% certainty, the signal-to-noise ratio of the forecasts is smaller than the signal-to-noise ratio of the observations, which suggests that raw forecasts should not be taken as representative scenarios of the observations. Forecast recalibration is thus required, which can be coherently addressed within the proposed framework. Comment: 36 pages, 10 figures |
format |
Text |
author |
Siegert, Stefan Stephenson, David B. Sansom, Philip G. Scaife, Adam A. Eade, Rosie Arribas, Alberto |
author_facet |
Siegert, Stefan Stephenson, David B. Sansom, Philip G. Scaife, Adam A. Eade, Rosie Arribas, Alberto |
author_sort |
Siegert, Stefan |
title |
A Bayesian framework for verification and recalibration of ensemble forecasts: How uncertain is NAO predictability? |
title_short |
A Bayesian framework for verification and recalibration of ensemble forecasts: How uncertain is NAO predictability? |
title_full |
A Bayesian framework for verification and recalibration of ensemble forecasts: How uncertain is NAO predictability? |
title_fullStr |
A Bayesian framework for verification and recalibration of ensemble forecasts: How uncertain is NAO predictability? |
title_full_unstemmed |
A Bayesian framework for verification and recalibration of ensemble forecasts: How uncertain is NAO predictability? |
title_sort |
bayesian framework for verification and recalibration of ensemble forecasts: how uncertain is nao predictability? |
publishDate |
2015 |
url |
http://arxiv.org/abs/1504.01933 https://doi.org/10.1175/JCLI-D-15-0196.1 |
genre |
North Atlantic North Atlantic oscillation |
genre_facet |
North Atlantic North Atlantic oscillation |
op_relation |
http://arxiv.org/abs/1504.01933 doi:10.1175/JCLI-D-15-0196.1 |
op_doi |
https://doi.org/10.1175/JCLI-D-15-0196.1 |
container_title |
Journal of Climate |
container_volume |
29 |
container_issue |
3 |
container_start_page |
995 |
op_container_end_page |
1012 |
_version_ |
1776202178128510976 |