Assimilation of semi-qualitative observations with a stochastic Ensemble Kalman Filter

The Ensemble Kalman filter assumes the observations to be Gaussian random variables with a pre-specified mean and variance. In practice, observations may also have detection limits, for instance when a gauge has a minimum or maximum value. In such cases most data assimilation schemes discard out-of-...

Full description

Bibliographic Details
Published in:Quarterly Journal of the Royal Meteorological Society
Main Authors: Shah, Abhishek, Gharamti, Mohamad El, Bertino, Laurent
Format: Text
Language:unknown
Published: 2018
Subjects:
Online Access:http://arxiv.org/abs/1804.07648
https://doi.org/10.1002/qj.3381
id ftarxivpreprints:oai:arXiv.org:1804.07648
record_format openpolar
spelling ftarxivpreprints:oai:arXiv.org:1804.07648 2023-09-05T13:23:05+02:00 Assimilation of semi-qualitative observations with a stochastic Ensemble Kalman Filter Shah, Abhishek Gharamti, Mohamad El Bertino, Laurent 2018-04-20 http://arxiv.org/abs/1804.07648 https://doi.org/10.1002/qj.3381 unknown http://arxiv.org/abs/1804.07648 doi:10.1002/qj.3381 Mathematics - Optimization and Control Statistics - Applications Statistics - Methodology text 2018 ftarxivpreprints https://doi.org/10.1002/qj.3381 2023-08-16T14:49:03Z The Ensemble Kalman filter assumes the observations to be Gaussian random variables with a pre-specified mean and variance. In practice, observations may also have detection limits, for instance when a gauge has a minimum or maximum value. In such cases most data assimilation schemes discard out-of-range values, treating them as "not a number", at a loss of possibly useful qualitative information. The current work focuses on the development of a data assimilation scheme that tackles observations with a detection limit. We present the Ensemble Kalman Filter Semi-Qualitative (EnKF-SQ) and test its performance against the Partial Deterministic Ensemble Kalman Filter (PDEnKF) of Borup et al. (2015). Both are designed to explicitly assimilate the out-of-range observations: the out-of-range values are qualitative by nature (inequalities), but one can postulate a probability distribution for them and then update the ensemble members accordingly. The EnKF-SQ is tested within the framework of twin experiments, using both linear and non-linear toy models. Different sensitivity experiments are conducted to assess the influence of the ensemble size, observation detection limit and a number of observations on the performance of the filter. Our numerical results show that assimilating qualitative observations using the proposed scheme improves the overall forecast mean, making it viable for testing on more realistic applications such as sea-ice models. Text Sea ice ArXiv.org (Cornell University Library) Quarterly Journal of the Royal Meteorological Society 144 715 1882 1894
institution Open Polar
collection ArXiv.org (Cornell University Library)
op_collection_id ftarxivpreprints
language unknown
topic Mathematics - Optimization and Control
Statistics - Applications
Statistics - Methodology
spellingShingle Mathematics - Optimization and Control
Statistics - Applications
Statistics - Methodology
Shah, Abhishek
Gharamti, Mohamad El
Bertino, Laurent
Assimilation of semi-qualitative observations with a stochastic Ensemble Kalman Filter
topic_facet Mathematics - Optimization and Control
Statistics - Applications
Statistics - Methodology
description The Ensemble Kalman filter assumes the observations to be Gaussian random variables with a pre-specified mean and variance. In practice, observations may also have detection limits, for instance when a gauge has a minimum or maximum value. In such cases most data assimilation schemes discard out-of-range values, treating them as "not a number", at a loss of possibly useful qualitative information. The current work focuses on the development of a data assimilation scheme that tackles observations with a detection limit. We present the Ensemble Kalman Filter Semi-Qualitative (EnKF-SQ) and test its performance against the Partial Deterministic Ensemble Kalman Filter (PDEnKF) of Borup et al. (2015). Both are designed to explicitly assimilate the out-of-range observations: the out-of-range values are qualitative by nature (inequalities), but one can postulate a probability distribution for them and then update the ensemble members accordingly. The EnKF-SQ is tested within the framework of twin experiments, using both linear and non-linear toy models. Different sensitivity experiments are conducted to assess the influence of the ensemble size, observation detection limit and a number of observations on the performance of the filter. Our numerical results show that assimilating qualitative observations using the proposed scheme improves the overall forecast mean, making it viable for testing on more realistic applications such as sea-ice models.
format Text
author Shah, Abhishek
Gharamti, Mohamad El
Bertino, Laurent
author_facet Shah, Abhishek
Gharamti, Mohamad El
Bertino, Laurent
author_sort Shah, Abhishek
title Assimilation of semi-qualitative observations with a stochastic Ensemble Kalman Filter
title_short Assimilation of semi-qualitative observations with a stochastic Ensemble Kalman Filter
title_full Assimilation of semi-qualitative observations with a stochastic Ensemble Kalman Filter
title_fullStr Assimilation of semi-qualitative observations with a stochastic Ensemble Kalman Filter
title_full_unstemmed Assimilation of semi-qualitative observations with a stochastic Ensemble Kalman Filter
title_sort assimilation of semi-qualitative observations with a stochastic ensemble kalman filter
publishDate 2018
url http://arxiv.org/abs/1804.07648
https://doi.org/10.1002/qj.3381
genre Sea ice
genre_facet Sea ice
op_relation http://arxiv.org/abs/1804.07648
doi:10.1002/qj.3381
op_doi https://doi.org/10.1002/qj.3381
container_title Quarterly Journal of the Royal Meteorological Society
container_volume 144
container_issue 715
container_start_page 1882
op_container_end_page 1894
_version_ 1776203667645399040