Evaluation of Visible Infrared Imaging Radiometer Suite (VIIRS) neural network cloud detection against current operational cloud masks

Cloud properties are critical to our understanding of weather and climate variability, but their estimation from satellite imagers is a nontrivial task. In this work, we aim to improve cloud detection, which is the most fundamental cloud property. We use a neural network applied to Visible Infrared...

Full description

Bibliographic Details
Published in:Atmospheric Measurement Techniques
Main Authors: C. H. White, A. K. Heidinger, S. A. Ackerman
Format: Article in Journal/Newspaper
Language:English
Published: Copernicus Publications 2021
Subjects:
Online Access:https://doi.org/10.5194/amt-14-3371-2021
https://doaj.org/article/e903e6fba30244a3802fe0228bb9573e
id ftdoajarticles:oai:doaj.org/article:e903e6fba30244a3802fe0228bb9573e
record_format openpolar
spelling ftdoajarticles:oai:doaj.org/article:e903e6fba30244a3802fe0228bb9573e 2023-05-15T16:30:03+02:00 Evaluation of Visible Infrared Imaging Radiometer Suite (VIIRS) neural network cloud detection against current operational cloud masks C. H. White A. K. Heidinger S. A. Ackerman 2021-05-01T00:00:00Z https://doi.org/10.5194/amt-14-3371-2021 https://doaj.org/article/e903e6fba30244a3802fe0228bb9573e EN eng Copernicus Publications https://amt.copernicus.org/articles/14/3371/2021/amt-14-3371-2021.pdf https://doaj.org/toc/1867-1381 https://doaj.org/toc/1867-8548 doi:10.5194/amt-14-3371-2021 1867-1381 1867-8548 https://doaj.org/article/e903e6fba30244a3802fe0228bb9573e Atmospheric Measurement Techniques, Vol 14, Pp 3371-3394 (2021) Environmental engineering TA170-171 Earthwork. Foundations TA715-787 article 2021 ftdoajarticles https://doi.org/10.5194/amt-14-3371-2021 2022-12-31T16:37:15Z Cloud properties are critical to our understanding of weather and climate variability, but their estimation from satellite imagers is a nontrivial task. In this work, we aim to improve cloud detection, which is the most fundamental cloud property. We use a neural network applied to Visible Infrared Imaging Radiometer Suite (VIIRS) measurements to determine whether an imager pixel is cloudy or cloud-free. The neural network is trained and evaluated using 4 years (2016–2019) of coincident measurements between VIIRS and the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP). We successfully address the lack of sun glint in the collocation dataset with a simple semi-supervised learning approach. The results of the neural network are then compared with two operational cloud masks: the Continuity MODIS-VIIRS Cloud Mask (MVCM) and the NOAA Enterprise Cloud Mask (ECM). We find that the neural network outperforms both operational cloud masks in most conditions examined with a few exceptions. The largest improvements we observe occur during the night over snow- or ice-covered surfaces in the high latitudes. In our analysis, we show that this improvement is not solely due to differences in optical-depth-based definitions of a cloud between each mask. We also analyze the differences in true-positive rate between day–night and land–water scenes as a function of optical depth. Such differences are a contributor to spatial artifacts in cloud masking, and we find that the neural network is the most consistent in cloud detection with respect to optical depth across these conditions. A regional analysis over Greenland illustrates the impact of such differences and shows that they can result in mean cloud fractions with very different spatial and temporal characteristics. Article in Journal/Newspaper Greenland Directory of Open Access Journals: DOAJ Articles Greenland Atmospheric Measurement Techniques 14 5 3371 3394
institution Open Polar
collection Directory of Open Access Journals: DOAJ Articles
op_collection_id ftdoajarticles
language English
topic Environmental engineering
TA170-171
Earthwork. Foundations
TA715-787
spellingShingle Environmental engineering
TA170-171
Earthwork. Foundations
TA715-787
C. H. White
A. K. Heidinger
S. A. Ackerman
Evaluation of Visible Infrared Imaging Radiometer Suite (VIIRS) neural network cloud detection against current operational cloud masks
topic_facet Environmental engineering
TA170-171
Earthwork. Foundations
TA715-787
description Cloud properties are critical to our understanding of weather and climate variability, but their estimation from satellite imagers is a nontrivial task. In this work, we aim to improve cloud detection, which is the most fundamental cloud property. We use a neural network applied to Visible Infrared Imaging Radiometer Suite (VIIRS) measurements to determine whether an imager pixel is cloudy or cloud-free. The neural network is trained and evaluated using 4 years (2016–2019) of coincident measurements between VIIRS and the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP). We successfully address the lack of sun glint in the collocation dataset with a simple semi-supervised learning approach. The results of the neural network are then compared with two operational cloud masks: the Continuity MODIS-VIIRS Cloud Mask (MVCM) and the NOAA Enterprise Cloud Mask (ECM). We find that the neural network outperforms both operational cloud masks in most conditions examined with a few exceptions. The largest improvements we observe occur during the night over snow- or ice-covered surfaces in the high latitudes. In our analysis, we show that this improvement is not solely due to differences in optical-depth-based definitions of a cloud between each mask. We also analyze the differences in true-positive rate between day–night and land–water scenes as a function of optical depth. Such differences are a contributor to spatial artifacts in cloud masking, and we find that the neural network is the most consistent in cloud detection with respect to optical depth across these conditions. A regional analysis over Greenland illustrates the impact of such differences and shows that they can result in mean cloud fractions with very different spatial and temporal characteristics.
format Article in Journal/Newspaper
author C. H. White
A. K. Heidinger
S. A. Ackerman
author_facet C. H. White
A. K. Heidinger
S. A. Ackerman
author_sort C. H. White
title Evaluation of Visible Infrared Imaging Radiometer Suite (VIIRS) neural network cloud detection against current operational cloud masks
title_short Evaluation of Visible Infrared Imaging Radiometer Suite (VIIRS) neural network cloud detection against current operational cloud masks
title_full Evaluation of Visible Infrared Imaging Radiometer Suite (VIIRS) neural network cloud detection against current operational cloud masks
title_fullStr Evaluation of Visible Infrared Imaging Radiometer Suite (VIIRS) neural network cloud detection against current operational cloud masks
title_full_unstemmed Evaluation of Visible Infrared Imaging Radiometer Suite (VIIRS) neural network cloud detection against current operational cloud masks
title_sort evaluation of visible infrared imaging radiometer suite (viirs) neural network cloud detection against current operational cloud masks
publisher Copernicus Publications
publishDate 2021
url https://doi.org/10.5194/amt-14-3371-2021
https://doaj.org/article/e903e6fba30244a3802fe0228bb9573e
geographic Greenland
geographic_facet Greenland
genre Greenland
genre_facet Greenland
op_source Atmospheric Measurement Techniques, Vol 14, Pp 3371-3394 (2021)
op_relation https://amt.copernicus.org/articles/14/3371/2021/amt-14-3371-2021.pdf
https://doaj.org/toc/1867-1381
https://doaj.org/toc/1867-8548
doi:10.5194/amt-14-3371-2021
1867-1381
1867-8548
https://doaj.org/article/e903e6fba30244a3802fe0228bb9573e
op_doi https://doi.org/10.5194/amt-14-3371-2021
container_title Atmospheric Measurement Techniques
container_volume 14
container_issue 5
container_start_page 3371
op_container_end_page 3394
_version_ 1766019768059428864