Enhancing sea ice segmentation in Sentinel-1 images with atrous convolutions
Due to the growing volume of remote sensing data and the low latency required for safe marine navigation, machine learning (ML) algorithms are being developed to accelerate sea ice chart generation, currently a manual interpretation task. However, the low signal-to-noise ratio of the freely availabl...
Published in: | International Journal of Remote Sensing |
---|---|
Main Authors: | , , , , , |
Format: | Text |
Language: | unknown |
Published: |
2023
|
Subjects: | |
Online Access: | http://arxiv.org/abs/2310.17122 https://doi.org/10.1080/01431161.2023.2248560 |
id |
ftarxivpreprints:oai:arXiv.org:2310.17122 |
---|---|
record_format |
openpolar |
spelling |
ftarxivpreprints:oai:arXiv.org:2310.17122 2023-11-12T04:25:57+01:00 Enhancing sea ice segmentation in Sentinel-1 images with atrous convolutions de Lima, Rafael Pires Vahedi, Behzad Hughes, Nick Barrett, Andrew P. Meier, Walter Karimzadeh, Morteza 2023-10-25 http://arxiv.org/abs/2310.17122 https://doi.org/10.1080/01431161.2023.2248560 unknown http://arxiv.org/abs/2310.17122 International Journal of Remote Sensing 4:17, 5344-5374 (20230 doi:10.1080/01431161.2023.2248560 Electrical Engineering and Systems Science - Image and Video Processing Computer Science - Computer Vision and Pattern Recognition text 2023 ftarxivpreprints https://doi.org/10.1080/01431161.2023.2248560 2023-10-29T01:07:52Z Due to the growing volume of remote sensing data and the low latency required for safe marine navigation, machine learning (ML) algorithms are being developed to accelerate sea ice chart generation, currently a manual interpretation task. However, the low signal-to-noise ratio of the freely available Sentinel-1 Synthetic Aperture Radar (SAR) imagery, the ambiguity of backscatter signals for ice types, and the scarcity of open-source high-resolution labelled data makes automating sea ice mapping challenging. We use Extreme Earth version 2, a high-resolution benchmark dataset generated for ML training and evaluation, to investigate the effectiveness of ML for automated sea ice mapping. Our customized pipeline combines ResNets and Atrous Spatial Pyramid Pooling for SAR image segmentation. We investigate the performance of our model for: i) binary classification of sea ice and open water in a segmentation framework; and ii) a multiclass segmentation of five sea ice types. For binary ice-water classification, models trained with our largest training set have weighted F1 scores all greater than 0.95 for January and July test scenes. Specifically, the median weighted F1 score was 0.98, indicating high performance for both months. By comparison, a competitive baseline U-Net has a weighted average F1 score of ranging from 0.92 to 0.94 (median 0.93) for July, and 0.97 to 0.98 (median 0.97) for January. Multiclass ice type classification is more challenging, and even though our models achieve 2% improvement in weighted F1 average compared to the baseline U-Net, test weighted F1 is generally between 0.6 and 0.80. Our approach can efficiently segment full SAR scenes in one run, is faster than the baseline U-Net, retains spatial resolution and dimension, and is more robust against noise compared to approaches that rely on patch classification. Text Sea ice ArXiv.org (Cornell University Library) International Journal of Remote Sensing 44 17 5344 5374 |
institution |
Open Polar |
collection |
ArXiv.org (Cornell University Library) |
op_collection_id |
ftarxivpreprints |
language |
unknown |
topic |
Electrical Engineering and Systems Science - Image and Video Processing Computer Science - Computer Vision and Pattern Recognition |
spellingShingle |
Electrical Engineering and Systems Science - Image and Video Processing Computer Science - Computer Vision and Pattern Recognition de Lima, Rafael Pires Vahedi, Behzad Hughes, Nick Barrett, Andrew P. Meier, Walter Karimzadeh, Morteza Enhancing sea ice segmentation in Sentinel-1 images with atrous convolutions |
topic_facet |
Electrical Engineering and Systems Science - Image and Video Processing Computer Science - Computer Vision and Pattern Recognition |
description |
Due to the growing volume of remote sensing data and the low latency required for safe marine navigation, machine learning (ML) algorithms are being developed to accelerate sea ice chart generation, currently a manual interpretation task. However, the low signal-to-noise ratio of the freely available Sentinel-1 Synthetic Aperture Radar (SAR) imagery, the ambiguity of backscatter signals for ice types, and the scarcity of open-source high-resolution labelled data makes automating sea ice mapping challenging. We use Extreme Earth version 2, a high-resolution benchmark dataset generated for ML training and evaluation, to investigate the effectiveness of ML for automated sea ice mapping. Our customized pipeline combines ResNets and Atrous Spatial Pyramid Pooling for SAR image segmentation. We investigate the performance of our model for: i) binary classification of sea ice and open water in a segmentation framework; and ii) a multiclass segmentation of five sea ice types. For binary ice-water classification, models trained with our largest training set have weighted F1 scores all greater than 0.95 for January and July test scenes. Specifically, the median weighted F1 score was 0.98, indicating high performance for both months. By comparison, a competitive baseline U-Net has a weighted average F1 score of ranging from 0.92 to 0.94 (median 0.93) for July, and 0.97 to 0.98 (median 0.97) for January. Multiclass ice type classification is more challenging, and even though our models achieve 2% improvement in weighted F1 average compared to the baseline U-Net, test weighted F1 is generally between 0.6 and 0.80. Our approach can efficiently segment full SAR scenes in one run, is faster than the baseline U-Net, retains spatial resolution and dimension, and is more robust against noise compared to approaches that rely on patch classification. |
format |
Text |
author |
de Lima, Rafael Pires Vahedi, Behzad Hughes, Nick Barrett, Andrew P. Meier, Walter Karimzadeh, Morteza |
author_facet |
de Lima, Rafael Pires Vahedi, Behzad Hughes, Nick Barrett, Andrew P. Meier, Walter Karimzadeh, Morteza |
author_sort |
de Lima, Rafael Pires |
title |
Enhancing sea ice segmentation in Sentinel-1 images with atrous convolutions |
title_short |
Enhancing sea ice segmentation in Sentinel-1 images with atrous convolutions |
title_full |
Enhancing sea ice segmentation in Sentinel-1 images with atrous convolutions |
title_fullStr |
Enhancing sea ice segmentation in Sentinel-1 images with atrous convolutions |
title_full_unstemmed |
Enhancing sea ice segmentation in Sentinel-1 images with atrous convolutions |
title_sort |
enhancing sea ice segmentation in sentinel-1 images with atrous convolutions |
publishDate |
2023 |
url |
http://arxiv.org/abs/2310.17122 https://doi.org/10.1080/01431161.2023.2248560 |
genre |
Sea ice |
genre_facet |
Sea ice |
op_relation |
http://arxiv.org/abs/2310.17122 International Journal of Remote Sensing 4:17, 5344-5374 (20230 doi:10.1080/01431161.2023.2248560 |
op_doi |
https://doi.org/10.1080/01431161.2023.2248560 |
container_title |
International Journal of Remote Sensing |
container_volume |
44 |
container_issue |
17 |
container_start_page |
5344 |
op_container_end_page |
5374 |
_version_ |
1782340103244349440 |