PixelDINO: Semi-Supervised Semantic Segmentation for Detecting Permafrost Disturbances
Arctic Permafrost is facing significant changes due to global climate change. As these regions are largely inaccessible, remote sensing plays a crucial rule in better understanding the underlying processes not just on a local scale, but across the Arctic. In this study, we focus on the remote detect...
Main Authors: | , , , |
---|---|
Format: | Text |
Language: | unknown |
Published: |
2024
|
Subjects: | |
Online Access: | http://arxiv.org/abs/2401.09271 |
id |
ftarxivpreprints:oai:arXiv.org:2401.09271 |
---|---|
record_format |
openpolar |
spelling |
ftarxivpreprints:oai:arXiv.org:2401.09271 2024-02-11T10:00:45+01:00 PixelDINO: Semi-Supervised Semantic Segmentation for Detecting Permafrost Disturbances Heidler, Konrad Nitze, Ingmar Grosse, Guido Zhu, Xiao Xiang 2024-01-17 http://arxiv.org/abs/2401.09271 unknown http://arxiv.org/abs/2401.09271 Computer Science - Computer Vision and Pattern Recognition text 2024 ftarxivpreprints 2024-01-21T02:07:40Z Arctic Permafrost is facing significant changes due to global climate change. As these regions are largely inaccessible, remote sensing plays a crucial rule in better understanding the underlying processes not just on a local scale, but across the Arctic. In this study, we focus on the remote detection of retrogressive thaw slumps (RTS), a permafrost disturbance comparable to landslides induced by thawing. For such analyses from space, deep learning has become an indispensable tool, but limited labelled training data remains a challenge for training accurate models. To improve model generalization across the Arctic without the need for additional labelled data, we present a semi-supervised learning approach to train semantic segmentation models to detect RTS. Our framework called PixelDINO is trained in parallel on labelled data as well as unlabelled data. For the unlabelled data, the model segments the imagery into self-taught pseudo-classes and the training procedure ensures consistency of these pseudo-classes across strong augmentations of the input data. Our experimental results demonstrate that PixelDINO can improve model performance both over supervised baseline methods as well as existing semi-supervised semantic segmentation approaches, highlighting its potential for training robust models that generalize well to regions that were not included in the training data. The project page containing code and other materials for this study can be found at \url{https://khdlr.github.io/PixelDINO/}. Text Arctic Climate change permafrost ArXiv.org (Cornell University Library) Arctic |
institution |
Open Polar |
collection |
ArXiv.org (Cornell University Library) |
op_collection_id |
ftarxivpreprints |
language |
unknown |
topic |
Computer Science - Computer Vision and Pattern Recognition |
spellingShingle |
Computer Science - Computer Vision and Pattern Recognition Heidler, Konrad Nitze, Ingmar Grosse, Guido Zhu, Xiao Xiang PixelDINO: Semi-Supervised Semantic Segmentation for Detecting Permafrost Disturbances |
topic_facet |
Computer Science - Computer Vision and Pattern Recognition |
description |
Arctic Permafrost is facing significant changes due to global climate change. As these regions are largely inaccessible, remote sensing plays a crucial rule in better understanding the underlying processes not just on a local scale, but across the Arctic. In this study, we focus on the remote detection of retrogressive thaw slumps (RTS), a permafrost disturbance comparable to landslides induced by thawing. For such analyses from space, deep learning has become an indispensable tool, but limited labelled training data remains a challenge for training accurate models. To improve model generalization across the Arctic without the need for additional labelled data, we present a semi-supervised learning approach to train semantic segmentation models to detect RTS. Our framework called PixelDINO is trained in parallel on labelled data as well as unlabelled data. For the unlabelled data, the model segments the imagery into self-taught pseudo-classes and the training procedure ensures consistency of these pseudo-classes across strong augmentations of the input data. Our experimental results demonstrate that PixelDINO can improve model performance both over supervised baseline methods as well as existing semi-supervised semantic segmentation approaches, highlighting its potential for training robust models that generalize well to regions that were not included in the training data. The project page containing code and other materials for this study can be found at \url{https://khdlr.github.io/PixelDINO/}. |
format |
Text |
author |
Heidler, Konrad Nitze, Ingmar Grosse, Guido Zhu, Xiao Xiang |
author_facet |
Heidler, Konrad Nitze, Ingmar Grosse, Guido Zhu, Xiao Xiang |
author_sort |
Heidler, Konrad |
title |
PixelDINO: Semi-Supervised Semantic Segmentation for Detecting Permafrost Disturbances |
title_short |
PixelDINO: Semi-Supervised Semantic Segmentation for Detecting Permafrost Disturbances |
title_full |
PixelDINO: Semi-Supervised Semantic Segmentation for Detecting Permafrost Disturbances |
title_fullStr |
PixelDINO: Semi-Supervised Semantic Segmentation for Detecting Permafrost Disturbances |
title_full_unstemmed |
PixelDINO: Semi-Supervised Semantic Segmentation for Detecting Permafrost Disturbances |
title_sort |
pixeldino: semi-supervised semantic segmentation for detecting permafrost disturbances |
publishDate |
2024 |
url |
http://arxiv.org/abs/2401.09271 |
geographic |
Arctic |
geographic_facet |
Arctic |
genre |
Arctic Climate change permafrost |
genre_facet |
Arctic Climate change permafrost |
op_relation |
http://arxiv.org/abs/2401.09271 |
_version_ |
1790596456610004992 |