Semantic segmentation of glaciological features across multiple remote sensing platforms with the Segment Anything Model (SAM)

• Published in: Journal of Glaciology
• Main Authors: Shankar, Siddharth, Stearns, Leigh A., van der Veen, C. J.
• Format: Article in Journal/Newspaper
• Language: English
• Published: Cambridge University Press (CUP) 2023
• Subjects: Earth-Surface Processes; Journal of Glaciology; Sea ice
• Online Access: http://dx.doi.org/10.1017/jog.2023.95; https://www.cambridge.org/core/services/aop-cambridge-core/content/view/S0022143023000953

Abstract Semantic segmentation is a critical part of observation-driven research in glaciology. Using remote sensing to quantify how features change (e.g. glacier termini, supraglacial lakes, icebergs, crevasses) is particularly important in polar regions, where glaciological features may be spatially small but reflect important shifts in boundary conditions. In this study, we assess the utility of the Segment Anything Model (SAM), released by Meta AI Research, for cryosphere research. SAM is a foundational AI model that generates segmentation masks without additional training data. This is highly beneficial in polar science because pre-existing training data rarely exist. Widely-used conventional deep learning models such as UNet require tens of thousands of training labels to perform effectively. We show that the Segment Anything Model performs well for different features (icebergs, glacier termini, supra-glacial lakes, crevasses), in different environmental settings (open water, mélange, and sea ice), with different sensors (Sentinel-1, Sentinel-2, Planet, timelapse photographs) and different spatial resolutions. Due to the performance, versatility, and cross-platform adaptability of SAM, we conclude that it is a powerful and robust model for cryosphere research.