Interactive snow avalanche segmentation from webcam imagery: results, potential, and limitations

• Main Authors: Hafner, Elisabeth D, Kontogianni, Theodora, Caye Daudt, Rodrigo, Oberson, Lucien, Wegner, Jan Dirk, Schindler, Konrad, Bühler, Yves
• Format: Article in Journal/Newspaper
• Language: English
• Published: Copernicus Publications 2024
• Subjects: Digital Society Initiative; Department of Mathematical Modeling and Machine Learning; 510 Mathematics; The Cryosphere
• Online Access: https://www.zora.uzh.ch/id/eprint/266321/; https://www.zora.uzh.ch/id/eprint/266321/1/2024Wegner_InteractiveSnow.pdf

Abstract: For many safety-related applications such as hazard mapping or road management, well-documented avalanche events are crucial. Nowadays, despite the variety of research directions, the available data are mostly restricted to isolated locations where they are collected by observers in the field. Webcams are becoming more frequent in the Alps and beyond, capturing numerous avalanche-prone slopes. To complement the knowledge about avalanche occurrences, we propose making use of this webcam imagery for avalanche mapping. For humans, avalanches are relatively easy to identify, but the manual mapping of their outlines is time intensive. Therefore, we propose supporting the mapping of avalanches in images with a learned segmentation model. In interactive avalanche segmentation (IAS), a user collaborates with a deep-learning model to segment the avalanche outlines, taking advantage of human expert knowledge while keeping the effort low thanks to the model's ability to delineate avalanches. The human corrections to the segmentation in the form of positive clicks on the avalanche or negative clicks on the background result in avalanche outlines of good quality with little effort. Relying on IAS, we extract avalanches from the images in a flexible and efficient manner, resulting in a 90 % time saving compared to conventional manual mapping. The images can be georeferenced with a mono-photogrammetry tool, allowing for exact geolocation of the avalanche outlines and subsequent use in geographical information systems (GISs). If a webcam is mounted in a stable position, the georeferencing can be re-used for all subsequent images. In this way, all avalanches mapped in images from a webcam can be imported into a designated database, making them available for the relevant safety-related applications. For imagery, we rely on current data and data archived from webcams that cover Dischma Valley near Davos, Switzerland, and that have captured an image every 30 min during the daytime since the winter of 2019. Our model and ...