Can a computer see what an ice expert sees? Multilabel ice objects classification with convolutional neural networks

Computer-aided scene analysis has drawn much attention, especially in autonomous navigation and advanced navigation assistance systems for surface vessels. In ice-infested waters, multilabel ice object classification and segmentation form the core of these systems, which are required for path-planni...

Full description

Bibliographic Details
Published in:Results in Engineering
Main Authors: Kim, Ekaterina, Dahiya, Gurvinder, Løset, Sveinung, Skjetne, Roger
Format: Article in Journal/Newspaper
Language:English
Published: Elsevier 2019
Subjects:
Online Access:http://hdl.handle.net/11250/2640680
https://doi.org/10.1016/j.rineng.2019.100036
Description
Summary:Computer-aided scene analysis has drawn much attention, especially in autonomous navigation and advanced navigation assistance systems for surface vessels. In ice-infested waters, multilabel ice object classification and segmentation form the core of these systems, which are required for path-planning and collision avoidance algorithms. This study focuses on the interpretation of ice conditions from close-range optical imagery. It presents a model for multilabel ice object classification that builds on state-of-the-art open source libraries and deep learning platforms. This work explores the generalization ability of open source models to differentiate between nine categories of surface ice features: level ice, deformed ice, broken ice, icebergs, floebergs, floebits, ice floes, pancake ice, and brash ice. The results demonstrate the ability of the models to classify these nine categories from optical close-range images, which were gathered online and during a research cruise to the Fram Strait on the R/V Lance in 2012. We tested a variety of classification algorithms on the collected ice imagery and compared the results against randomly selected test cases representing different ice features with different degrees of local texture distortion. In doing so, we can evaluate the effectiveness of the classification of different classes and compare different levels of information presented for the classification. In addition, we provide a model implementation: a GitHub repository, ICEXPERT, that is suitable for ice object classification from close-range ice imagery. publishedVersion This article is available under the Creative Commons CC-BY-NC-ND license and permits non-commercial use of the work as published, without adaptation or alteration provided the work is fully attributed.