Matching individual Ladoga ringed seals across short-term image sequences

• Published in: Mammalian Biology
• Main Authors: Nepovinnykh, Ekaterina, Chelak, Ilia, Lushpanov, Andrei, Eerola, Tuomas, Kälviäinen, Heikki, Chirkova, Olga
• Other Authors: Lappeenrannan-Lahden teknillinen yliopisto LUT, Lappeenranta-Lahti University of Technology LUT, fi=School of Engineering Science|en=School of Engineering Science|
• Format: Article in Journal/Newspaper
• Language: English
• Published: Springer Nature 2022
• Subjects: Ladoga ringed seal; animal re-identification; photo-identification; instance segmentation; convolutional neural networks; Pusa hispida; ringed seal
• Online Access: https://lutpub.lut.fi/handle/10024/164700

Automated wildlife reidentification has attracted increasing attention in recent years as it provides a non-invasive tool to identify and to track individual wild animals over time. In this paper, the first steps are taken towards the automatic photo-identification of the Ladoga ringed seals (Pusa hispida ladogensis). A method is proposed that takes a sequence of images, each containing multiple individuals as the input, and produces cropped images of seals grouped based on one certain individual per group. The method starts by detecting each seal from the images and proceeds to matching the individual seals between the images. It is shown that high grouping accuracy can be obtained with a general-purpose image retrieval method on an image sequence taken from the same location within a relatively short period of time. Each resulting group contains multiple images of one individual with slightly different variations, for example, in pose and illumination. Utilizing these images simultaneously provides more information for the individual re-identification compared to the traditional approach, i.e., which utilizes just one image at a time. It is further demonstrated that a convolutional neural network based method can be used to extract the unique pelage patterns of the seals despite the low contrast. Finally, a method is proposed and experiments with the novel Ladoga ringed seals data are carried out to provide a proof-of-concept for the individual re-identification. Publishers version