Siamese Network Based Pelage Pattern Matching for Ringed Seal Re-identification

In this paper we propose a method to match pelage patterns of the Saimaa ringed seals enabling the re-identification of individuals. First, the pelage pattern is extracted from the seal's fur using a method based on the Sato tubeness filter. After this, the similarities of the pelage pattern pa...

Full description

Bibliographic Details
Published in:2020 IEEE Winter Applications of Computer Vision Workshops (WACVW)
Main Authors: Nepovinnykh, Ekaterina, Eerola, Tuomas, Kälviäinen, Heikki
Other Authors: Lappeenrannan-Lahden teknillinen yliopisto LUT, Lappeenranta-Lahti University of Technology LUT, fi=School of Engineering Science|en=School of Engineering Science|
Format: Conference Object
Language:English
Published: IEEE 2020
Subjects:
Online Access:https://lutpub.lut.fi/handle/10024/161893
Description
Summary:In this paper we propose a method to match pelage patterns of the Saimaa ringed seals enabling the re-identification of individuals. First, the pelage pattern is extracted from the seal's fur using a method based on the Sato tubeness filter. After this, the similarities of the pelage pattern patches are computed using a siamese network trained with a triplet loss function and a large dataset of manually selected patches. The similarities are then used to find the best matching patches from the images in the database of known individuals. Furthermore, we employ the proposed pattern matching method to build a full framework for the ringed seal re-identification, consisting of CNN-based animal segmentation, patch correspondence detection, and ranking the images in the database of known seal individuals based on the similarity to the query image. Our experiments on challenging datasets of Saimaa ringed seals show that the proposed method achieves promising identification results, providing a useful tool for the Saimaa ringed seal monitoring. Post-print / Final draft