Robust Re-identification of Manta Rays from Natural Markings by Learning Pose Invariant Embeddings

• Published in: 2021 Digital Image Computing: Techniques and Applications (DICTA)
• Main Authors: Moskvyak, Olga, Maire, Frederic, Dayoub, Feras, Armstrong, Asia O., Baktashmotlagh, Mahsa
• Other Authors: Zhou, Jun, Salvado, Olivier, Sohel, Ferdous, Borges, Paulo Vinicius K., Wang, Shilin
• Format: Book Part
• Language: unknown
• Published: Institute of Electrical and Electronics Engineers Inc. 2021
• Subjects: Humpback Whale
• Online Access: https://eprints.qut.edu.au/232369/

Visual re-identification of individual animals that bear unique natural body markings is an essential task in wildlife conservation. The photo databases of animal markings grow with each new observation and identifying an individual means matching against thousands of images. We focus on the re-identification of manta rays because the existing process is time-consuming and only semi-automatic. The current solution Manta Matcher requires images of high quality with the pattern of interest in a near frontal view limiting the use of photos sourced from citizen scientists. This paper presents a novel application of a deep convolutional neural network (CNN) for visual re-identification based on natural markings. Our contribution is an experimental demonstration of the superiority of CNNs in learning embeddings for patterns under viewpoint changes on a novel and challenging dataset. We show that our system can handle more variations in viewing angle, occlusions and illumination compared to the current solution. Our system achieves top-10 accuracy of 98% with only 2 matching examples in the database which makes it of practical value and ready for adoption by marine biologists. We also evaluate our system on a dataset of humpback whale flukes to demonstrate that the approach is generic and not species-specific.