Multi-Center Agent Loss for Visual Identification of Chinese Simmental in the Wild

• Published in: Animals
• Main Authors: Jianmin Zhao, Qiusheng Lian, Neal N. Xiong
• Format: Article in Journal/Newspaper
• Language: English
• Published: MDPI AG 2022
• Subjects: cattle identification; deep convolutional neural networks (DCNNs); deep metric learning (DML); open-set recognition; precision livestock farming; Veterinary medicine; SF600-1100; Zoology; QL1-991; DML
• Online Access: https://doi.org/10.3390/ani12040459; https://doaj.org/article/3f70697c7f69413f9902acfb465092ef

Visual identification of cattle in the wild provides an essential way for real-time cattle monitoring applicable to precision livestock farming. Chinese Simmental exhibit a yellow or brown coat with individually characteristic white stripes or spots, which makes a biometric identifier for identification possible. This work employed the observable biometric characteristics to perform cattle identification with an image from any viewpoint. We propose multi-center agent loss to jointly supervise the learning of DCNNs by SoftMax with multiple centers and the agent triplet. We reformulated SoftMax with multiple centers to reduce intra-class variance by offering more centers for feature clustering. Then, we utilized the agent triplet, which consisted of the features and the agents, to enforce separation among different classes. As there are no datasets for the identification of cattle with multi-view images, we created CNSID100, consisting of 11,635 images from 100 Chinese Simmental identities. Our proposed loss was comprehensively compared with several well-known losses on CNSID100 and OpenCows2020 and analyzed in an engineering application in the farming environment. It was encouraging to find that our approach outperformed the state-of-the-art models on the datasets above. The engineering application demonstrated that our pipeline with detection and recognition is promising for continuous cattle identification in real livestock farming scenarios.