A Unified Multiple Proxy Deep Metric Learning Framework Embedded With Distribution Optimization for Fine-Grained Ship Classification in Remote Sensing Images

• Published in: IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
• Main Authors: Jianwen Xu, Haitao Lang
• Format: Article in Journal/Newspaper
• Language: English
• Published: IEEE 2024
• Subjects: Deep metric learning (DML); deep neural networks (DNN); fine-grained ship classification; optical remote sensing (ORS); synthetic aperture radar (SAR); Ocean engineering; TC1501-1800; Geophysics. Cosmic physics; QC801-809; DML
• Online Access: https://doi.org/10.1109/JSTARS.2024.3365472; https://doaj.org/article/4ad0abaa39bb461a81e48b06362bee18

Improving ship classification performance in remote sensing imagery by deep metric learning (DML) is a newly emerging research topic and has good application prospects. From the perspective of the use of metric loss (classification loss and pairwise loss) and the way of proxy learning (a single proxy or multiple proxies), this study summarizes the existing DML methods into four representative frameworks and proposes a novel framework, namely, a u nified m ultiple p roxy deep metric learning framework embedded with d istribution optimization (UMP+D). Specifically, the UMP+D not only unifies the combination of classification loss and pairwise loss into a single loss function containing only pairwise representation but also fuses it with multiple proxy learning. In addition, a distribution loss branch is embedded in the UMP+D to refine the distribution of samples in the feature embedding space to further tighten the intraclass samples and pull apart the interclass samples. Extensive experiments on two optical remote sensing datasets and one synthetic aperture radar dataset demonstrate that the proposed UMP+D framework outperforms the existing frameworks and achieves state-of-the-art performance.