Angular Margin-Based Softmax Losses: Toward Discriminative Deep Metric Learning

• Main Author: Alirezazadeh, Pendar
• Other Authors: Dornaika, Fadi, Moujahid, Abdelmalik
• Format: Doctoral or Postdoctoral Thesis
• Language: English
• Published: 2024
• Subjects: algorithmic languages; artificial intelligence; codes and coding systems; DML
• Online Access: http://hdl.handle.net/10810/69179

147 p. Discriminative deep metric learning aims to construct an embedding space in whichinstances of the same class can be grouped together while being effectivelydistinguished from instances belonging to other classes by deeply learnedrepresentations. In this context, angular deep metric learning emerges as a specializedsubset of discriminative deep metric learning, which is characterized by focusing onthe angles between the feature vectors rather than their magnitudes.Classical methods such as ArcFace and CosFace are considered pioneers in the fieldof angle-dependent metric learning as they introduce angle-dependent margins intothe softmax loss function. This strategic approach aims to promote more coherentclustering within classes while achieving greater angular separation between differentclasses. These methods have been applied specifically in the context of facerecognition.This thesis presents several research contributions consisting of novel softmax lossfunctions based on angular margins. The first contribution is to extend theapplicability of these loss functions beyond the field of face recognition. Theeffectiveness of these functions is investigated in challenging contexts with limitedlabeled data. Topics such as fashion image retrieval, fashion style recognition andclassification of histopathologic breast cancer images are covered.In the area of fashion image retrieval, Discriminative Margin Loss (DML) is proposedto investigate the adjustment of margin penalties for positive and negative classes.The underlying goal is to improve the discriminative power of the learnedembeddings specifically for fashion image retrieval.For the challenges related to fashion style and face recognition, Additive CosineMargin Loss (ACML) is introduced. ACML simplifies the fine-tuning of marginpenalties while strengthening the separation between classes and the cohesion withinclasses. This approach leads to performance improvements in these specialrecognition tasks.The Boosted Additive Angular Margin Loss (BAM) method is ...