Triplet Loss-less Center Loss Sampling Strategies in Facial Expression Recognition Scenarios

• Main Authors: Rajoli, Hossein, Lotfi, Fatemeh, Atyabi, Adham, Afghah, Fatemeh
• Format: Text
• Language: unknown
• Published: 2023
• Subjects: Computer Science - Computer Vision and Pattern Recognition; Computer Science - Artificial Intelligence; Computer Science - Computational Complexity; Computer Science - Computer Science and Game Theory; DML
• Online Access: http://arxiv.org/abs/2302.04108

Facial expressions convey massive information and play a crucial role in emotional expression. Deep neural network (DNN) accompanied by deep metric learning (DML) techniques boost the discriminative ability of the model in facial expression recognition (FER) applications. DNN, equipped with only classification loss functions such as Cross-Entropy cannot compact intra-class feature variation or separate inter-class feature distance as well as when it gets fortified by a DML supporting loss item. The triplet center loss (TCL) function is applied on all dimensions of the sample's embedding in the embedding space. In our work, we developed three strategies: fully-synthesized, semi-synthesized, and prediction-based negative sample selection strategies. To achieve better results, we introduce a selective attention module that provides a combination of pixel-wise and element-wise attention coefficients using high-semantic deep features of input samples. We evaluated the proposed method on the RAF-DB, a highly imbalanced dataset. The experimental results reveal significant improvements in comparison to the baseline for all three negative sample selection strategies. Comment: The paper has been accepted in the CISS 2023 and will be published very soon