Multi Proxy Anchor Family Loss for Several Types of Gradients

The deep metric learning (DML) objective is to learn a neural network that maps into an embedding space where similar data are near and dissimilar data are far. However, conventional proxy-based losses for DML have two problems: gradient problem and application of the real-world dataset with multipl...

Full description

Bibliographic Details
Published in:Computer Vision and Image Understanding
Main Authors: Saeki, Shozo, Kawahara, Minoru, Aman, Hirohisa
Format: Text
Language:unknown
Published: 2021
Subjects:
DML
Online Access:http://arxiv.org/abs/2110.03997
https://doi.org/10.1016/j.cviu.2023.103654
id ftarxivpreprints:oai:arXiv.org:2110.03997
record_format openpolar
spelling ftarxivpreprints:oai:arXiv.org:2110.03997 2023-09-05T13:19:05+02:00 Multi Proxy Anchor Family Loss for Several Types of Gradients Saeki, Shozo Kawahara, Minoru Aman, Hirohisa 2021-10-08 http://arxiv.org/abs/2110.03997 https://doi.org/10.1016/j.cviu.2023.103654 unknown http://arxiv.org/abs/2110.03997 Computer Vision and Image Understanding. 229 (2023) 103654 doi:10.1016/j.cviu.2023.103654 Computer Science - Computer Vision and Pattern Recognition text 2021 ftarxivpreprints https://doi.org/10.1016/j.cviu.2023.103654 2023-08-16T16:43:32Z The deep metric learning (DML) objective is to learn a neural network that maps into an embedding space where similar data are near and dissimilar data are far. However, conventional proxy-based losses for DML have two problems: gradient problem and application of the real-world dataset with multiple local centers. Additionally, the performance metrics of DML also have some issues with stability and flexibility. This paper proposes three multi-proxies anchor (MPA) family losses and a normalized discounted cumulative gain (nDCG@k) metric. This paper makes three contributions. (1) MPA-family losses can learn using a real-world dataset with multi-local centers. (2) MPA-family losses improve the training capacity of a neural network owing to solving the gradient problem. (3) MPA-family losses have data-wise or class-wise characteristics with respect to gradient generation. Finally, we demonstrate the effectiveness of MPA-family losses, and MPA-family losses achieves higher accuracy on two datasets for fine-grained images. Text DML ArXiv.org (Cornell University Library) Computer Vision and Image Understanding 229 103654
institution Open Polar
collection ArXiv.org (Cornell University Library)
op_collection_id ftarxivpreprints
language unknown
topic Computer Science - Computer Vision and Pattern Recognition
spellingShingle Computer Science - Computer Vision and Pattern Recognition
Saeki, Shozo
Kawahara, Minoru
Aman, Hirohisa
Multi Proxy Anchor Family Loss for Several Types of Gradients
topic_facet Computer Science - Computer Vision and Pattern Recognition
description The deep metric learning (DML) objective is to learn a neural network that maps into an embedding space where similar data are near and dissimilar data are far. However, conventional proxy-based losses for DML have two problems: gradient problem and application of the real-world dataset with multiple local centers. Additionally, the performance metrics of DML also have some issues with stability and flexibility. This paper proposes three multi-proxies anchor (MPA) family losses and a normalized discounted cumulative gain (nDCG@k) metric. This paper makes three contributions. (1) MPA-family losses can learn using a real-world dataset with multi-local centers. (2) MPA-family losses improve the training capacity of a neural network owing to solving the gradient problem. (3) MPA-family losses have data-wise or class-wise characteristics with respect to gradient generation. Finally, we demonstrate the effectiveness of MPA-family losses, and MPA-family losses achieves higher accuracy on two datasets for fine-grained images.
format Text
author Saeki, Shozo
Kawahara, Minoru
Aman, Hirohisa
author_facet Saeki, Shozo
Kawahara, Minoru
Aman, Hirohisa
author_sort Saeki, Shozo
title Multi Proxy Anchor Family Loss for Several Types of Gradients
title_short Multi Proxy Anchor Family Loss for Several Types of Gradients
title_full Multi Proxy Anchor Family Loss for Several Types of Gradients
title_fullStr Multi Proxy Anchor Family Loss for Several Types of Gradients
title_full_unstemmed Multi Proxy Anchor Family Loss for Several Types of Gradients
title_sort multi proxy anchor family loss for several types of gradients
publishDate 2021
url http://arxiv.org/abs/2110.03997
https://doi.org/10.1016/j.cviu.2023.103654
genre DML
genre_facet DML
op_relation http://arxiv.org/abs/2110.03997
Computer Vision and Image Understanding. 229 (2023) 103654
doi:10.1016/j.cviu.2023.103654
op_doi https://doi.org/10.1016/j.cviu.2023.103654
container_title Computer Vision and Image Understanding
container_volume 229
container_start_page 103654
_version_ 1776199894811279360