Multi Proxy Anchor Family Loss for Several Types of Gradients
The deep metric learning (DML) objective is to learn a neural network that maps into an embedding space where similar data are near and dissimilar data are far. However, conventional proxy-based losses for DML have two problems: gradient problem and application of the real-world dataset with multipl...
Published in: | Computer Vision and Image Understanding |
---|---|
Main Authors: | , , |
Format: | Text |
Language: | unknown |
Published: |
2021
|
Subjects: | |
Online Access: | http://arxiv.org/abs/2110.03997 https://doi.org/10.1016/j.cviu.2023.103654 |
id |
ftarxivpreprints:oai:arXiv.org:2110.03997 |
---|---|
record_format |
openpolar |
spelling |
ftarxivpreprints:oai:arXiv.org:2110.03997 2023-09-05T13:19:05+02:00 Multi Proxy Anchor Family Loss for Several Types of Gradients Saeki, Shozo Kawahara, Minoru Aman, Hirohisa 2021-10-08 http://arxiv.org/abs/2110.03997 https://doi.org/10.1016/j.cviu.2023.103654 unknown http://arxiv.org/abs/2110.03997 Computer Vision and Image Understanding. 229 (2023) 103654 doi:10.1016/j.cviu.2023.103654 Computer Science - Computer Vision and Pattern Recognition text 2021 ftarxivpreprints https://doi.org/10.1016/j.cviu.2023.103654 2023-08-16T16:43:32Z The deep metric learning (DML) objective is to learn a neural network that maps into an embedding space where similar data are near and dissimilar data are far. However, conventional proxy-based losses for DML have two problems: gradient problem and application of the real-world dataset with multiple local centers. Additionally, the performance metrics of DML also have some issues with stability and flexibility. This paper proposes three multi-proxies anchor (MPA) family losses and a normalized discounted cumulative gain (nDCG@k) metric. This paper makes three contributions. (1) MPA-family losses can learn using a real-world dataset with multi-local centers. (2) MPA-family losses improve the training capacity of a neural network owing to solving the gradient problem. (3) MPA-family losses have data-wise or class-wise characteristics with respect to gradient generation. Finally, we demonstrate the effectiveness of MPA-family losses, and MPA-family losses achieves higher accuracy on two datasets for fine-grained images. Text DML ArXiv.org (Cornell University Library) Computer Vision and Image Understanding 229 103654 |
institution |
Open Polar |
collection |
ArXiv.org (Cornell University Library) |
op_collection_id |
ftarxivpreprints |
language |
unknown |
topic |
Computer Science - Computer Vision and Pattern Recognition |
spellingShingle |
Computer Science - Computer Vision and Pattern Recognition Saeki, Shozo Kawahara, Minoru Aman, Hirohisa Multi Proxy Anchor Family Loss for Several Types of Gradients |
topic_facet |
Computer Science - Computer Vision and Pattern Recognition |
description |
The deep metric learning (DML) objective is to learn a neural network that maps into an embedding space where similar data are near and dissimilar data are far. However, conventional proxy-based losses for DML have two problems: gradient problem and application of the real-world dataset with multiple local centers. Additionally, the performance metrics of DML also have some issues with stability and flexibility. This paper proposes three multi-proxies anchor (MPA) family losses and a normalized discounted cumulative gain (nDCG@k) metric. This paper makes three contributions. (1) MPA-family losses can learn using a real-world dataset with multi-local centers. (2) MPA-family losses improve the training capacity of a neural network owing to solving the gradient problem. (3) MPA-family losses have data-wise or class-wise characteristics with respect to gradient generation. Finally, we demonstrate the effectiveness of MPA-family losses, and MPA-family losses achieves higher accuracy on two datasets for fine-grained images. |
format |
Text |
author |
Saeki, Shozo Kawahara, Minoru Aman, Hirohisa |
author_facet |
Saeki, Shozo Kawahara, Minoru Aman, Hirohisa |
author_sort |
Saeki, Shozo |
title |
Multi Proxy Anchor Family Loss for Several Types of Gradients |
title_short |
Multi Proxy Anchor Family Loss for Several Types of Gradients |
title_full |
Multi Proxy Anchor Family Loss for Several Types of Gradients |
title_fullStr |
Multi Proxy Anchor Family Loss for Several Types of Gradients |
title_full_unstemmed |
Multi Proxy Anchor Family Loss for Several Types of Gradients |
title_sort |
multi proxy anchor family loss for several types of gradients |
publishDate |
2021 |
url |
http://arxiv.org/abs/2110.03997 https://doi.org/10.1016/j.cviu.2023.103654 |
genre |
DML |
genre_facet |
DML |
op_relation |
http://arxiv.org/abs/2110.03997 Computer Vision and Image Understanding. 229 (2023) 103654 doi:10.1016/j.cviu.2023.103654 |
op_doi |
https://doi.org/10.1016/j.cviu.2023.103654 |
container_title |
Computer Vision and Image Understanding |
container_volume |
229 |
container_start_page |
103654 |
_version_ |
1776199894811279360 |