SoftTriple Loss: Deep Metric Learning Without Triplet Sampling
Distance metric learning (DML) is to learn the embeddings where examples from the same class are closer than examples from different classes. It can be cast as an optimization problem with triplet constraints. Due to the vast number of triplet constraints, a sampling strategy is essential for DML. W...
Main Authors: | , , , , , |
---|---|
Format: | Text |
Language: | unknown |
Published: |
2019
|
Subjects: | |
Online Access: | http://arxiv.org/abs/1909.05235 |
id |
ftarxivpreprints:oai:arXiv.org:1909.05235 |
---|---|
record_format |
openpolar |
spelling |
ftarxivpreprints:oai:arXiv.org:1909.05235 2023-09-05T13:19:05+02:00 SoftTriple Loss: Deep Metric Learning Without Triplet Sampling Qian, Qi Shang, Lei Sun, Baigui Hu, Juhua Li, Hao Jin, Rong 2019-09-11 http://arxiv.org/abs/1909.05235 unknown http://arxiv.org/abs/1909.05235 Computer Science - Computer Vision and Pattern Recognition text 2019 ftarxivpreprints 2023-08-16T15:30:40Z Distance metric learning (DML) is to learn the embeddings where examples from the same class are closer than examples from different classes. It can be cast as an optimization problem with triplet constraints. Due to the vast number of triplet constraints, a sampling strategy is essential for DML. With the tremendous success of deep learning in classifications, it has been applied for DML. When learning embeddings with deep neural networks (DNNs), only a mini-batch of data is available at each iteration. The set of triplet constraints has to be sampled within the mini-batch. Since a mini-batch cannot capture the neighbors in the original set well, it makes the learned embeddings sub-optimal. On the contrary, optimizing SoftMax loss, which is a classification loss, with DNN shows a superior performance in certain DML tasks. It inspires us to investigate the formulation of SoftMax. Our analysis shows that SoftMax loss is equivalent to a smoothed triplet loss where each class has a single center. In real-world data, one class can contain several local clusters rather than a single one, e.g., birds of different poses. Therefore, we propose the SoftTriple loss to extend the SoftMax loss with multiple centers for each class. Compared with conventional deep metric learning algorithms, optimizing SoftTriple loss can learn the embeddings without the sampling phase by mildly increasing the size of the last fully connected layer. Experiments on the benchmark fine-grained data sets demonstrate the effectiveness of the proposed loss function. Code is available at https://github.com/idstcv/SoftTriple Comment: accepted by ICCV'19 Text DML ArXiv.org (Cornell University Library) |
institution |
Open Polar |
collection |
ArXiv.org (Cornell University Library) |
op_collection_id |
ftarxivpreprints |
language |
unknown |
topic |
Computer Science - Computer Vision and Pattern Recognition |
spellingShingle |
Computer Science - Computer Vision and Pattern Recognition Qian, Qi Shang, Lei Sun, Baigui Hu, Juhua Li, Hao Jin, Rong SoftTriple Loss: Deep Metric Learning Without Triplet Sampling |
topic_facet |
Computer Science - Computer Vision and Pattern Recognition |
description |
Distance metric learning (DML) is to learn the embeddings where examples from the same class are closer than examples from different classes. It can be cast as an optimization problem with triplet constraints. Due to the vast number of triplet constraints, a sampling strategy is essential for DML. With the tremendous success of deep learning in classifications, it has been applied for DML. When learning embeddings with deep neural networks (DNNs), only a mini-batch of data is available at each iteration. The set of triplet constraints has to be sampled within the mini-batch. Since a mini-batch cannot capture the neighbors in the original set well, it makes the learned embeddings sub-optimal. On the contrary, optimizing SoftMax loss, which is a classification loss, with DNN shows a superior performance in certain DML tasks. It inspires us to investigate the formulation of SoftMax. Our analysis shows that SoftMax loss is equivalent to a smoothed triplet loss where each class has a single center. In real-world data, one class can contain several local clusters rather than a single one, e.g., birds of different poses. Therefore, we propose the SoftTriple loss to extend the SoftMax loss with multiple centers for each class. Compared with conventional deep metric learning algorithms, optimizing SoftTriple loss can learn the embeddings without the sampling phase by mildly increasing the size of the last fully connected layer. Experiments on the benchmark fine-grained data sets demonstrate the effectiveness of the proposed loss function. Code is available at https://github.com/idstcv/SoftTriple Comment: accepted by ICCV'19 |
format |
Text |
author |
Qian, Qi Shang, Lei Sun, Baigui Hu, Juhua Li, Hao Jin, Rong |
author_facet |
Qian, Qi Shang, Lei Sun, Baigui Hu, Juhua Li, Hao Jin, Rong |
author_sort |
Qian, Qi |
title |
SoftTriple Loss: Deep Metric Learning Without Triplet Sampling |
title_short |
SoftTriple Loss: Deep Metric Learning Without Triplet Sampling |
title_full |
SoftTriple Loss: Deep Metric Learning Without Triplet Sampling |
title_fullStr |
SoftTriple Loss: Deep Metric Learning Without Triplet Sampling |
title_full_unstemmed |
SoftTriple Loss: Deep Metric Learning Without Triplet Sampling |
title_sort |
softtriple loss: deep metric learning without triplet sampling |
publishDate |
2019 |
url |
http://arxiv.org/abs/1909.05235 |
genre |
DML |
genre_facet |
DML |
op_relation |
http://arxiv.org/abs/1909.05235 |
_version_ |
1776199897617268736 |