A Simple and Effective Framework for Pairwise Deep Metric Learning
Deep metric learning (DML) has received much attention in deep learning due to its wide applications in computer vision. Previous studies have focused on designing complicated losses and hard example mining methods, which are mostly heuristic and lack of theoretical understanding. In this paper, we...
Main Authors: | , , , |
---|---|
Format: | Text |
Language: | unknown |
Published: |
2019
|
Subjects: | |
Online Access: | http://arxiv.org/abs/1912.11194 |
id |
ftarxivpreprints:oai:arXiv.org:1912.11194 |
---|---|
record_format |
openpolar |
spelling |
ftarxivpreprints:oai:arXiv.org:1912.11194 2023-09-05T13:19:06+02:00 A Simple and Effective Framework for Pairwise Deep Metric Learning Qi, Qi Yan, Yan Wang, Xiaoyu Yang, Tianbao 2019-12-23 http://arxiv.org/abs/1912.11194 unknown http://arxiv.org/abs/1912.11194 Computer Science - Machine Learning Computer Science - Computer Vision and Pattern Recognition Statistics - Machine Learning text 2019 ftarxivpreprints 2023-08-16T15:40:13Z Deep metric learning (DML) has received much attention in deep learning due to its wide applications in computer vision. Previous studies have focused on designing complicated losses and hard example mining methods, which are mostly heuristic and lack of theoretical understanding. In this paper, we cast DML as a simple pairwise binary classification problem that classifies a pair of examples as similar or dissimilar. It identifies the most critical issue in this problem--imbalanced data pairs. To tackle this issue, we propose a simple and effective framework to sample pairs in a batch of data for updating the model. The key to this framework is to define a robust loss for all pairs over a mini-batch of data, which is formulated by distributionally robust optimization. The flexibility in constructing the uncertainty decision set of the dual variable allows us to recover state-of-the-art complicated losses and also to induce novel variants. Empirical studies on several benchmark data sets demonstrate that our simple and effective method outperforms the state-of-the-art results. Codes are available at: https://github.com/qiqi-helloworld/A-Simple-and-Effective-Framework-for-Pairewise-Distance-Metric-Learning Comment: 16 pages, 5 figures Text DML ArXiv.org (Cornell University Library) |
institution |
Open Polar |
collection |
ArXiv.org (Cornell University Library) |
op_collection_id |
ftarxivpreprints |
language |
unknown |
topic |
Computer Science - Machine Learning Computer Science - Computer Vision and Pattern Recognition Statistics - Machine Learning |
spellingShingle |
Computer Science - Machine Learning Computer Science - Computer Vision and Pattern Recognition Statistics - Machine Learning Qi, Qi Yan, Yan Wang, Xiaoyu Yang, Tianbao A Simple and Effective Framework for Pairwise Deep Metric Learning |
topic_facet |
Computer Science - Machine Learning Computer Science - Computer Vision and Pattern Recognition Statistics - Machine Learning |
description |
Deep metric learning (DML) has received much attention in deep learning due to its wide applications in computer vision. Previous studies have focused on designing complicated losses and hard example mining methods, which are mostly heuristic and lack of theoretical understanding. In this paper, we cast DML as a simple pairwise binary classification problem that classifies a pair of examples as similar or dissimilar. It identifies the most critical issue in this problem--imbalanced data pairs. To tackle this issue, we propose a simple and effective framework to sample pairs in a batch of data for updating the model. The key to this framework is to define a robust loss for all pairs over a mini-batch of data, which is formulated by distributionally robust optimization. The flexibility in constructing the uncertainty decision set of the dual variable allows us to recover state-of-the-art complicated losses and also to induce novel variants. Empirical studies on several benchmark data sets demonstrate that our simple and effective method outperforms the state-of-the-art results. Codes are available at: https://github.com/qiqi-helloworld/A-Simple-and-Effective-Framework-for-Pairewise-Distance-Metric-Learning Comment: 16 pages, 5 figures |
format |
Text |
author |
Qi, Qi Yan, Yan Wang, Xiaoyu Yang, Tianbao |
author_facet |
Qi, Qi Yan, Yan Wang, Xiaoyu Yang, Tianbao |
author_sort |
Qi, Qi |
title |
A Simple and Effective Framework for Pairwise Deep Metric Learning |
title_short |
A Simple and Effective Framework for Pairwise Deep Metric Learning |
title_full |
A Simple and Effective Framework for Pairwise Deep Metric Learning |
title_fullStr |
A Simple and Effective Framework for Pairwise Deep Metric Learning |
title_full_unstemmed |
A Simple and Effective Framework for Pairwise Deep Metric Learning |
title_sort |
simple and effective framework for pairwise deep metric learning |
publishDate |
2019 |
url |
http://arxiv.org/abs/1912.11194 |
genre |
DML |
genre_facet |
DML |
op_relation |
http://arxiv.org/abs/1912.11194 |
_version_ |
1776199910302941184 |