Noise-resistant Deep Metric Learning with Ranking-based Instance Selection
The existence of noisy labels in real-world data negatively impacts the performance of deep learning models. Although much research effort has been devoted to improving robustness to noisy labels in classification tasks, the problem of noisy labels in deep metric learning (DML) remains open. In this...
Main Authors: | , , , , , , , , |
---|---|
Format: | Text |
Language: | unknown |
Published: |
2021
|
Subjects: | |
Online Access: | http://arxiv.org/abs/2103.16047 |
id |
ftarxivpreprints:oai:arXiv.org:2103.16047 |
---|---|
record_format |
openpolar |
spelling |
ftarxivpreprints:oai:arXiv.org:2103.16047 2023-09-05T13:19:05+02:00 Noise-resistant Deep Metric Learning with Ranking-based Instance Selection Liu, Chang Yu, Han Li, Boyang Shen, Zhiqi Gao, Zhanning Ren, Peiran Xie, Xuansong Cui, Lizhen Miao, Chunyan 2021-03-29 http://arxiv.org/abs/2103.16047 unknown http://arxiv.org/abs/2103.16047 Computer Science - Computer Vision and Pattern Recognition text 2021 ftarxivpreprints 2023-08-16T16:25:09Z The existence of noisy labels in real-world data negatively impacts the performance of deep learning models. Although much research effort has been devoted to improving robustness to noisy labels in classification tasks, the problem of noisy labels in deep metric learning (DML) remains open. In this paper, we propose a noise-resistant training technique for DML, which we name Probabilistic Ranking-based Instance Selection with Memory (PRISM). PRISM identifies noisy data in a minibatch using average similarity against image features extracted by several previous versions of the neural network. These features are stored in and retrieved from a memory bank. To alleviate the high computational cost brought by the memory bank, we introduce an acceleration method that replaces individual data points with the class centers. In extensive comparisons with 12 existing approaches under both synthetic and real-world label noise, PRISM demonstrates superior performance of up to 6.06% in Precision@1. Comment: Accepted by CVPR 2021 Text DML ArXiv.org (Cornell University Library) |
institution |
Open Polar |
collection |
ArXiv.org (Cornell University Library) |
op_collection_id |
ftarxivpreprints |
language |
unknown |
topic |
Computer Science - Computer Vision and Pattern Recognition |
spellingShingle |
Computer Science - Computer Vision and Pattern Recognition Liu, Chang Yu, Han Li, Boyang Shen, Zhiqi Gao, Zhanning Ren, Peiran Xie, Xuansong Cui, Lizhen Miao, Chunyan Noise-resistant Deep Metric Learning with Ranking-based Instance Selection |
topic_facet |
Computer Science - Computer Vision and Pattern Recognition |
description |
The existence of noisy labels in real-world data negatively impacts the performance of deep learning models. Although much research effort has been devoted to improving robustness to noisy labels in classification tasks, the problem of noisy labels in deep metric learning (DML) remains open. In this paper, we propose a noise-resistant training technique for DML, which we name Probabilistic Ranking-based Instance Selection with Memory (PRISM). PRISM identifies noisy data in a minibatch using average similarity against image features extracted by several previous versions of the neural network. These features are stored in and retrieved from a memory bank. To alleviate the high computational cost brought by the memory bank, we introduce an acceleration method that replaces individual data points with the class centers. In extensive comparisons with 12 existing approaches under both synthetic and real-world label noise, PRISM demonstrates superior performance of up to 6.06% in Precision@1. Comment: Accepted by CVPR 2021 |
format |
Text |
author |
Liu, Chang Yu, Han Li, Boyang Shen, Zhiqi Gao, Zhanning Ren, Peiran Xie, Xuansong Cui, Lizhen Miao, Chunyan |
author_facet |
Liu, Chang Yu, Han Li, Boyang Shen, Zhiqi Gao, Zhanning Ren, Peiran Xie, Xuansong Cui, Lizhen Miao, Chunyan |
author_sort |
Liu, Chang |
title |
Noise-resistant Deep Metric Learning with Ranking-based Instance Selection |
title_short |
Noise-resistant Deep Metric Learning with Ranking-based Instance Selection |
title_full |
Noise-resistant Deep Metric Learning with Ranking-based Instance Selection |
title_fullStr |
Noise-resistant Deep Metric Learning with Ranking-based Instance Selection |
title_full_unstemmed |
Noise-resistant Deep Metric Learning with Ranking-based Instance Selection |
title_sort |
noise-resistant deep metric learning with ranking-based instance selection |
publishDate |
2021 |
url |
http://arxiv.org/abs/2103.16047 |
genre |
DML |
genre_facet |
DML |
op_relation |
http://arxiv.org/abs/2103.16047 |
_version_ |
1776199904505364480 |