Exploring Adversarial Robustness of Deep Metric Learning
Deep Metric Learning (DML), a widely-used technique, involves learning a distance metric between pairs of samples. DML uses deep neural architectures to learn semantic embeddings of the input, where the distance between similar examples is small while dissimilar ones are far apart. Although the unde...
Main Authors: | , , , , |
---|---|
Format: | Text |
Language: | unknown |
Published: |
2021
|
Subjects: | |
Online Access: | http://arxiv.org/abs/2102.07265 |
id |
ftarxivpreprints:oai:arXiv.org:2102.07265 |
---|---|
record_format |
openpolar |
spelling |
ftarxivpreprints:oai:arXiv.org:2102.07265 2023-09-05T13:19:04+02:00 Exploring Adversarial Robustness of Deep Metric Learning Panum, Thomas Kobber Wang, Zi Kan, Pengyu Fernandes, Earlence Jha, Somesh 2021-02-14 http://arxiv.org/abs/2102.07265 unknown http://arxiv.org/abs/2102.07265 Computer Science - Machine Learning Computer Science - Artificial Intelligence text 2021 ftarxivpreprints 2023-08-16T16:20:33Z Deep Metric Learning (DML), a widely-used technique, involves learning a distance metric between pairs of samples. DML uses deep neural architectures to learn semantic embeddings of the input, where the distance between similar examples is small while dissimilar ones are far apart. Although the underlying neural networks produce good accuracy on naturally occurring samples, they are vulnerable to adversarially-perturbed samples that reduce performance. We take a first step towards training robust DML models and tackle the primary challenge of the metric losses being dependent on the samples in a mini-batch, unlike standard losses that only depend on the specific input-output pair. We analyze this dependence effect and contribute a robust optimization formulation. Using experiments on three commonly-used DML datasets, we demonstrate 5-76 fold increases in adversarial accuracy, and outperform an existing DML model that sought out to be robust. Text DML ArXiv.org (Cornell University Library) |
institution |
Open Polar |
collection |
ArXiv.org (Cornell University Library) |
op_collection_id |
ftarxivpreprints |
language |
unknown |
topic |
Computer Science - Machine Learning Computer Science - Artificial Intelligence |
spellingShingle |
Computer Science - Machine Learning Computer Science - Artificial Intelligence Panum, Thomas Kobber Wang, Zi Kan, Pengyu Fernandes, Earlence Jha, Somesh Exploring Adversarial Robustness of Deep Metric Learning |
topic_facet |
Computer Science - Machine Learning Computer Science - Artificial Intelligence |
description |
Deep Metric Learning (DML), a widely-used technique, involves learning a distance metric between pairs of samples. DML uses deep neural architectures to learn semantic embeddings of the input, where the distance between similar examples is small while dissimilar ones are far apart. Although the underlying neural networks produce good accuracy on naturally occurring samples, they are vulnerable to adversarially-perturbed samples that reduce performance. We take a first step towards training robust DML models and tackle the primary challenge of the metric losses being dependent on the samples in a mini-batch, unlike standard losses that only depend on the specific input-output pair. We analyze this dependence effect and contribute a robust optimization formulation. Using experiments on three commonly-used DML datasets, we demonstrate 5-76 fold increases in adversarial accuracy, and outperform an existing DML model that sought out to be robust. |
format |
Text |
author |
Panum, Thomas Kobber Wang, Zi Kan, Pengyu Fernandes, Earlence Jha, Somesh |
author_facet |
Panum, Thomas Kobber Wang, Zi Kan, Pengyu Fernandes, Earlence Jha, Somesh |
author_sort |
Panum, Thomas Kobber |
title |
Exploring Adversarial Robustness of Deep Metric Learning |
title_short |
Exploring Adversarial Robustness of Deep Metric Learning |
title_full |
Exploring Adversarial Robustness of Deep Metric Learning |
title_fullStr |
Exploring Adversarial Robustness of Deep Metric Learning |
title_full_unstemmed |
Exploring Adversarial Robustness of Deep Metric Learning |
title_sort |
exploring adversarial robustness of deep metric learning |
publishDate |
2021 |
url |
http://arxiv.org/abs/2102.07265 |
genre |
DML |
genre_facet |
DML |
op_relation |
http://arxiv.org/abs/2102.07265 |
_version_ |
1776199880839004160 |