A Framework to Enhance Generalization of Deep Metric Learning methods using General Discriminative Feature Learning and Class Adversarial Neural Networks
Metric learning algorithms aim to learn a distance function that brings the semantically similar data items together and keeps dissimilar ones at a distance. The traditional Mahalanobis distance learning is equivalent to find a linear projection. In contrast, Deep Metric Learning (DML) methods are p...
Main Authors: | , , |
---|---|
Format: | Text |
Language: | unknown |
Published: |
2021
|
Subjects: | |
Online Access: | http://arxiv.org/abs/2106.06420 |
id |
ftarxivpreprints:oai:arXiv.org:2106.06420 |
---|---|
record_format |
openpolar |
spelling |
ftarxivpreprints:oai:arXiv.org:2106.06420 2023-09-05T13:19:05+02:00 A Framework to Enhance Generalization of Deep Metric Learning methods using General Discriminative Feature Learning and Class Adversarial Neural Networks Al-Kaabi, Karrar Monsefi, Reza Zabihzadeh, Davood 2021-06-11 http://arxiv.org/abs/2106.06420 unknown http://arxiv.org/abs/2106.06420 Computer Science - Computer Vision and Pattern Recognition Computer Science - Information Retrieval Computer Science - Machine Learning 6804 (Primary) text 2021 ftarxivpreprints 2023-08-16T16:32:22Z Metric learning algorithms aim to learn a distance function that brings the semantically similar data items together and keeps dissimilar ones at a distance. The traditional Mahalanobis distance learning is equivalent to find a linear projection. In contrast, Deep Metric Learning (DML) methods are proposed that automatically extract features from data and learn a non-linear transformation from input space to a semantically embedding space. Recently, many DML methods are proposed focused to enhance the discrimination power of the learned metric by providing novel sampling strategies or loss functions. This approach is very helpful when both the training and test examples are coming from the same set of categories. However, it is less effective in many applications of DML such as image retrieval and person-reidentification. Here, the DML should learn general semantic concepts from observed classes and employ them to rank or identify objects from unseen categories. Neglecting the generalization ability of the learned representation and just emphasizing to learn a more discriminative embedding on the observed classes may lead to the overfitting problem. To address this limitation, we propose a framework to enhance the generalization power of existing DML methods in a Zero-Shot Learning (ZSL) setting by general yet discriminative representation learning and employing a class adversarial neural network. To learn a more general representation, we propose to employ feature maps of intermediate layers in a deep neural network and enhance their discrimination power through an attention mechanism. Besides, a class adversarial network is utilized to enforce the deep model to seek class invariant features for the DML task. We evaluate our work on widely used machine vision datasets in a ZSL setting. Comment: Includes: 31 Pages, 5 Tables, 15 Figures Text DML ArXiv.org (Cornell University Library) |
institution |
Open Polar |
collection |
ArXiv.org (Cornell University Library) |
op_collection_id |
ftarxivpreprints |
language |
unknown |
topic |
Computer Science - Computer Vision and Pattern Recognition Computer Science - Information Retrieval Computer Science - Machine Learning 6804 (Primary) |
spellingShingle |
Computer Science - Computer Vision and Pattern Recognition Computer Science - Information Retrieval Computer Science - Machine Learning 6804 (Primary) Al-Kaabi, Karrar Monsefi, Reza Zabihzadeh, Davood A Framework to Enhance Generalization of Deep Metric Learning methods using General Discriminative Feature Learning and Class Adversarial Neural Networks |
topic_facet |
Computer Science - Computer Vision and Pattern Recognition Computer Science - Information Retrieval Computer Science - Machine Learning 6804 (Primary) |
description |
Metric learning algorithms aim to learn a distance function that brings the semantically similar data items together and keeps dissimilar ones at a distance. The traditional Mahalanobis distance learning is equivalent to find a linear projection. In contrast, Deep Metric Learning (DML) methods are proposed that automatically extract features from data and learn a non-linear transformation from input space to a semantically embedding space. Recently, many DML methods are proposed focused to enhance the discrimination power of the learned metric by providing novel sampling strategies or loss functions. This approach is very helpful when both the training and test examples are coming from the same set of categories. However, it is less effective in many applications of DML such as image retrieval and person-reidentification. Here, the DML should learn general semantic concepts from observed classes and employ them to rank or identify objects from unseen categories. Neglecting the generalization ability of the learned representation and just emphasizing to learn a more discriminative embedding on the observed classes may lead to the overfitting problem. To address this limitation, we propose a framework to enhance the generalization power of existing DML methods in a Zero-Shot Learning (ZSL) setting by general yet discriminative representation learning and employing a class adversarial neural network. To learn a more general representation, we propose to employ feature maps of intermediate layers in a deep neural network and enhance their discrimination power through an attention mechanism. Besides, a class adversarial network is utilized to enforce the deep model to seek class invariant features for the DML task. We evaluate our work on widely used machine vision datasets in a ZSL setting. Comment: Includes: 31 Pages, 5 Tables, 15 Figures |
format |
Text |
author |
Al-Kaabi, Karrar Monsefi, Reza Zabihzadeh, Davood |
author_facet |
Al-Kaabi, Karrar Monsefi, Reza Zabihzadeh, Davood |
author_sort |
Al-Kaabi, Karrar |
title |
A Framework to Enhance Generalization of Deep Metric Learning methods using General Discriminative Feature Learning and Class Adversarial Neural Networks |
title_short |
A Framework to Enhance Generalization of Deep Metric Learning methods using General Discriminative Feature Learning and Class Adversarial Neural Networks |
title_full |
A Framework to Enhance Generalization of Deep Metric Learning methods using General Discriminative Feature Learning and Class Adversarial Neural Networks |
title_fullStr |
A Framework to Enhance Generalization of Deep Metric Learning methods using General Discriminative Feature Learning and Class Adversarial Neural Networks |
title_full_unstemmed |
A Framework to Enhance Generalization of Deep Metric Learning methods using General Discriminative Feature Learning and Class Adversarial Neural Networks |
title_sort |
framework to enhance generalization of deep metric learning methods using general discriminative feature learning and class adversarial neural networks |
publishDate |
2021 |
url |
http://arxiv.org/abs/2106.06420 |
genre |
DML |
genre_facet |
DML |
op_relation |
http://arxiv.org/abs/2106.06420 |
_version_ |
1776199890457591808 |