A Novel Ensemble Architecture of Residual Attention-Based Deep Metric Learning for Remote Sensing Image Retrieval
Recently, deep metric learning (DML) has received widespread attention in the field of remote sensing image retrieval (RSIR), owing to its ability to extract discriminative features to represent images and then to measure the similarity between images via learning a distance function among feature v...
Published in: | Remote Sensing |
---|---|
Main Authors: | , , , , |
Format: | Text |
Language: | English |
Published: |
Multidisciplinary Digital Publishing Institute
2021
|
Subjects: | |
Online Access: | https://doi.org/10.3390/rs13173445 |
id |
ftmdpi:oai:mdpi.com:/2072-4292/13/17/3445/ |
---|---|
record_format |
openpolar |
spelling |
ftmdpi:oai:mdpi.com:/2072-4292/13/17/3445/ 2023-08-20T04:06:09+02:00 A Novel Ensemble Architecture of Residual Attention-Based Deep Metric Learning for Remote Sensing Image Retrieval Qimin Cheng Deqiao Gan Peng Fu Haiyan Huang Yuzhuo Zhou agris 2021-08-30 application/pdf https://doi.org/10.3390/rs13173445 EN eng Multidisciplinary Digital Publishing Institute https://dx.doi.org/10.3390/rs13173445 https://creativecommons.org/licenses/by/4.0/ Remote Sensing; Volume 13; Issue 17; Pages: 3445 deep metric learning (DML) residual attention descriptor ensemble remote sensing image retrieval (RSIR) Text 2021 ftmdpi https://doi.org/10.3390/rs13173445 2023-08-01T02:34:19Z Recently, deep metric learning (DML) has received widespread attention in the field of remote sensing image retrieval (RSIR), owing to its ability to extract discriminative features to represent images and then to measure the similarity between images via learning a distance function among feature vectors. However, the distinguishability of features extracted by the most current DML-based methods for RSIR is still not sufficient, and the retrieval efficiency needs to be further improved. To this end, we propose a novel ensemble architecture of residual attention-based deep metric learning (EARA) for RSIR. In our proposed architecture, residual attention is introduced and ameliorated to increase feature discriminability, maintain global features, and concatenate feature vectors of different weights. Then, descriptor ensemble rather than embedding ensemble is chosen to further boost the performance of RSIR with reduced time cost and memory consumption. Furthermore, our proposed architecture can be flexibly extended with different types of deep neural networks, loss functions, and feature descriptors. To evaluate the performance and efficiency of our architecture, we conduct exhaustive experiments on three benchmark remote sensing datasets, including UCMD, SIRI-WHU, and AID. The experimental results demonstrate that the proposed architecture outperforms the four state-of-the-art methods, including BIER, A-BIER, DCES, and ABE, by 15.45%, 13.04%, 10.31%, and 6.62% in the mean Average Precision (mAP), respectively. As for the retrieval execution complexity, the retrieval time and floating point of operations (FLOPs), needed by the proposed architecture on AID, reduce by 92% and 80% compared to those needed by ABE, albeit with the same Recall@1 between the two methods. Text DML MDPI Open Access Publishing Remote Sensing 13 17 3445 |
institution |
Open Polar |
collection |
MDPI Open Access Publishing |
op_collection_id |
ftmdpi |
language |
English |
topic |
deep metric learning (DML) residual attention descriptor ensemble remote sensing image retrieval (RSIR) |
spellingShingle |
deep metric learning (DML) residual attention descriptor ensemble remote sensing image retrieval (RSIR) Qimin Cheng Deqiao Gan Peng Fu Haiyan Huang Yuzhuo Zhou A Novel Ensemble Architecture of Residual Attention-Based Deep Metric Learning for Remote Sensing Image Retrieval |
topic_facet |
deep metric learning (DML) residual attention descriptor ensemble remote sensing image retrieval (RSIR) |
description |
Recently, deep metric learning (DML) has received widespread attention in the field of remote sensing image retrieval (RSIR), owing to its ability to extract discriminative features to represent images and then to measure the similarity between images via learning a distance function among feature vectors. However, the distinguishability of features extracted by the most current DML-based methods for RSIR is still not sufficient, and the retrieval efficiency needs to be further improved. To this end, we propose a novel ensemble architecture of residual attention-based deep metric learning (EARA) for RSIR. In our proposed architecture, residual attention is introduced and ameliorated to increase feature discriminability, maintain global features, and concatenate feature vectors of different weights. Then, descriptor ensemble rather than embedding ensemble is chosen to further boost the performance of RSIR with reduced time cost and memory consumption. Furthermore, our proposed architecture can be flexibly extended with different types of deep neural networks, loss functions, and feature descriptors. To evaluate the performance and efficiency of our architecture, we conduct exhaustive experiments on three benchmark remote sensing datasets, including UCMD, SIRI-WHU, and AID. The experimental results demonstrate that the proposed architecture outperforms the four state-of-the-art methods, including BIER, A-BIER, DCES, and ABE, by 15.45%, 13.04%, 10.31%, and 6.62% in the mean Average Precision (mAP), respectively. As for the retrieval execution complexity, the retrieval time and floating point of operations (FLOPs), needed by the proposed architecture on AID, reduce by 92% and 80% compared to those needed by ABE, albeit with the same Recall@1 between the two methods. |
format |
Text |
author |
Qimin Cheng Deqiao Gan Peng Fu Haiyan Huang Yuzhuo Zhou |
author_facet |
Qimin Cheng Deqiao Gan Peng Fu Haiyan Huang Yuzhuo Zhou |
author_sort |
Qimin Cheng |
title |
A Novel Ensemble Architecture of Residual Attention-Based Deep Metric Learning for Remote Sensing Image Retrieval |
title_short |
A Novel Ensemble Architecture of Residual Attention-Based Deep Metric Learning for Remote Sensing Image Retrieval |
title_full |
A Novel Ensemble Architecture of Residual Attention-Based Deep Metric Learning for Remote Sensing Image Retrieval |
title_fullStr |
A Novel Ensemble Architecture of Residual Attention-Based Deep Metric Learning for Remote Sensing Image Retrieval |
title_full_unstemmed |
A Novel Ensemble Architecture of Residual Attention-Based Deep Metric Learning for Remote Sensing Image Retrieval |
title_sort |
novel ensemble architecture of residual attention-based deep metric learning for remote sensing image retrieval |
publisher |
Multidisciplinary Digital Publishing Institute |
publishDate |
2021 |
url |
https://doi.org/10.3390/rs13173445 |
op_coverage |
agris |
genre |
DML |
genre_facet |
DML |
op_source |
Remote Sensing; Volume 13; Issue 17; Pages: 3445 |
op_relation |
https://dx.doi.org/10.3390/rs13173445 |
op_rights |
https://creativecommons.org/licenses/by/4.0/ |
op_doi |
https://doi.org/10.3390/rs13173445 |
container_title |
Remote Sensing |
container_volume |
13 |
container_issue |
17 |
container_start_page |
3445 |
_version_ |
1774717084965535744 |