Distribution Consistency Loss for Large-Scale Remote Sensing Image Retrieval
Remote sensing images are featured by massiveness, diversity and complexity. These features put forward higher requirements for the speed and accuracy of remote sensing image retrieval. The extraction method plays a key role in retrieving remote sensing images. Deep metric learning (DML) captures th...
Published in: | Remote Sensing |
---|---|
Main Authors: | , , |
Format: | Article in Journal/Newspaper |
Language: | English |
Published: |
MDPI AG
2020
|
Subjects: | |
Online Access: | https://doi.org/10.3390/rs12010175 https://doaj.org/article/fbb5cb20c4ef4d8da85d8b08275cf553 |
id |
ftdoajarticles:oai:doaj.org/article:fbb5cb20c4ef4d8da85d8b08275cf553 |
---|---|
record_format |
openpolar |
spelling |
ftdoajarticles:oai:doaj.org/article:fbb5cb20c4ef4d8da85d8b08275cf553 2023-05-15T16:01:45+02:00 Distribution Consistency Loss for Large-Scale Remote Sensing Image Retrieval Lili Fan Hongwei Zhao Haoyu Zhao 2020-01-01T00:00:00Z https://doi.org/10.3390/rs12010175 https://doaj.org/article/fbb5cb20c4ef4d8da85d8b08275cf553 EN eng MDPI AG https://www.mdpi.com/2072-4292/12/1/175 https://doaj.org/toc/2072-4292 2072-4292 doi:10.3390/rs12010175 https://doaj.org/article/fbb5cb20c4ef4d8da85d8b08275cf553 Remote Sensing, Vol 12, Iss 1, p 175 (2020) deep metric learning remote sensing image retrieval (rsir) sample balance loss distribution consistency loss Science Q article 2020 ftdoajarticles https://doi.org/10.3390/rs12010175 2022-12-31T16:18:10Z Remote sensing images are featured by massiveness, diversity and complexity. These features put forward higher requirements for the speed and accuracy of remote sensing image retrieval. The extraction method plays a key role in retrieving remote sensing images. Deep metric learning (DML) captures the semantic similarity information between data points by learning embedding in vector space. However, due to the uneven distribution of sample data in remote sensing image datasets, the pair-based loss currently used in DML is not suitable. To improve this, we propose a novel distribution consistency loss to solve this problem. First, we define a new way to mine samples by selecting five in-class hard samples and five inter-class hard samples to form an informative set. This method can make the network extract more useful information in a short time. Secondly, in order to avoid inaccurate feature extraction due to sample imbalance, we assign dynamic weight to the positive samples according to the ratio of the number of hard samples and easy samples in the class, and name the loss caused by the positive sample as the sample balance loss. We combine the sample balance of the positive samples with the ranking consistency of the negative samples to form our distribution consistency loss. Finally, we built an end-to-end fine-tuning network suitable for remote sensing image retrieval. We display comprehensive experimental results drawing on three remote sensing image datasets that are publicly available and show that our method achieves the state-of-the-art performance. Article in Journal/Newspaper DML Directory of Open Access Journals: DOAJ Articles Remote Sensing 12 1 175 |
institution |
Open Polar |
collection |
Directory of Open Access Journals: DOAJ Articles |
op_collection_id |
ftdoajarticles |
language |
English |
topic |
deep metric learning remote sensing image retrieval (rsir) sample balance loss distribution consistency loss Science Q |
spellingShingle |
deep metric learning remote sensing image retrieval (rsir) sample balance loss distribution consistency loss Science Q Lili Fan Hongwei Zhao Haoyu Zhao Distribution Consistency Loss for Large-Scale Remote Sensing Image Retrieval |
topic_facet |
deep metric learning remote sensing image retrieval (rsir) sample balance loss distribution consistency loss Science Q |
description |
Remote sensing images are featured by massiveness, diversity and complexity. These features put forward higher requirements for the speed and accuracy of remote sensing image retrieval. The extraction method plays a key role in retrieving remote sensing images. Deep metric learning (DML) captures the semantic similarity information between data points by learning embedding in vector space. However, due to the uneven distribution of sample data in remote sensing image datasets, the pair-based loss currently used in DML is not suitable. To improve this, we propose a novel distribution consistency loss to solve this problem. First, we define a new way to mine samples by selecting five in-class hard samples and five inter-class hard samples to form an informative set. This method can make the network extract more useful information in a short time. Secondly, in order to avoid inaccurate feature extraction due to sample imbalance, we assign dynamic weight to the positive samples according to the ratio of the number of hard samples and easy samples in the class, and name the loss caused by the positive sample as the sample balance loss. We combine the sample balance of the positive samples with the ranking consistency of the negative samples to form our distribution consistency loss. Finally, we built an end-to-end fine-tuning network suitable for remote sensing image retrieval. We display comprehensive experimental results drawing on three remote sensing image datasets that are publicly available and show that our method achieves the state-of-the-art performance. |
format |
Article in Journal/Newspaper |
author |
Lili Fan Hongwei Zhao Haoyu Zhao |
author_facet |
Lili Fan Hongwei Zhao Haoyu Zhao |
author_sort |
Lili Fan |
title |
Distribution Consistency Loss for Large-Scale Remote Sensing Image Retrieval |
title_short |
Distribution Consistency Loss for Large-Scale Remote Sensing Image Retrieval |
title_full |
Distribution Consistency Loss for Large-Scale Remote Sensing Image Retrieval |
title_fullStr |
Distribution Consistency Loss for Large-Scale Remote Sensing Image Retrieval |
title_full_unstemmed |
Distribution Consistency Loss for Large-Scale Remote Sensing Image Retrieval |
title_sort |
distribution consistency loss for large-scale remote sensing image retrieval |
publisher |
MDPI AG |
publishDate |
2020 |
url |
https://doi.org/10.3390/rs12010175 https://doaj.org/article/fbb5cb20c4ef4d8da85d8b08275cf553 |
genre |
DML |
genre_facet |
DML |
op_source |
Remote Sensing, Vol 12, Iss 1, p 175 (2020) |
op_relation |
https://www.mdpi.com/2072-4292/12/1/175 https://doaj.org/toc/2072-4292 2072-4292 doi:10.3390/rs12010175 https://doaj.org/article/fbb5cb20c4ef4d8da85d8b08275cf553 |
op_doi |
https://doi.org/10.3390/rs12010175 |
container_title |
Remote Sensing |
container_volume |
12 |
container_issue |
1 |
container_start_page |
175 |
_version_ |
1766397491571326976 |