Improving Image co-segmentation via Deep Metric Learning
Deep Metric Learning (DML) is helpful in computer vision tasks. In this paper, we firstly introduce DML into image co-segmentation. We propose a novel Triplet loss for Image Segmentation, called IS-Triplet loss for short, and combine it with traditional image segmentation loss. Different from the ge...
Main Authors: | , |
---|---|
Format: | Text |
Language: | unknown |
Published: |
2021
|
Subjects: | |
Online Access: | http://arxiv.org/abs/2103.10670 |
id |
ftarxivpreprints:oai:arXiv.org:2103.10670 |
---|---|
record_format |
openpolar |
spelling |
ftarxivpreprints:oai:arXiv.org:2103.10670 2023-09-05T13:19:05+02:00 Improving Image co-segmentation via Deep Metric Learning Li, Zhengwen Liu, Xiabi 2021-03-19 http://arxiv.org/abs/2103.10670 unknown http://arxiv.org/abs/2103.10670 Computer Science - Computer Vision and Pattern Recognition Computer Science - Artificial Intelligence text 2021 ftarxivpreprints 2023-08-16T16:24:02Z Deep Metric Learning (DML) is helpful in computer vision tasks. In this paper, we firstly introduce DML into image co-segmentation. We propose a novel Triplet loss for Image Segmentation, called IS-Triplet loss for short, and combine it with traditional image segmentation loss. Different from the general DML task which learns the metric between pictures, we treat each pixel as a sample, and use their embedded features in high-dimensional space to form triples, then we tend to force the distance between pixels of different categories greater than of the same category by optimizing IS-Triplet loss so that the pixels from different categories are easier to be distinguished in the high-dimensional feature space. We further present an efficient triple sampling strategy to make a feasible computation of IS-Triplet loss. Finally, the IS-Triplet loss is combined with 3 traditional image segmentation losses to perform image segmentation. We apply the proposed approach to image co-segmentation and test it on the SBCoseg dataset and the Internet dataset. The experimental result shows that our approach can effectively improve the discrimination of pixels' categories in high-dimensional space and thus help traditional loss achieve better performance of image segmentation with fewer training epochs. Comment: 11 pages, 5 figures Text DML ArXiv.org (Cornell University Library) |
institution |
Open Polar |
collection |
ArXiv.org (Cornell University Library) |
op_collection_id |
ftarxivpreprints |
language |
unknown |
topic |
Computer Science - Computer Vision and Pattern Recognition Computer Science - Artificial Intelligence |
spellingShingle |
Computer Science - Computer Vision and Pattern Recognition Computer Science - Artificial Intelligence Li, Zhengwen Liu, Xiabi Improving Image co-segmentation via Deep Metric Learning |
topic_facet |
Computer Science - Computer Vision and Pattern Recognition Computer Science - Artificial Intelligence |
description |
Deep Metric Learning (DML) is helpful in computer vision tasks. In this paper, we firstly introduce DML into image co-segmentation. We propose a novel Triplet loss for Image Segmentation, called IS-Triplet loss for short, and combine it with traditional image segmentation loss. Different from the general DML task which learns the metric between pictures, we treat each pixel as a sample, and use their embedded features in high-dimensional space to form triples, then we tend to force the distance between pixels of different categories greater than of the same category by optimizing IS-Triplet loss so that the pixels from different categories are easier to be distinguished in the high-dimensional feature space. We further present an efficient triple sampling strategy to make a feasible computation of IS-Triplet loss. Finally, the IS-Triplet loss is combined with 3 traditional image segmentation losses to perform image segmentation. We apply the proposed approach to image co-segmentation and test it on the SBCoseg dataset and the Internet dataset. The experimental result shows that our approach can effectively improve the discrimination of pixels' categories in high-dimensional space and thus help traditional loss achieve better performance of image segmentation with fewer training epochs. Comment: 11 pages, 5 figures |
format |
Text |
author |
Li, Zhengwen Liu, Xiabi |
author_facet |
Li, Zhengwen Liu, Xiabi |
author_sort |
Li, Zhengwen |
title |
Improving Image co-segmentation via Deep Metric Learning |
title_short |
Improving Image co-segmentation via Deep Metric Learning |
title_full |
Improving Image co-segmentation via Deep Metric Learning |
title_fullStr |
Improving Image co-segmentation via Deep Metric Learning |
title_full_unstemmed |
Improving Image co-segmentation via Deep Metric Learning |
title_sort |
improving image co-segmentation via deep metric learning |
publishDate |
2021 |
url |
http://arxiv.org/abs/2103.10670 |
genre |
DML |
genre_facet |
DML |
op_relation |
http://arxiv.org/abs/2103.10670 |
_version_ |
1776199899376779264 |