BP-Triplet Net for Unsupervised Domain Adaptation: A Bayesian Perspective
Triplet loss, one of the deep metric learning (DML) methods, is to learn the embeddings where examples from the same class are closer than examples from different classes. Motivated by DML, we propose an effective BP-Triplet Loss for unsupervised domain adaption (UDA) from the perspective of Bayesia...
Main Authors: | , , |
---|---|
Format: | Text |
Language: | unknown |
Published: |
2022
|
Subjects: | |
Online Access: | http://arxiv.org/abs/2202.09541 |
id |
ftarxivpreprints:oai:arXiv.org:2202.09541 |
---|---|
record_format |
openpolar |
spelling |
ftarxivpreprints:oai:arXiv.org:2202.09541 2023-09-05T13:19:06+02:00 BP-Triplet Net for Unsupervised Domain Adaptation: A Bayesian Perspective Wang, Shanshan Zhang, Lei Wang, Pichao 2022-02-19 http://arxiv.org/abs/2202.09541 unknown http://arxiv.org/abs/2202.09541 Computer Science - Computer Vision and Pattern Recognition text 2022 ftarxivpreprints 2023-08-16T16:56:21Z Triplet loss, one of the deep metric learning (DML) methods, is to learn the embeddings where examples from the same class are closer than examples from different classes. Motivated by DML, we propose an effective BP-Triplet Loss for unsupervised domain adaption (UDA) from the perspective of Bayesian learning and we name the model as BP-Triplet Net. In previous metric learning based methods for UDA, sample pairs across domains are treated equally, which is not appropriate due to the domain bias. In our work, considering the different importance of pair-wise samples for both feature learning and domain alignment, we deduce our BP-Triplet loss for effective UDA from the perspective of Bayesian learning. Our BP-Triplet loss adjusts the weights of pair-wise samples in intra domain and inter domain. Especially, it can self attend to the hard pairs (including hard positive pair and hard negative pair). Together with the commonly used adversarial loss for domain alignment, the quality of target pseudo labels is progressively improved. Our method achieved low joint error of the ideal source and target hypothesis. The expected target error can then be upper bounded following Ben-David s theorem. Comprehensive evaluations on five benchmark datasets, handwritten digits, Office31, ImageCLEF-DA, Office-Home and VisDA-2017 demonstrate the effectiveness of the proposed approach for UDA. Text DML ArXiv.org (Cornell University Library) |
institution |
Open Polar |
collection |
ArXiv.org (Cornell University Library) |
op_collection_id |
ftarxivpreprints |
language |
unknown |
topic |
Computer Science - Computer Vision and Pattern Recognition |
spellingShingle |
Computer Science - Computer Vision and Pattern Recognition Wang, Shanshan Zhang, Lei Wang, Pichao BP-Triplet Net for Unsupervised Domain Adaptation: A Bayesian Perspective |
topic_facet |
Computer Science - Computer Vision and Pattern Recognition |
description |
Triplet loss, one of the deep metric learning (DML) methods, is to learn the embeddings where examples from the same class are closer than examples from different classes. Motivated by DML, we propose an effective BP-Triplet Loss for unsupervised domain adaption (UDA) from the perspective of Bayesian learning and we name the model as BP-Triplet Net. In previous metric learning based methods for UDA, sample pairs across domains are treated equally, which is not appropriate due to the domain bias. In our work, considering the different importance of pair-wise samples for both feature learning and domain alignment, we deduce our BP-Triplet loss for effective UDA from the perspective of Bayesian learning. Our BP-Triplet loss adjusts the weights of pair-wise samples in intra domain and inter domain. Especially, it can self attend to the hard pairs (including hard positive pair and hard negative pair). Together with the commonly used adversarial loss for domain alignment, the quality of target pseudo labels is progressively improved. Our method achieved low joint error of the ideal source and target hypothesis. The expected target error can then be upper bounded following Ben-David s theorem. Comprehensive evaluations on five benchmark datasets, handwritten digits, Office31, ImageCLEF-DA, Office-Home and VisDA-2017 demonstrate the effectiveness of the proposed approach for UDA. |
format |
Text |
author |
Wang, Shanshan Zhang, Lei Wang, Pichao |
author_facet |
Wang, Shanshan Zhang, Lei Wang, Pichao |
author_sort |
Wang, Shanshan |
title |
BP-Triplet Net for Unsupervised Domain Adaptation: A Bayesian Perspective |
title_short |
BP-Triplet Net for Unsupervised Domain Adaptation: A Bayesian Perspective |
title_full |
BP-Triplet Net for Unsupervised Domain Adaptation: A Bayesian Perspective |
title_fullStr |
BP-Triplet Net for Unsupervised Domain Adaptation: A Bayesian Perspective |
title_full_unstemmed |
BP-Triplet Net for Unsupervised Domain Adaptation: A Bayesian Perspective |
title_sort |
bp-triplet net for unsupervised domain adaptation: a bayesian perspective |
publishDate |
2022 |
url |
http://arxiv.org/abs/2202.09541 |
genre |
DML |
genre_facet |
DML |
op_relation |
http://arxiv.org/abs/2202.09541 |
_version_ |
1776199911252951040 |