Deep Metric Learning with Chance Constraints
Deep metric learning (DML) aims to minimize empirical expected loss of the pairwise intra-/inter- class proximity violations in the embedding space. We relate DML to feasibility problem of finite chance constraints. We show that minimizer of proxy-based DML satisfies certain chance constraints, and...
Main Authors: | , , |
---|---|
Format: | Text |
Language: | unknown |
Published: |
2022
|
Subjects: | |
Online Access: | http://arxiv.org/abs/2209.09060 |
id |
ftarxivpreprints:oai:arXiv.org:2209.09060 |
---|---|
record_format |
openpolar |
spelling |
ftarxivpreprints:oai:arXiv.org:2209.09060 2023-10-09T21:51:02+02:00 Deep Metric Learning with Chance Constraints Gurbuz, Yeti Z. Can, Ogul Alatan, A. Aydin 2022-09-19 http://arxiv.org/abs/2209.09060 unknown http://arxiv.org/abs/2209.09060 Computer Science - Computer Vision and Pattern Recognition Computer Science - Machine Learning Statistics - Machine Learning text 2022 ftarxivpreprints 2023-09-10T01:05:42Z Deep metric learning (DML) aims to minimize empirical expected loss of the pairwise intra-/inter- class proximity violations in the embedding space. We relate DML to feasibility problem of finite chance constraints. We show that minimizer of proxy-based DML satisfies certain chance constraints, and that the worst case generalization performance of the proxy-based methods can be characterized by the radius of the smallest ball around a class proxy to cover the entire domain of the corresponding class samples, suggesting multiple proxies per class helps performance. To provide a scalable algorithm as well as exploiting more proxies, we consider the chance constraints implied by the minimizers of proxy-based DML instances and reformulate DML as finding a feasible point in intersection of such constraints, resulting in a problem to be approximately solved by iterative projections. Simply put, we repeatedly train a regularized proxy-based loss and re-initialize the proxies with the embeddings of the deliberately selected new samples. We applied our method with 4 well-accepted DML losses and show the effectiveness with extensive evaluations on 4 popular DML benchmarks. Code is available at: https://github.com/yetigurbuz/ccp-dml Comment: Accepted as a conference paper at IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2024 Text DML ArXiv.org (Cornell University Library) |
institution |
Open Polar |
collection |
ArXiv.org (Cornell University Library) |
op_collection_id |
ftarxivpreprints |
language |
unknown |
topic |
Computer Science - Computer Vision and Pattern Recognition Computer Science - Machine Learning Statistics - Machine Learning |
spellingShingle |
Computer Science - Computer Vision and Pattern Recognition Computer Science - Machine Learning Statistics - Machine Learning Gurbuz, Yeti Z. Can, Ogul Alatan, A. Aydin Deep Metric Learning with Chance Constraints |
topic_facet |
Computer Science - Computer Vision and Pattern Recognition Computer Science - Machine Learning Statistics - Machine Learning |
description |
Deep metric learning (DML) aims to minimize empirical expected loss of the pairwise intra-/inter- class proximity violations in the embedding space. We relate DML to feasibility problem of finite chance constraints. We show that minimizer of proxy-based DML satisfies certain chance constraints, and that the worst case generalization performance of the proxy-based methods can be characterized by the radius of the smallest ball around a class proxy to cover the entire domain of the corresponding class samples, suggesting multiple proxies per class helps performance. To provide a scalable algorithm as well as exploiting more proxies, we consider the chance constraints implied by the minimizers of proxy-based DML instances and reformulate DML as finding a feasible point in intersection of such constraints, resulting in a problem to be approximately solved by iterative projections. Simply put, we repeatedly train a regularized proxy-based loss and re-initialize the proxies with the embeddings of the deliberately selected new samples. We applied our method with 4 well-accepted DML losses and show the effectiveness with extensive evaluations on 4 popular DML benchmarks. Code is available at: https://github.com/yetigurbuz/ccp-dml Comment: Accepted as a conference paper at IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2024 |
format |
Text |
author |
Gurbuz, Yeti Z. Can, Ogul Alatan, A. Aydin |
author_facet |
Gurbuz, Yeti Z. Can, Ogul Alatan, A. Aydin |
author_sort |
Gurbuz, Yeti Z. |
title |
Deep Metric Learning with Chance Constraints |
title_short |
Deep Metric Learning with Chance Constraints |
title_full |
Deep Metric Learning with Chance Constraints |
title_fullStr |
Deep Metric Learning with Chance Constraints |
title_full_unstemmed |
Deep Metric Learning with Chance Constraints |
title_sort |
deep metric learning with chance constraints |
publishDate |
2022 |
url |
http://arxiv.org/abs/2209.09060 |
genre |
DML |
genre_facet |
DML |
op_relation |
http://arxiv.org/abs/2209.09060 |
_version_ |
1779314124291833856 |