Siamese Labels Auxiliary Learning
In deep learning, auxiliary training has been widely used to assist the training of models. During the training phase, using auxiliary modules to assist training can improve the performance of the model. During the testing phase, auxiliary modules can be removed, so the test parameters are not incre...
Main Authors: | , , , |
---|---|
Format: | Text |
Language: | unknown |
Published: |
2021
|
Subjects: | |
Online Access: | http://arxiv.org/abs/2103.00200 |
id |
ftarxivpreprints:oai:arXiv.org:2103.00200 |
---|---|
record_format |
openpolar |
spelling |
ftarxivpreprints:oai:arXiv.org:2103.00200 2023-09-05T13:19:05+02:00 Siamese Labels Auxiliary Learning Gan, Wenrui Liu, Zhulin Chen, C. L. Philip Zhang, Tong 2021-02-27 http://arxiv.org/abs/2103.00200 unknown http://arxiv.org/abs/2103.00200 Computer Science - Artificial Intelligence text 2021 ftarxivpreprints 2023-08-16T16:22:00Z In deep learning, auxiliary training has been widely used to assist the training of models. During the training phase, using auxiliary modules to assist training can improve the performance of the model. During the testing phase, auxiliary modules can be removed, so the test parameters are not increased. In this paper, we propose a novel auxiliary training method, Siamese Labels Auxiliary Learning (SiLa). Unlike Deep Mutual Learning (DML), SiLa emphasizes auxiliary learning and can be easily combined with DML. In general, the main work of this paper include: (1) propose SiLa Learning, which improves the performance of common models without increasing test parameters; (2) compares SiLa with DML and proves that SiLa can improve the generalization of the model; (3) SiLa is applied to Dynamic Neural Networks, and proved that SiLa can be used for various types of network structures. Text DML ArXiv.org (Cornell University Library) Sila ENVELOPE(13.133,13.133,66.320,66.320) |
institution |
Open Polar |
collection |
ArXiv.org (Cornell University Library) |
op_collection_id |
ftarxivpreprints |
language |
unknown |
topic |
Computer Science - Artificial Intelligence |
spellingShingle |
Computer Science - Artificial Intelligence Gan, Wenrui Liu, Zhulin Chen, C. L. Philip Zhang, Tong Siamese Labels Auxiliary Learning |
topic_facet |
Computer Science - Artificial Intelligence |
description |
In deep learning, auxiliary training has been widely used to assist the training of models. During the training phase, using auxiliary modules to assist training can improve the performance of the model. During the testing phase, auxiliary modules can be removed, so the test parameters are not increased. In this paper, we propose a novel auxiliary training method, Siamese Labels Auxiliary Learning (SiLa). Unlike Deep Mutual Learning (DML), SiLa emphasizes auxiliary learning and can be easily combined with DML. In general, the main work of this paper include: (1) propose SiLa Learning, which improves the performance of common models without increasing test parameters; (2) compares SiLa with DML and proves that SiLa can improve the generalization of the model; (3) SiLa is applied to Dynamic Neural Networks, and proved that SiLa can be used for various types of network structures. |
format |
Text |
author |
Gan, Wenrui Liu, Zhulin Chen, C. L. Philip Zhang, Tong |
author_facet |
Gan, Wenrui Liu, Zhulin Chen, C. L. Philip Zhang, Tong |
author_sort |
Gan, Wenrui |
title |
Siamese Labels Auxiliary Learning |
title_short |
Siamese Labels Auxiliary Learning |
title_full |
Siamese Labels Auxiliary Learning |
title_fullStr |
Siamese Labels Auxiliary Learning |
title_full_unstemmed |
Siamese Labels Auxiliary Learning |
title_sort |
siamese labels auxiliary learning |
publishDate |
2021 |
url |
http://arxiv.org/abs/2103.00200 |
long_lat |
ENVELOPE(13.133,13.133,66.320,66.320) |
geographic |
Sila |
geographic_facet |
Sila |
genre |
DML |
genre_facet |
DML |
op_relation |
http://arxiv.org/abs/2103.00200 |
_version_ |
1776199892005289984 |