Ensembles of Compact, Region-specific & Regularized Spiking Neural Networks for Scalable Place Recognition
Spiking neural networks have significant potential utility in robotics due to their high energy efficiency on specialized hardware, but proof-of-concept implementations have not yet typically achieved competitive performance or capability with conventional approaches. In this paper, we tackle one of...
Main Authors: | , , |
---|---|
Format: | Text |
Language: | unknown |
Published: |
2022
|
Subjects: | |
Online Access: | http://arxiv.org/abs/2209.08723 |
id |
ftarxivpreprints:oai:arXiv.org:2209.08723 |
---|---|
record_format |
openpolar |
spelling |
ftarxivpreprints:oai:arXiv.org:2209.08723 2023-09-05T13:21:15+02:00 Ensembles of Compact, Region-specific & Regularized Spiking Neural Networks for Scalable Place Recognition Hussaini, Somayeh Milford, Michael Fischer, Tobias 2022-09-18 http://arxiv.org/abs/2209.08723 unknown http://arxiv.org/abs/2209.08723 Computer Science - Computer Vision and Pattern Recognition text 2022 ftarxivpreprints 2023-08-16T17:17:17Z Spiking neural networks have significant potential utility in robotics due to their high energy efficiency on specialized hardware, but proof-of-concept implementations have not yet typically achieved competitive performance or capability with conventional approaches. In this paper, we tackle one of the key practical challenges of scalability by introducing a novel modular ensemble network approach, where compact, localized spiking networks each learn and are solely responsible for recognizing places in a local region of the environment only. This modular approach creates a highly scalable system. However, it comes with a high-performance cost where a lack of global regularization at deployment time leads to hyperactive neurons that erroneously respond to places outside their learned region. Our second contribution introduces a regularization approach that detects and removes these problematic hyperactive neurons during the initial environmental learning phase. We evaluate this new scalable modular system on benchmark localization datasets Nordland and Oxford RobotCar, with comparisons to standard techniques NetVLAD, DenseVLAD, and SAD, and a previous spiking neural network system. Our system substantially outperforms the previous SNN system on its small dataset, but also maintains performance on 27 times larger benchmark datasets where the operation of the previous system is computationally infeasible, and performs competitively with the conventional localization systems. Comment: 8 pages, 6 figures, accepted to the IEEE International Conference on Robotics and Automation (ICRA) 2023 Text Nordland Nordland Nordland ArXiv.org (Cornell University Library) |
institution |
Open Polar |
collection |
ArXiv.org (Cornell University Library) |
op_collection_id |
ftarxivpreprints |
language |
unknown |
topic |
Computer Science - Computer Vision and Pattern Recognition |
spellingShingle |
Computer Science - Computer Vision and Pattern Recognition Hussaini, Somayeh Milford, Michael Fischer, Tobias Ensembles of Compact, Region-specific & Regularized Spiking Neural Networks for Scalable Place Recognition |
topic_facet |
Computer Science - Computer Vision and Pattern Recognition |
description |
Spiking neural networks have significant potential utility in robotics due to their high energy efficiency on specialized hardware, but proof-of-concept implementations have not yet typically achieved competitive performance or capability with conventional approaches. In this paper, we tackle one of the key practical challenges of scalability by introducing a novel modular ensemble network approach, where compact, localized spiking networks each learn and are solely responsible for recognizing places in a local region of the environment only. This modular approach creates a highly scalable system. However, it comes with a high-performance cost where a lack of global regularization at deployment time leads to hyperactive neurons that erroneously respond to places outside their learned region. Our second contribution introduces a regularization approach that detects and removes these problematic hyperactive neurons during the initial environmental learning phase. We evaluate this new scalable modular system on benchmark localization datasets Nordland and Oxford RobotCar, with comparisons to standard techniques NetVLAD, DenseVLAD, and SAD, and a previous spiking neural network system. Our system substantially outperforms the previous SNN system on its small dataset, but also maintains performance on 27 times larger benchmark datasets where the operation of the previous system is computationally infeasible, and performs competitively with the conventional localization systems. Comment: 8 pages, 6 figures, accepted to the IEEE International Conference on Robotics and Automation (ICRA) 2023 |
format |
Text |
author |
Hussaini, Somayeh Milford, Michael Fischer, Tobias |
author_facet |
Hussaini, Somayeh Milford, Michael Fischer, Tobias |
author_sort |
Hussaini, Somayeh |
title |
Ensembles of Compact, Region-specific & Regularized Spiking Neural Networks for Scalable Place Recognition |
title_short |
Ensembles of Compact, Region-specific & Regularized Spiking Neural Networks for Scalable Place Recognition |
title_full |
Ensembles of Compact, Region-specific & Regularized Spiking Neural Networks for Scalable Place Recognition |
title_fullStr |
Ensembles of Compact, Region-specific & Regularized Spiking Neural Networks for Scalable Place Recognition |
title_full_unstemmed |
Ensembles of Compact, Region-specific & Regularized Spiking Neural Networks for Scalable Place Recognition |
title_sort |
ensembles of compact, region-specific & regularized spiking neural networks for scalable place recognition |
publishDate |
2022 |
url |
http://arxiv.org/abs/2209.08723 |
genre |
Nordland Nordland Nordland |
genre_facet |
Nordland Nordland Nordland |
op_relation |
http://arxiv.org/abs/2209.08723 |
_version_ |
1776201842971115520 |