VPRTempo: A Fast Temporally Encoded Spiking Neural Network for Visual Place Recognition
Spiking Neural Networks (SNNs) are at the forefront of neuromorphic computing thanks to their potential energy-efficiency, low latencies, and capacity for continual learning. While these capabilities are well suited for robotics tasks, SNNs have seen limited adaptation in this field thus far. This w...
Main Authors: | , , , |
---|---|
Format: | Text |
Language: | unknown |
Published: |
2023
|
Subjects: | |
Online Access: | http://arxiv.org/abs/2309.10225 |
id |
ftarxivpreprints:oai:arXiv.org:2309.10225 |
---|---|
record_format |
openpolar |
spelling |
ftarxivpreprints:oai:arXiv.org:2309.10225 2023-10-09T21:53:44+02:00 VPRTempo: A Fast Temporally Encoded Spiking Neural Network for Visual Place Recognition Hines, Adam D. Stratton, Peter G. Milford, Michael Fischer, Tobias 2023-09-18 http://arxiv.org/abs/2309.10225 unknown http://arxiv.org/abs/2309.10225 Computer Science - Robotics text 2023 ftarxivpreprints 2023-09-24T01:06:43Z Spiking Neural Networks (SNNs) are at the forefront of neuromorphic computing thanks to their potential energy-efficiency, low latencies, and capacity for continual learning. While these capabilities are well suited for robotics tasks, SNNs have seen limited adaptation in this field thus far. This work introduces a SNN for Visual Place Recognition (VPR) that is both trainable within minutes and queryable in milliseconds, making it well suited for deployment on compute-constrained robotic systems. Our proposed system, VPRTempo, overcomes slow training and inference times using an abstracted SNN that trades biological realism for efficiency. VPRTempo employs a temporal code that determines the timing of a single spike based on a pixel's intensity, as opposed to prior SNNs relying on rate coding that determined the number of spikes; improving spike efficiency by over 100%. VPRTempo is trained using Spike-Timing Dependent Plasticity and a supervised delta learning rule enforcing that each output spiking neuron responds to just a single place. We evaluate our system on the Nordland and Oxford RobotCar benchmark localization datasets, which include up to 27k places. We found that VPRTempo's accuracy is comparable to prior SNNs and the popular NetVLAD place recognition algorithm, while being several orders of magnitude faster and suitable for real-time deployment -- with inference speeds over 50 Hz on CPU. VPRTempo could be integrated as a loop closure component for online SLAM on resource-constrained systems such as space and underwater robots. Comment: 8 pages, 3 figures, under review Text Nordland Nordland Nordland ArXiv.org (Cornell University Library) |
institution |
Open Polar |
collection |
ArXiv.org (Cornell University Library) |
op_collection_id |
ftarxivpreprints |
language |
unknown |
topic |
Computer Science - Robotics |
spellingShingle |
Computer Science - Robotics Hines, Adam D. Stratton, Peter G. Milford, Michael Fischer, Tobias VPRTempo: A Fast Temporally Encoded Spiking Neural Network for Visual Place Recognition |
topic_facet |
Computer Science - Robotics |
description |
Spiking Neural Networks (SNNs) are at the forefront of neuromorphic computing thanks to their potential energy-efficiency, low latencies, and capacity for continual learning. While these capabilities are well suited for robotics tasks, SNNs have seen limited adaptation in this field thus far. This work introduces a SNN for Visual Place Recognition (VPR) that is both trainable within minutes and queryable in milliseconds, making it well suited for deployment on compute-constrained robotic systems. Our proposed system, VPRTempo, overcomes slow training and inference times using an abstracted SNN that trades biological realism for efficiency. VPRTempo employs a temporal code that determines the timing of a single spike based on a pixel's intensity, as opposed to prior SNNs relying on rate coding that determined the number of spikes; improving spike efficiency by over 100%. VPRTempo is trained using Spike-Timing Dependent Plasticity and a supervised delta learning rule enforcing that each output spiking neuron responds to just a single place. We evaluate our system on the Nordland and Oxford RobotCar benchmark localization datasets, which include up to 27k places. We found that VPRTempo's accuracy is comparable to prior SNNs and the popular NetVLAD place recognition algorithm, while being several orders of magnitude faster and suitable for real-time deployment -- with inference speeds over 50 Hz on CPU. VPRTempo could be integrated as a loop closure component for online SLAM on resource-constrained systems such as space and underwater robots. Comment: 8 pages, 3 figures, under review |
format |
Text |
author |
Hines, Adam D. Stratton, Peter G. Milford, Michael Fischer, Tobias |
author_facet |
Hines, Adam D. Stratton, Peter G. Milford, Michael Fischer, Tobias |
author_sort |
Hines, Adam D. |
title |
VPRTempo: A Fast Temporally Encoded Spiking Neural Network for Visual Place Recognition |
title_short |
VPRTempo: A Fast Temporally Encoded Spiking Neural Network for Visual Place Recognition |
title_full |
VPRTempo: A Fast Temporally Encoded Spiking Neural Network for Visual Place Recognition |
title_fullStr |
VPRTempo: A Fast Temporally Encoded Spiking Neural Network for Visual Place Recognition |
title_full_unstemmed |
VPRTempo: A Fast Temporally Encoded Spiking Neural Network for Visual Place Recognition |
title_sort |
vprtempo: a fast temporally encoded spiking neural network for visual place recognition |
publishDate |
2023 |
url |
http://arxiv.org/abs/2309.10225 |
genre |
Nordland Nordland Nordland |
genre_facet |
Nordland Nordland Nordland |
op_relation |
http://arxiv.org/abs/2309.10225 |
_version_ |
1779317038763737088 |