What you see is what you get: Experience ranking with deep neural dataset-to-dataset similarity for topological localisation
Recalling the most relevant visual memories for localisation or understanding a priori the likely outcome of localisation effort against a particular visual memory is useful for efficient and robust visual navigation. Solutions to this problem should be divorced from performance appraisal against gr...
Main Authors: | , , , |
---|---|
Format: | Text |
Language: | unknown |
Published: |
2023
|
Subjects: | |
Online Access: | http://arxiv.org/abs/2310.13622 |
id |
ftarxivpreprints:oai:arXiv.org:2310.13622 |
---|---|
record_format |
openpolar |
spelling |
ftarxivpreprints:oai:arXiv.org:2310.13622 2023-11-12T04:21:29+01:00 What you see is what you get: Experience ranking with deep neural dataset-to-dataset similarity for topological localisation Gadd, Matthew Ramtoula, Benjamin De Martini, Daniele Newman, Paul 2023-10-20 http://arxiv.org/abs/2310.13622 unknown http://arxiv.org/abs/2310.13622 Computer Science - Computer Vision and Pattern Recognition Computer Science - Robotics text 2023 ftarxivpreprints 2023-10-29T01:07:22Z Recalling the most relevant visual memories for localisation or understanding a priori the likely outcome of localisation effort against a particular visual memory is useful for efficient and robust visual navigation. Solutions to this problem should be divorced from performance appraisal against ground truth - as this is not available at run-time - and should ideally be based on generalisable environmental observations. For this, we propose applying the recently developed Visual DNA as a highly scalable tool for comparing datasets of images - in this work, sequences of map and live experiences. In the case of localisation, important dataset differences impacting performance are modes of appearance change, including weather, lighting, and season. Specifically, for any deep architecture which is used for place recognition by matching feature volumes at a particular layer, we use distribution measures to compare neuron-wise activation statistics between live images and multiple previously recorded past experiences, with a potentially large seasonal (winter/summer) or time of day (day/night) shift. We find that differences in these statistics correlate to performance when localising using a past experience with the same appearance gap. We validate our approach over the Nordland cross-season dataset as well as data from Oxford's University Parks with lighting and mild seasonal change, showing excellent ability of our system to rank actual localisation performance across candidate experiences. Comment: 18th International Symposium on Experimental Robotics (ISER 2023) Text Nordland Nordland Nordland ArXiv.org (Cornell University Library) |
institution |
Open Polar |
collection |
ArXiv.org (Cornell University Library) |
op_collection_id |
ftarxivpreprints |
language |
unknown |
topic |
Computer Science - Computer Vision and Pattern Recognition Computer Science - Robotics |
spellingShingle |
Computer Science - Computer Vision and Pattern Recognition Computer Science - Robotics Gadd, Matthew Ramtoula, Benjamin De Martini, Daniele Newman, Paul What you see is what you get: Experience ranking with deep neural dataset-to-dataset similarity for topological localisation |
topic_facet |
Computer Science - Computer Vision and Pattern Recognition Computer Science - Robotics |
description |
Recalling the most relevant visual memories for localisation or understanding a priori the likely outcome of localisation effort against a particular visual memory is useful for efficient and robust visual navigation. Solutions to this problem should be divorced from performance appraisal against ground truth - as this is not available at run-time - and should ideally be based on generalisable environmental observations. For this, we propose applying the recently developed Visual DNA as a highly scalable tool for comparing datasets of images - in this work, sequences of map and live experiences. In the case of localisation, important dataset differences impacting performance are modes of appearance change, including weather, lighting, and season. Specifically, for any deep architecture which is used for place recognition by matching feature volumes at a particular layer, we use distribution measures to compare neuron-wise activation statistics between live images and multiple previously recorded past experiences, with a potentially large seasonal (winter/summer) or time of day (day/night) shift. We find that differences in these statistics correlate to performance when localising using a past experience with the same appearance gap. We validate our approach over the Nordland cross-season dataset as well as data from Oxford's University Parks with lighting and mild seasonal change, showing excellent ability of our system to rank actual localisation performance across candidate experiences. Comment: 18th International Symposium on Experimental Robotics (ISER 2023) |
format |
Text |
author |
Gadd, Matthew Ramtoula, Benjamin De Martini, Daniele Newman, Paul |
author_facet |
Gadd, Matthew Ramtoula, Benjamin De Martini, Daniele Newman, Paul |
author_sort |
Gadd, Matthew |
title |
What you see is what you get: Experience ranking with deep neural dataset-to-dataset similarity for topological localisation |
title_short |
What you see is what you get: Experience ranking with deep neural dataset-to-dataset similarity for topological localisation |
title_full |
What you see is what you get: Experience ranking with deep neural dataset-to-dataset similarity for topological localisation |
title_fullStr |
What you see is what you get: Experience ranking with deep neural dataset-to-dataset similarity for topological localisation |
title_full_unstemmed |
What you see is what you get: Experience ranking with deep neural dataset-to-dataset similarity for topological localisation |
title_sort |
what you see is what you get: experience ranking with deep neural dataset-to-dataset similarity for topological localisation |
publishDate |
2023 |
url |
http://arxiv.org/abs/2310.13622 |
genre |
Nordland Nordland Nordland |
genre_facet |
Nordland Nordland Nordland |
op_relation |
http://arxiv.org/abs/2310.13622 |
_version_ |
1782336866552381440 |