Deep Metric Learning for Scalable Gait-Based Person Re-Identification Using Force Platform Data

• Published in: Sensors
• Main Authors: Duncanson, Kayne A., Thwaites, Simon, Booth, David, Hanly, Gary, Robertson, William S. P., Abbasnejad, Ehsan, Thewlis, Dominic
• Format: Text
• Language: English
• Published: MDPI 2023
• Subjects: Article; DML
• Online Access: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10099366/; http://www.ncbi.nlm.nih.gov/pubmed/37050451; https://doi.org/10.3390/s23073392

Walking gait data acquired with force platforms may be used for person re-identification (re-ID) in various authentication, surveillance, and forensics applications. Current force platform-based re-ID systems classify a fixed set of identities (IDs), which presents a problem when IDs are added or removed from the database. We formulated force platform-based re-ID as a deep metric learning (DML) task, whereby a deep neural network learns a feature representation that can be compared between inputs using a distance metric. The force platform dataset used in this study is one of the largest and the most comprehensive of its kind, containing 193 IDs with significant variations in clothing, footwear, walking speed, and time between trials. Several DML model architectures were evaluated in a challenging setting where none of the IDs were seen during training (i.e., zero-shot re-ID) and there was only one prior sample per ID to compare with each query sample. The best architecture was 85% accurate in this setting, though an analysis of changes in walking speed and footwear between measurement instances revealed that accuracy was 28% higher on same-speed, same-footwear comparisons, compared to cross-speed, cross-footwear comparisons. These results demonstrate the potential of DML algorithms for zero-shot re-ID using force platform data, and highlight challenging cases.