Crowd-Aware Robot Navigation for Pedestrians with Multiple Collision Avoidance Strategies via Map-based Deep Reinforcement Learning
It is challenging for a mobile robot to navigate through human crowds. Existing approaches usually assume that pedestrians follow a predefined collision avoidance strategy, like social force model (SFM) or optimal reciprocal collision avoidance (ORCA). However, their performances commonly need to be...
Main Authors: | , , , , , |
---|---|
Format: | Text |
Language: | unknown |
Published: |
2021
|
Subjects: | |
Online Access: | http://arxiv.org/abs/2109.02541 |
id |
ftarxivpreprints:oai:arXiv.org:2109.02541 |
---|---|
record_format |
openpolar |
spelling |
ftarxivpreprints:oai:arXiv.org:2109.02541 2023-09-05T13:22:22+02:00 Crowd-Aware Robot Navigation for Pedestrians with Multiple Collision Avoidance Strategies via Map-based Deep Reinforcement Learning Yao1, Shunyi Chen, Guangda Qiu, Quecheng Ma, Jun Chen, Xiaoping Ji, Jianmin 2021-09-06 http://arxiv.org/abs/2109.02541 unknown http://arxiv.org/abs/2109.02541 Computer Science - Robotics text 2021 ftarxivpreprints 2023-08-16T16:40:09Z It is challenging for a mobile robot to navigate through human crowds. Existing approaches usually assume that pedestrians follow a predefined collision avoidance strategy, like social force model (SFM) or optimal reciprocal collision avoidance (ORCA). However, their performances commonly need to be further improved for practical applications, where pedestrians follow multiple different collision avoidance strategies. In this paper, we propose a map-based deep reinforcement learning approach for crowd-aware robot navigation with various pedestrians. We use the sensor map to represent the environmental information around the robot, including its shape and observable appearances of obstacles. We also introduce the pedestrian map that specifies the movements of pedestrians around the robot. By applying both maps as inputs of the neural network, we show that a navigation policy can be trained to better interact with pedestrians following different collision avoidance strategies. We evaluate our approach under multiple scenarios both in the simulator and on an actual robot. The results show that our approach allows the robot to successfully interact with various pedestrians and outperforms compared methods in terms of the success rate. Comment: 7 page Text Orca ArXiv.org (Cornell University Library) |
institution |
Open Polar |
collection |
ArXiv.org (Cornell University Library) |
op_collection_id |
ftarxivpreprints |
language |
unknown |
topic |
Computer Science - Robotics |
spellingShingle |
Computer Science - Robotics Yao1, Shunyi Chen, Guangda Qiu, Quecheng Ma, Jun Chen, Xiaoping Ji, Jianmin Crowd-Aware Robot Navigation for Pedestrians with Multiple Collision Avoidance Strategies via Map-based Deep Reinforcement Learning |
topic_facet |
Computer Science - Robotics |
description |
It is challenging for a mobile robot to navigate through human crowds. Existing approaches usually assume that pedestrians follow a predefined collision avoidance strategy, like social force model (SFM) or optimal reciprocal collision avoidance (ORCA). However, their performances commonly need to be further improved for practical applications, where pedestrians follow multiple different collision avoidance strategies. In this paper, we propose a map-based deep reinforcement learning approach for crowd-aware robot navigation with various pedestrians. We use the sensor map to represent the environmental information around the robot, including its shape and observable appearances of obstacles. We also introduce the pedestrian map that specifies the movements of pedestrians around the robot. By applying both maps as inputs of the neural network, we show that a navigation policy can be trained to better interact with pedestrians following different collision avoidance strategies. We evaluate our approach under multiple scenarios both in the simulator and on an actual robot. The results show that our approach allows the robot to successfully interact with various pedestrians and outperforms compared methods in terms of the success rate. Comment: 7 page |
format |
Text |
author |
Yao1, Shunyi Chen, Guangda Qiu, Quecheng Ma, Jun Chen, Xiaoping Ji, Jianmin |
author_facet |
Yao1, Shunyi Chen, Guangda Qiu, Quecheng Ma, Jun Chen, Xiaoping Ji, Jianmin |
author_sort |
Yao1, Shunyi |
title |
Crowd-Aware Robot Navigation for Pedestrians with Multiple Collision Avoidance Strategies via Map-based Deep Reinforcement Learning |
title_short |
Crowd-Aware Robot Navigation for Pedestrians with Multiple Collision Avoidance Strategies via Map-based Deep Reinforcement Learning |
title_full |
Crowd-Aware Robot Navigation for Pedestrians with Multiple Collision Avoidance Strategies via Map-based Deep Reinforcement Learning |
title_fullStr |
Crowd-Aware Robot Navigation for Pedestrians with Multiple Collision Avoidance Strategies via Map-based Deep Reinforcement Learning |
title_full_unstemmed |
Crowd-Aware Robot Navigation for Pedestrians with Multiple Collision Avoidance Strategies via Map-based Deep Reinforcement Learning |
title_sort |
crowd-aware robot navigation for pedestrians with multiple collision avoidance strategies via map-based deep reinforcement learning |
publishDate |
2021 |
url |
http://arxiv.org/abs/2109.02541 |
genre |
Orca |
genre_facet |
Orca |
op_relation |
http://arxiv.org/abs/2109.02541 |
_version_ |
1776202886980567040 |