DC-MRTA: Decentralized Multi-Robot Task Allocation and Navigation in Complex Environments
We present a novel reinforcement learning (RL) based task allocation and decentralized navigation algorithm for mobile robots in warehouse environments. Our approach is designed for scenarios in which multiple robots are used to perform various pick up and delivery tasks. We consider the problem of...
Main Authors: | , , , |
---|---|
Format: | Text |
Language: | unknown |
Published: |
2022
|
Subjects: | |
Online Access: | http://arxiv.org/abs/2209.02865 |
id |
ftarxivpreprints:oai:arXiv.org:2209.02865 |
---|---|
record_format |
openpolar |
spelling |
ftarxivpreprints:oai:arXiv.org:2209.02865 2023-09-05T13:22:22+02:00 DC-MRTA: Decentralized Multi-Robot Task Allocation and Navigation in Complex Environments Agrawal, Aakriti Hariharan, Senthil Bedi, Amrit Singh Manocha, Dinesh 2022-09-06 http://arxiv.org/abs/2209.02865 unknown http://arxiv.org/abs/2209.02865 IROS-2022 Computer Science - Robotics Computer Science - Machine Learning Computer Science - Multiagent Systems text 2022 ftarxivpreprints 2023-08-16T17:16:07Z We present a novel reinforcement learning (RL) based task allocation and decentralized navigation algorithm for mobile robots in warehouse environments. Our approach is designed for scenarios in which multiple robots are used to perform various pick up and delivery tasks. We consider the problem of joint decentralized task allocation and navigation and present a two level approach to solve it. At the higher level, we solve the task allocation by formulating it in terms of Markov Decision Processes and choosing the appropriate rewards to minimize the Total Travel Delay (TTD). At the lower level, we use a decentralized navigation scheme based on ORCA that enables each robot to perform these tasks in an independent manner, and avoid collisions with other robots and dynamic obstacles. We combine these lower and upper levels by defining rewards for the higher level as the feedback from the lower level navigation algorithm. We perform extensive evaluation in complex warehouse layouts with large number of agents and highlight the benefits over state-of-the-art algorithms based on myopic pickup distance minimization and regret-based task selection. We observe improvement up to 14% in terms of task completion time and up-to 40% improvement in terms of computing collision-free trajectories for the robots. Text Orca ArXiv.org (Cornell University Library) |
institution |
Open Polar |
collection |
ArXiv.org (Cornell University Library) |
op_collection_id |
ftarxivpreprints |
language |
unknown |
topic |
Computer Science - Robotics Computer Science - Machine Learning Computer Science - Multiagent Systems |
spellingShingle |
Computer Science - Robotics Computer Science - Machine Learning Computer Science - Multiagent Systems Agrawal, Aakriti Hariharan, Senthil Bedi, Amrit Singh Manocha, Dinesh DC-MRTA: Decentralized Multi-Robot Task Allocation and Navigation in Complex Environments |
topic_facet |
Computer Science - Robotics Computer Science - Machine Learning Computer Science - Multiagent Systems |
description |
We present a novel reinforcement learning (RL) based task allocation and decentralized navigation algorithm for mobile robots in warehouse environments. Our approach is designed for scenarios in which multiple robots are used to perform various pick up and delivery tasks. We consider the problem of joint decentralized task allocation and navigation and present a two level approach to solve it. At the higher level, we solve the task allocation by formulating it in terms of Markov Decision Processes and choosing the appropriate rewards to minimize the Total Travel Delay (TTD). At the lower level, we use a decentralized navigation scheme based on ORCA that enables each robot to perform these tasks in an independent manner, and avoid collisions with other robots and dynamic obstacles. We combine these lower and upper levels by defining rewards for the higher level as the feedback from the lower level navigation algorithm. We perform extensive evaluation in complex warehouse layouts with large number of agents and highlight the benefits over state-of-the-art algorithms based on myopic pickup distance minimization and regret-based task selection. We observe improvement up to 14% in terms of task completion time and up-to 40% improvement in terms of computing collision-free trajectories for the robots. |
format |
Text |
author |
Agrawal, Aakriti Hariharan, Senthil Bedi, Amrit Singh Manocha, Dinesh |
author_facet |
Agrawal, Aakriti Hariharan, Senthil Bedi, Amrit Singh Manocha, Dinesh |
author_sort |
Agrawal, Aakriti |
title |
DC-MRTA: Decentralized Multi-Robot Task Allocation and Navigation in Complex Environments |
title_short |
DC-MRTA: Decentralized Multi-Robot Task Allocation and Navigation in Complex Environments |
title_full |
DC-MRTA: Decentralized Multi-Robot Task Allocation and Navigation in Complex Environments |
title_fullStr |
DC-MRTA: Decentralized Multi-Robot Task Allocation and Navigation in Complex Environments |
title_full_unstemmed |
DC-MRTA: Decentralized Multi-Robot Task Allocation and Navigation in Complex Environments |
title_sort |
dc-mrta: decentralized multi-robot task allocation and navigation in complex environments |
publishDate |
2022 |
url |
http://arxiv.org/abs/2209.02865 |
genre |
Orca |
genre_facet |
Orca |
op_relation |
http://arxiv.org/abs/2209.02865 IROS-2022 |
_version_ |
1776202891110907904 |