ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulation ...
Humans intuitively understand that inanimate objects do not move by themselves, but that state changes are typically caused by human manipulation (e.g., the opening of a book). This is not yet the case for machines. In part this is because there exist no datasets with ground-truth 3D annotations for...
Main Authors: | , , , , , , |
---|---|
Format: | Report |
Language: | unknown |
Published: |
arXiv
2022
|
Subjects: | |
Online Access: | https://dx.doi.org/10.48550/arxiv.2204.13662 https://arxiv.org/abs/2204.13662 |
id |
ftdatacite:10.48550/arxiv.2204.13662 |
---|---|
record_format |
openpolar |
spelling |
ftdatacite:10.48550/arxiv.2204.13662 2023-06-11T04:08:59+02:00 ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulation ... Fan, Zicong Taheri, Omid Tzionas, Dimitrios Kocabas, Muhammed Kaufmann, Manuel Black, Michael J. Hilliges, Otmar 2022 https://dx.doi.org/10.48550/arxiv.2204.13662 https://arxiv.org/abs/2204.13662 unknown arXiv arXiv.org perpetual, non-exclusive license http://arxiv.org/licenses/nonexclusive-distrib/1.0/ Computer Vision and Pattern Recognition cs.CV FOS Computer and information sciences CreativeWork Article article Preprint 2022 ftdatacite https://doi.org/10.48550/arxiv.2204.13662 2023-05-02T10:50:41Z Humans intuitively understand that inanimate objects do not move by themselves, but that state changes are typically caused by human manipulation (e.g., the opening of a book). This is not yet the case for machines. In part this is because there exist no datasets with ground-truth 3D annotations for the study of physically consistent and synchronised motion of hands and articulated objects. To this end, we introduce ARCTIC -- a dataset of two hands that dexterously manipulate objects, containing 2.1M video frames paired with accurate 3D hand and object meshes and detailed, dynamic contact information. It contains bi-manual articulation of objects such as scissors or laptops, where hand poses and object states evolve jointly in time. We propose two novel articulated hand-object interaction tasks: (1) Consistent motion reconstruction: Given a monocular video, the goal is to reconstruct two hands and articulated objects in 3D, so that their motions are spatio-temporally consistent. (2) Interaction field ... : Project page: https://arctic.is.tue.mpg.de ... Report Arctic DataCite Metadata Store (German National Library of Science and Technology) Arctic |
institution |
Open Polar |
collection |
DataCite Metadata Store (German National Library of Science and Technology) |
op_collection_id |
ftdatacite |
language |
unknown |
topic |
Computer Vision and Pattern Recognition cs.CV FOS Computer and information sciences |
spellingShingle |
Computer Vision and Pattern Recognition cs.CV FOS Computer and information sciences Fan, Zicong Taheri, Omid Tzionas, Dimitrios Kocabas, Muhammed Kaufmann, Manuel Black, Michael J. Hilliges, Otmar ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulation ... |
topic_facet |
Computer Vision and Pattern Recognition cs.CV FOS Computer and information sciences |
description |
Humans intuitively understand that inanimate objects do not move by themselves, but that state changes are typically caused by human manipulation (e.g., the opening of a book). This is not yet the case for machines. In part this is because there exist no datasets with ground-truth 3D annotations for the study of physically consistent and synchronised motion of hands and articulated objects. To this end, we introduce ARCTIC -- a dataset of two hands that dexterously manipulate objects, containing 2.1M video frames paired with accurate 3D hand and object meshes and detailed, dynamic contact information. It contains bi-manual articulation of objects such as scissors or laptops, where hand poses and object states evolve jointly in time. We propose two novel articulated hand-object interaction tasks: (1) Consistent motion reconstruction: Given a monocular video, the goal is to reconstruct two hands and articulated objects in 3D, so that their motions are spatio-temporally consistent. (2) Interaction field ... : Project page: https://arctic.is.tue.mpg.de ... |
format |
Report |
author |
Fan, Zicong Taheri, Omid Tzionas, Dimitrios Kocabas, Muhammed Kaufmann, Manuel Black, Michael J. Hilliges, Otmar |
author_facet |
Fan, Zicong Taheri, Omid Tzionas, Dimitrios Kocabas, Muhammed Kaufmann, Manuel Black, Michael J. Hilliges, Otmar |
author_sort |
Fan, Zicong |
title |
ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulation ... |
title_short |
ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulation ... |
title_full |
ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulation ... |
title_fullStr |
ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulation ... |
title_full_unstemmed |
ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulation ... |
title_sort |
arctic: a dataset for dexterous bimanual hand-object manipulation ... |
publisher |
arXiv |
publishDate |
2022 |
url |
https://dx.doi.org/10.48550/arxiv.2204.13662 https://arxiv.org/abs/2204.13662 |
geographic |
Arctic |
geographic_facet |
Arctic |
genre |
Arctic |
genre_facet |
Arctic |
op_rights |
arXiv.org perpetual, non-exclusive license http://arxiv.org/licenses/nonexclusive-distrib/1.0/ |
op_doi |
https://doi.org/10.48550/arxiv.2204.13662 |
_version_ |
1768382651229536256 |