3D Hand Pose Estimation in Egocentric Images in the Wild ...
We present WildHands, a method for 3D hand pose estimation in egocentric images in the wild. This is challenging due to (a) lack of 3D hand pose annotations for images in the wild, and (b) a form of perspective distortion-induced shape ambiguity that arises in the analysis of crops around hands. For...
Main Authors: | , , , |
---|---|
Format: | Article in Journal/Newspaper |
Language: | unknown |
Published: |
arXiv
2023
|
Subjects: | |
Online Access: | https://dx.doi.org/10.48550/arxiv.2312.06583 https://arxiv.org/abs/2312.06583 |
id |
ftdatacite:10.48550/arxiv.2312.06583 |
---|---|
record_format |
openpolar |
spelling |
ftdatacite:10.48550/arxiv.2312.06583 2024-01-28T10:03:50+01:00 3D Hand Pose Estimation in Egocentric Images in the Wild ... Prakash, Aditya Tu, Ruisen Chang, Matthew Gupta, Saurabh 2023 https://dx.doi.org/10.48550/arxiv.2312.06583 https://arxiv.org/abs/2312.06583 unknown arXiv arXiv.org perpetual, non-exclusive license http://arxiv.org/licenses/nonexclusive-distrib/1.0/ Computer Vision and Pattern Recognition cs.CV Artificial Intelligence cs.AI Machine Learning cs.LG Robotics cs.RO FOS Computer and information sciences Article Preprint CreativeWork article 2023 ftdatacite https://doi.org/10.48550/arxiv.2312.06583 2024-01-04T23:18:07Z We present WildHands, a method for 3D hand pose estimation in egocentric images in the wild. This is challenging due to (a) lack of 3D hand pose annotations for images in the wild, and (b) a form of perspective distortion-induced shape ambiguity that arises in the analysis of crops around hands. For the former, we use auxiliary supervision on in-the-wild data in the form of segmentation masks & grasp labels in addition to 3D supervision available in lab datasets. For the latter, we provide spatial cues about the location of the hand crop in the camera's field of view. Our approach achieves the best 3D hand pose on the ARCTIC leaderboard and outperforms FrankMocap, a popular and robust approach for estimating hand pose in the wild, by 45.3% when evaluated on 2D hand pose on our EPIC-HandKps dataset. ... : Project page: https://ap229997.github.io/projects/hands/ ... Article in Journal/Newspaper Arctic DataCite Metadata Store (German National Library of Science and Technology) Arctic |
institution |
Open Polar |
collection |
DataCite Metadata Store (German National Library of Science and Technology) |
op_collection_id |
ftdatacite |
language |
unknown |
topic |
Computer Vision and Pattern Recognition cs.CV Artificial Intelligence cs.AI Machine Learning cs.LG Robotics cs.RO FOS Computer and information sciences |
spellingShingle |
Computer Vision and Pattern Recognition cs.CV Artificial Intelligence cs.AI Machine Learning cs.LG Robotics cs.RO FOS Computer and information sciences Prakash, Aditya Tu, Ruisen Chang, Matthew Gupta, Saurabh 3D Hand Pose Estimation in Egocentric Images in the Wild ... |
topic_facet |
Computer Vision and Pattern Recognition cs.CV Artificial Intelligence cs.AI Machine Learning cs.LG Robotics cs.RO FOS Computer and information sciences |
description |
We present WildHands, a method for 3D hand pose estimation in egocentric images in the wild. This is challenging due to (a) lack of 3D hand pose annotations for images in the wild, and (b) a form of perspective distortion-induced shape ambiguity that arises in the analysis of crops around hands. For the former, we use auxiliary supervision on in-the-wild data in the form of segmentation masks & grasp labels in addition to 3D supervision available in lab datasets. For the latter, we provide spatial cues about the location of the hand crop in the camera's field of view. Our approach achieves the best 3D hand pose on the ARCTIC leaderboard and outperforms FrankMocap, a popular and robust approach for estimating hand pose in the wild, by 45.3% when evaluated on 2D hand pose on our EPIC-HandKps dataset. ... : Project page: https://ap229997.github.io/projects/hands/ ... |
format |
Article in Journal/Newspaper |
author |
Prakash, Aditya Tu, Ruisen Chang, Matthew Gupta, Saurabh |
author_facet |
Prakash, Aditya Tu, Ruisen Chang, Matthew Gupta, Saurabh |
author_sort |
Prakash, Aditya |
title |
3D Hand Pose Estimation in Egocentric Images in the Wild ... |
title_short |
3D Hand Pose Estimation in Egocentric Images in the Wild ... |
title_full |
3D Hand Pose Estimation in Egocentric Images in the Wild ... |
title_fullStr |
3D Hand Pose Estimation in Egocentric Images in the Wild ... |
title_full_unstemmed |
3D Hand Pose Estimation in Egocentric Images in the Wild ... |
title_sort |
3d hand pose estimation in egocentric images in the wild ... |
publisher |
arXiv |
publishDate |
2023 |
url |
https://dx.doi.org/10.48550/arxiv.2312.06583 https://arxiv.org/abs/2312.06583 |
geographic |
Arctic |
geographic_facet |
Arctic |
genre |
Arctic |
genre_facet |
Arctic |
op_rights |
arXiv.org perpetual, non-exclusive license http://arxiv.org/licenses/nonexclusive-distrib/1.0/ |
op_doi |
https://doi.org/10.48550/arxiv.2312.06583 |
_version_ |
1789329304355602432 |