ReMagicMirror: Action Learning Using Human Reenactment with the Mirror Metaphor
MMM 2017: 23rd International Conference on Multimedia Modeling, Jan 4-6, 2017, Reykjavik, Iceland, We propose ReMagicMirror, a system to help people learn actions (e.g., martial arts, dances). We first capture the motions of a teacher performing the action to learn, using two RGB-D cameras. Next, we...
Main Authors: | , , , , , , |
---|---|
Format: | Conference Object |
Language: | English |
Published: |
Springer International Publishing
2016
|
Subjects: | |
Online Access: | http://hdl.handle.net/10061/12231 |
id |
ftnarainstitute:oai:library.naist.jp:10061/12231 |
---|---|
record_format |
openpolar |
spelling |
ftnarainstitute:oai:library.naist.jp:10061/12231 2023-05-15T16:49:24+02:00 ReMagicMirror: Action Learning Using Human Reenactment with the Mirror Metaphor Kimura, Ryosuke Nakashima, Yuta Blanco, Ambrosio Kawasaki, Hiroshi Ikeuchi, Katsushi Sato, Tomokazu Yokoya, Naokazu 2016-12-31 application/pdf http://hdl.handle.net/10061/12231 en eng Springer International Publishing 10.1007/978-3-319-51811-4_25 978-3-319-51811-4 http://hdl.handle.net/10061/12231 303 315 73298663 73292633 73292286 Copyright c 2017 Springer International Publishing 3D human reconstruction Human reenactment RGB-D sensors Conference Paper 2016 ftnarainstitute 2023-02-03T01:01:12Z MMM 2017: 23rd International Conference on Multimedia Modeling, Jan 4-6, 2017, Reykjavik, Iceland, We propose ReMagicMirror, a system to help people learn actions (e.g., martial arts, dances). We first capture the motions of a teacher performing the action to learn, using two RGB-D cameras. Next, we fit a parametric human body model to the depth data and texture it using the color data, reconstructing the teacher’s motion and appearance. The learner is then shown the ReMagicMirror system, which acts as a mirror. We overlay the teacher’s reconstructed body on top of this mirror in an augmented reality fashion. The learner is able to intuitively manipulate the reconstruction’s viewpoint by simply rotating her body, allowing for easy comparisons between the learner and the teacher. We perform a user study to evaluate our system’s ease of use, effectiveness, quality, and appeal. Conference Object Iceland Nara Institute of Science and Technology: naistar (NAIST Academic Repository) |
institution |
Open Polar |
collection |
Nara Institute of Science and Technology: naistar (NAIST Academic Repository) |
op_collection_id |
ftnarainstitute |
language |
English |
topic |
3D human reconstruction Human reenactment RGB-D sensors |
spellingShingle |
3D human reconstruction Human reenactment RGB-D sensors Kimura, Ryosuke Nakashima, Yuta Blanco, Ambrosio Kawasaki, Hiroshi Ikeuchi, Katsushi Sato, Tomokazu Yokoya, Naokazu ReMagicMirror: Action Learning Using Human Reenactment with the Mirror Metaphor |
topic_facet |
3D human reconstruction Human reenactment RGB-D sensors |
description |
MMM 2017: 23rd International Conference on Multimedia Modeling, Jan 4-6, 2017, Reykjavik, Iceland, We propose ReMagicMirror, a system to help people learn actions (e.g., martial arts, dances). We first capture the motions of a teacher performing the action to learn, using two RGB-D cameras. Next, we fit a parametric human body model to the depth data and texture it using the color data, reconstructing the teacher’s motion and appearance. The learner is then shown the ReMagicMirror system, which acts as a mirror. We overlay the teacher’s reconstructed body on top of this mirror in an augmented reality fashion. The learner is able to intuitively manipulate the reconstruction’s viewpoint by simply rotating her body, allowing for easy comparisons between the learner and the teacher. We perform a user study to evaluate our system’s ease of use, effectiveness, quality, and appeal. |
format |
Conference Object |
author |
Kimura, Ryosuke Nakashima, Yuta Blanco, Ambrosio Kawasaki, Hiroshi Ikeuchi, Katsushi Sato, Tomokazu Yokoya, Naokazu |
author_facet |
Kimura, Ryosuke Nakashima, Yuta Blanco, Ambrosio Kawasaki, Hiroshi Ikeuchi, Katsushi Sato, Tomokazu Yokoya, Naokazu |
author_sort |
Kimura, Ryosuke |
title |
ReMagicMirror: Action Learning Using Human Reenactment with the Mirror Metaphor |
title_short |
ReMagicMirror: Action Learning Using Human Reenactment with the Mirror Metaphor |
title_full |
ReMagicMirror: Action Learning Using Human Reenactment with the Mirror Metaphor |
title_fullStr |
ReMagicMirror: Action Learning Using Human Reenactment with the Mirror Metaphor |
title_full_unstemmed |
ReMagicMirror: Action Learning Using Human Reenactment with the Mirror Metaphor |
title_sort |
remagicmirror: action learning using human reenactment with the mirror metaphor |
publisher |
Springer International Publishing |
publishDate |
2016 |
url |
http://hdl.handle.net/10061/12231 |
genre |
Iceland |
genre_facet |
Iceland |
op_relation |
10.1007/978-3-319-51811-4_25 978-3-319-51811-4 http://hdl.handle.net/10061/12231 303 315 73298663 73292633 73292286 |
op_rights |
Copyright c 2017 Springer International Publishing |
_version_ |
1766039543308353536 |