ReMagicMirror: Action Learning Using Human Reenactment with the Mirror Metaphor

MMM 2017: 23rd International Conference on Multimedia Modeling, Jan 4-6, 2017, Reykjavik, Iceland, We propose ReMagicMirror, a system to help people learn actions (e.g., martial arts, dances). We first capture the motions of a teacher performing the action to learn, using two RGB-D cameras. Next, we...

Full description

Bibliographic Details
Main Authors: Kimura, Ryosuke, Nakashima, Yuta, Blanco, Ambrosio, Kawasaki, Hiroshi, Ikeuchi, Katsushi, Sato, Tomokazu, Yokoya, Naokazu
Format: Conference Object
Language:English
Published: Springer International Publishing 2016
Subjects:
3D human reconstruction
Human reenactment
RGB-D sensors
Iceland
Online Access:http://hdl.handle.net/10061/12231
Description
Summary:MMM 2017: 23rd International Conference on Multimedia Modeling, Jan 4-6, 2017, Reykjavik, Iceland, We propose ReMagicMirror, a system to help people learn actions (e.g., martial arts, dances). We first capture the motions of a teacher performing the action to learn, using two RGB-D cameras. Next, we fit a parametric human body model to the depth data and texture it using the color data, reconstructing the teacher’s motion and appearance. The learner is then shown the ReMagicMirror system, which acts as a mirror. We overlay the teacher’s reconstructed body on top of this mirror in an augmented reality fashion. The learner is able to intuitively manipulate the reconstruction’s viewpoint by simply rotating her body, allowing for easy comparisons between the learner and the teacher. We perform a user study to evaluate our system’s ease of use, effectiveness, quality, and appeal.

Similar Items