The task learning MR system has various forms besides the self-study in the classroom lecture and the reference book. In order to support the learning of “operation” with the movement of the body, we develop a learning support system by presenting the teaching image in the mixed reality (MR). By using the mixed reality technology, the learner can see the example while doing actual operation by himself. In addition, the system can also identify the status of learners, according to the situation, can show the template, it is an interactive learning support system.
System look
The figure below shows the learner’s appearance and the vision when using the system. Together with the button operated by the learner, the demonstration is represented. The template is an interactive video that is displayed according to the learner’s situation.
System equipment
The figure is the equipment composition of this system. In the figure, it is intended to manipulate some buttons in a fixed order as a general operation. The motion of the learner and the orientation of the head are recognized in real time by the motion capture system. Depending on whether or not the button is pressed or the wrong button is pressed, a manual is displayed in the video see through type head mounted display that the learner has installed.
Main published literature
Tomoo Inoue, Motofumi Nakanishi, Physical task learning support system visualizing a virtual teacher by mixed reality, Proceedings of the Second International Conference on Computer Supported Education (CSEDU 2010), pp.276-281, 2010.