Developing an AR Lecture Recording System with Direct Manipulation of Virtual Slides by Physical Objects

Abstract

The increasing demand for lecture videos needs support for making them. Some lecturers conduct conventional and physical-style presentations in the real world. Videos recording slides physically displayed by a projector are blurrier than videos recording slides on a display monitor. We propose a recording system that merges physical-style lectures and slides with electronic presentation tools. Hence, we aim to develop a lecture recording system having a direct manipulation interface between virtual slides in augmented reality (AR) space and users in the real world. This research has three subgoals; sharp slide images in lecture videos, direct manipulation on virtual slides, and hand-writable virtual slides using ordinary physical objects such as whiteboard markers. First, we implemented (a) an AR lecture recording system with an AR slide function, (b) a direct manipulation interface on AR slides, and (c) a handwriting function with whiteboard markers. Then, we conducted experiments in terms of system performance and slide visibility. As a result, the frames per second (fps) of our recording system is 30 fps or more. First, the result of the task-based user experiments achieved -17.85 seconds. Second, the questionnaire result of the sevenpoint likert scale improved +2.26 points. Finally, we concluded that our lecture recording system with a direct manipulation interface on AR slides is practical enough to improve the visibility of interactive slides. This paper describes the implementation and its evaluations.