The CAMETRON Lecture Recording System: High Quality Video Recording and Editing with Minimal Human Supervision

Abstract

In this paper, we demonstrate a system that automates the process of recording video lectures in classrooms. Through special hardware (lecturer and audience facing cameras and microphone arrays), we record multiple points of view of the lecture. Person detection and tracking, along with recognition of different human actions are used to digitally zoom in on the lecturer, and alternate focus between the lecturer and the slides or the blackboard. Audio sound source localization, along with face detection and tracking, is used to detect questions from the audience, to digitally zoom in on the member of the audience asking the question and to improve the quality of the sound recording. Finally, an automatic video editing system is used to naturally switch between the different video streams and to compose a compelling end product. We demonstrate the working system in two classrooms, over two 2-hour lectures, given by two lecturers.

A Survey of Smart Classroom Literature

“…The key material planning strategies are summarized in Table 2. Video [25,[80][81][82][83][84] Recording software PTZ [85,86], mobile camera [87], camcorders [88], Kinect [89], microphones [82] Synchronization, indexing, scalability, camera control AR/VR [74,75] Computer vision and computer graphics techniques Workstations, special calibrated cameras Expensive, time consuming…”

“…Hulens et al [82] introduced the lecture recording method CAMETRON. For lecture recording, the device employs various microphones and cameras.…”