Advanced Soft Remote Control System Using Hand Gesture

Design and evaluation of novel gesture-centric interaction models in smart spaces

“…In addition, the reviewed literature only tests the proposed recognition approaches offline (cross validation on common or local collected dataset), except [43,79,28]. [43] just discussed some problems in online (real application scenario) test while [79,28] only reported the accuracy of their online test. This work will discuss in detail recognition accuracy, errors in gesture input procedure, and time analysis of gesture input workflow in a real application scenario.…”

“…The technologies include the Kinect, the smartphone and the smartwatch, covering natural, graspable and wearable user interfaces, and explicit (position data) and implicit (inertial data) tracking technologies. Most of the previous works employ a single enabling technology, such as the smartphone [58], inertial sensors [13], color cameras [28], etc. There are also multimodal interaction systems in smart design studio [43] and smart office [50] environment including gestural interaction on a single technology.…”

“…Some previous works make only objective or only subjective evaluations on their developed systems [79,58,28]. A user study in this work, however, has been carried out to exhaustively evaluate the interaction models with both objective and subjective metrics including the performance in terms of effectiveness and efficiency, and subjective ratings on the grammar, user interface, social acceptability, physical exertion, training, preference on technologies, usability, user experience, etc.…”

“…The 7 gestures including 4 swings, tilt, moving down and up, and pointing forward, could control TV, radio, lamps and blinds. Equipped with three ceiling-mounted zoom color cameras with pan/tilt modules, the Advanced Soft Remote Control System [28] detects users' pointing for device selection and recognizes 10 geometric gestures to control various home appliances such as TV, curtains and electric lights. Users in [50] select displays or items on displays by grasping and release them by opening hand in a smart office space using head-mounted devices (HMDs) with a external depth camera.…”

“…To control appliances, Point&Control [17] has a server determine which device the user is pointing at through collision detection and send the control interface of this pointed device to the user's smartphone where control commands are issued. A work in 2006 [28] also selects home appliances by pointing gesture but using normal color cameras. The pointing direction is inferred by detecting the user's face and segmenting the commanding hand with skin color cues.…”