WatchControl: A Control for Interactive Movie Using Continuous Gesture Recognition in Smartwatches

Abstract

This work proposes the development of a method to allow the use of smartwatch as a control for interactive movies using continuous recognition of gestures in smartwatches. We developed two prototypes to interact with interactive movies. The first one uses gesture recognition on the smartwatch screen. Thus, we created a set of gestures composed of straight lines that represent the actions in the interactive movie. In this prototype, the recognition of gestures is performed by the algorithm of continuous recognition of gestures. In this way, a gesture can be recognized before the user finalizes, and the action is sent quickly to the movie. The second prototype uses a touch of pressure in the smartwatch to control the film. As a study case, we have conducted our user study with the movie "Black Mirror: Bandersnatch", with usability and experience evaluation. A result has shown that the gestures proposed in the method are intuitive and that it has the potential to be used pleasantly and satisfactorily by the users. For 90% of the participants, the use of the smartwatch is more practical and easy to control Netflix compared to the remote control.