VISTouch

Abstract

It has become remarkably common recently for people to own multiple mobile devices, although it is still difficult to effectively use them in combination. In this study, we constructed a new system called VISTouch that achieves a new operational capability and increases user interest in mobile devices by enabling multiple devices to be used in combination dynamically and spatially. Using VISTouch, for example, to spatially connect a smart-phone to a horizontally positioned tablet that is displaying a map as viewed from above enables these devices to dynamically obtain the correct relative position. The smart-phone displays images viewed from its position, direction, and angle in real time as a window to show the virtual 3D space. We applied VISTouch to two applications that used detailed information of the relative position in real space between multiple devices. These applications showed the potential improvement in using multiple devices in combination.

Cross-Device Taxonomy

“…Tracks proximity of person with wearable device through BLE [134] , tracks wearable device through body-coupled communication on touch [134] , tracks devices' capacitive footprints on touchscreen [371] , tracks tangible and device footprints on capacitive surface [346] , capacitive markers on phone bezel for touch on large screen [374] , [371] , [346] , [374] , reads biometric data through body-coupled communication on touch [134] optical depth camera…”

“…developers, researchers) [14,58,99,197,202,205,236,261,373] → lab study with users [13,30,64,110,114,116,128,136,138,143,157,165,169,191,200,206,238,246,301,302,347] Demonstration 70→ example applications and case studies → of a technical system (e.g. development framework, toolkit, middleware) [124,145,152,174,193,235,243,304,328,373] → of an interaction technique [54,66,94,118,147,186,300,322,374] → of a theore...…”