Accurate and Low-Latency Sensing of Touch Contact on Any Surface with Finger-Worn IMU Sensor

Gu, Yizheng; Yu, Chun; Li, Zhipeng; Li, Weiqi; Xu, Senmiao; Wei, Xiaoying; Shi, Yuanchun

doi:10.1145/3332165.3347947

Cited by 45 publications

(19 citation statements)

References 45 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For example, DeformWear [70] are button-sized interfaces, attachable on various body locations, that augment the user's body with more expressive and precise input capability with pressure, shear, and pinch deformations. Other on-body techniques [70], especially those on arms [90,100] and fingers [4,79], reserve the user's hand from occupancy at all time. Daily objects are readily available and apparent for being used as input interfaces [86].…”

Section: On-body Techniques and Everyday Objectsmentioning

confidence: 99%

See 1 more Smart Citation

Towards Augmented Reality Driven Human-City Interaction: Current Research on Mobile Headsets and Future Challenges

et al. 2021

View full text Add to dashboard Cite

Interaction design for Augmented Reality (AR) is gaining attention from both academia and industry. This survey discusses 260 articles (68.8% of articles published between 2015–2019) to review the field of human interaction in connected cities with emphasis on augmented reality-driven interaction. We provide an overview of Human-City Interaction and related technological approaches, followed by reviewing the latest trends of information visualization, constrained interfaces, and embodied interaction for AR headsets. We highlight under-explored issues in interface design and input techniques that warrant further research and conjecture that AR with complementary Conversational User Interfaces (CUIs) is a crucial enabler for ubiquitous interaction with immersive systems in smart cities. Our work helps researchers understand the current potential and future needs of AR in Human-City Interaction.

show abstract

Section: On-body Techniques and Everyday Objectsmentioning

confidence: 99%

“…For example, points and taps in mid-air require CPU-hungry applications [3] and hence lead to a significant latency, hurting the user experience [1]. Instead, IMU-driven [100], optical [79], Fig. 7.…”

Section: On-body Techniques and Everyday Objectsmentioning

confidence: 99%

Towards Augmented Reality Driven Human-City Interaction: Current Research on Mobile Headsets and Future Challenges

et al. 2021

View full text Add to dashboard Cite

show abstract

“…However, these approaches still require fixing the cameras in the environment or using wearable cameras [19,47], which are expensive, power consuming and might introduce privacy issues [3,22]. Aside from cameras, work has also been done to exploit a ring with IMU and light proximity sensor to sense touch [15] or track fingertip movements on uninstrumented surfaces [26]. None of the existing work uses wrist-based sensing.…”

Section: Touch Input On Surfacesmentioning

confidence: 99%

Acustico: Surface Tap Detection and Localization using Wrist-based Acoustic TDOA Sensing

Gong

Gupta

Benko

2020

Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology

View full text Add to dashboard Cite

In this paper, we present Acustico, a passive acoustic sensing approach that enables tap detection and 2D tap localization on uninstrumented surfaces using a wrist-worn device. Our technique uses a novel application of acoustic time differences of arrival (TDOA) analysis. We adopt a sensor fusion approach by taking both "surface waves" (i.e., vibrations through surface) and "sound waves" (i.e., vibrations through air) into analysis to improve sensing resolution. We carefully design a sensor configuration to meet the constraints of a wristband form factor. We built a wristband prototype with four acoustic sensors, two accelerometers and two microphones. Through a 20participant study, we evaluated the performance of our proposed sensing technique for tap detection and localization. Results show that our system reliably detects taps with an F1-score of 0.9987 across different environmental noises and yields high localization accuracies with root-mean-square-errors of 7.6mm (X-axis) and 4.6mm (Y-axis) across different surfaces and tapping techniques.

show abstract

“…18. Validation based on Traces: Graphical model representation of prototype from Gu et al in[14]. 11 components have been identified and 11 components have been modeled.…”

mentioning

confidence: 99%

“…11 components have been identified and 11 components have been modeled. Therefore the proposed metamodeling infrastructure demonstrates consistency in expressing all components as outlined in[14] without restriction on specifications conveyed for each component.…”

mentioning

confidence: 99%

Model-driven development for interactive surface prototypes

Mthunzi¹,

Echtler²

2021

Preprint

View full text Add to dashboard Cite

In the research space of interactive surface environments, toolkits have a central role in rapid prototyping. They simplify operating both hardware and software technologies. However, the accelerated development of these technologies discontinues the usability of toolkits, in some cases making toolkits obsolete. One approach to address this challenge is establishing future-proof hardware and software interfaces based on the study of prevailing interactive surface environments. In this paper, we study interactive surface implementations and proposes a metamodeling infrastructure to support the analysis of prevailing implementations toward designing future-proof hardware and software modeling constructs. Our approach employs the unified modeling language and emphasizes the flexible description of existing systems. To evaluate the proposed approach, six existing research prototypes have been used to conduct traces, and the consistency demonstrated is promising. A face validation study with experts has also been conducted. Expert perceptions from the face validation study suggest potential benefit in using the UML-based approach as a shared notation for studying interactive surface environments.

show abstract

Accurate and Low-Latency Sensing of Touch Contact on Any Surface with Finger-Worn IMU Sensor

Cited by 45 publications

References 45 publications

Towards Augmented Reality Driven Human-City Interaction: Current Research on Mobile Headsets and Future Challenges

Towards Augmented Reality Driven Human-City Interaction: Current Research on Mobile Headsets and Future Challenges

Acustico: Surface Tap Detection and Localization using Wrist-based Acoustic TDOA Sensing

Model-driven development for interactive surface prototypes

Contact Info

Product

Resources

About