Design and Implementation of Procedural Self-Instructional Contents and Application on Smart Glasses

Abstract

Instructional contents are used to demonstrate a technical process to teach and walkthrough certain procedures to carry out a task. This type of informational content is widely used for teaching and lectures in form of tutorial videos and training videos. Since there are questions and uncertainties for what could be the killer application for the novel wearables, we propose a self-instruction training application on a smart glass to utilize already-available instruction videos as well as public open data in creative ways. We design and implement a prototype application to help users train by wearing smart glasses specifically designed for two concrete and hand-constrained use cases where the user's hands need to be free to operate. To increase the efficiency and feasibility of the self-instruction training, we contribute to the development of a wearable killer application by integrating a voice-based user interface using speech recognizer, public open data APIs, and timestamp-based procedural content navigation structure into our proof-of-concept application.

Multi-Sensor, Third-Party API, and Cross-Device Integrated Toolkit for Enriching Participatory Research

“…Wearable smart glasses such as Google Glass feature always-on, always-accessible, and always-connected characteristics. Various sensors and cameras in these wearable computers enable many engaging scenarios [17][18][19][20] including medication information provision [21] to provide essential information. For example, Apiratwarakul et al explored using smart glasses as a tool for assessing people in mass-casualty incidents [22].…”