Keep doing what i just did

Abstract

Automating tasks can make a smartphone easier to use and more battery efficient. However, currently little work has been done to help end-users to create such automations. In this paper, we explore an approach for automating smartphone tasks by demonstration. We have developed a mobile application called Keep Doing It that continuously records users' interactions with their smartphones. After users performed a task that they would like to automate, they can ask our application to create the automation based on their latest actions. Since users only have to use their smartphones, as they would naturally do, to demonstrate automations, we believe that our approach can lower the barrier for creating smartphone automations. Overall, an initial evaluation of the approach suggests that users would be willing to automate their phones by demonstration.

Keep Doing What I Just Did: Automating Smartphones by Demonstration

“…The first prototype version of the Keep Doing It application and its lab evaluation, which are discussed in this dissertation, have been published as a long paper at the 15th ACM International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2013) (Maués & Barbosa, 2013b). We also presented a discussion about how the automation by demonstration approach may as well make smartphone automations more accessible for end-users with disabilities (as the elderly and the blind) at IFIP INTERACT 2013 Workshop on Rethinking Universal Accessibility: A broader approach considering the digital gap (Maués & Barbosa, 2013a).…”