Toward a theory of interaction in mobile paper-digital ensembles

Heinrichs, Felix; Schreiber, Daniel K.; Huber, Jochen; Mühlhäuser, Max

doi:10.1145/2207676.2208328

Cited by 3 publications

(1 citation statement)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Finally, Liao et al [18] use the camera of a mobile phone to make associations between digital and paper content. More recently, Heinrichs et al [13] examine how users shift their focus between paper and a smartphone. They observe that users try to minimize the number of transitions between the two media, but transitions are not necessarily disruptive and often go unnoticed.…”

Section: Pen Paper and Mobile Feedbackmentioning

confidence: 99%

Interpreting strokes on paper with a mobile assistant

Tsandilas

2012

Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology

View full text Add to dashboard Cite

Digital pen technology has allowed for the easy transfer of pen data from paper to the computer. However, linking handwritten content with the digital world remains a hard problem as it requires the translation of unstructured and highly personal vocabularies into structured ones that computers can easily understand and process. Automatic recognition can help to this direction, but as it is not always reliable, solutions require the active cooperation between users and recognition algorithms. This work examines the use of portable touch-screen devices in connection with pen and paper to help users direct and refine the interpretation of their strokes on paper. We explore four techniques of bimanual interaction that combine touch and pen-writing, where user attention is divided between the original strokes on paper and their interpretation by the electronic device. We demonstrate the techniques through a mobile interface for writing music that complements the automatic recognition with interactive user-driven interpretation. An experiment evaluates the four techniques and provides insights about their strengths and limitations.

show abstract

Section: Pen Paper and Mobile Feedbackmentioning

confidence: 99%