Full-body movement as material for interaction design

Abstract

This article focuses on the design potential of digital interactions where the body is seen as the interface. With computational technology and sensors infiltrating many aspects of our lives and urban surroundings, interaction designers' ability to visualise and generate designs are important in order to understand and explore such design spaces. I propose three concepts-accessibility, immediacy and generation-as means for analysing movement as a design material for interaction design. Drawing on a social semiotics approach, contemporary choreographic research is studied where digital tools are used to generate, explicate and communicate interactive movement. I argue that by drawing on the particularities and potentials of the moving body as interface such as those explored through choreographic practice, we may avoid imitating existing exchanges with technology and create novel interactions.

Towards A Process Model for Co-Creating AI Experiences

“…Tools for material prototyping should be accessible (allow developers and designers to think about the material), immediate (support rapid iterative feedback, reflection-in-action, and reflection-on-action), and generative (allow test, probe, and exploration iterations) [33]. Lastly, developers, engineers, and data scientists employ more mechanical, less organic processes focused on application data [28].…”

“…Design requires iteration and feedback across these three aspects. When fabrication and application are cleanly separated-as with natural materials like wood and technological materials like RFID-prior work has considered design material as a given [4,18,24,26,33,53,65,74]. As a consequence, UX design emphasizes understanding material properties, developing processes to generate material artifacts, and evaluating expectations and values associated with material encounters.…”

GestureAnalyzer

“…Schrammel et al [32] discuss that interpretation of motion tracking data can be used in the understanding of user behavior such as pattern of pedestrian attention using body and head movements. Hansen [9] discusses the potential of body motion data as a material for interaction design, and argues that visualization of body movement is a necessary step for the exploration and generation of knowledge from the motion data.…”

Trigger shift

“…Previous research has noted that while whole body interfaces such as Kinect offer new digital interaction possibilities, our lack of experience of using the body to interact in such a way limits our imagination [15]. Hansen [15] argues that most commercial games that use Kinect presents what are essentially impoverished versions of realworld interactions-such as swinging sports equipment.…”

“…Hansen [15] argues that most commercial games that use Kinect presents what are essentially impoverished versions of realworld interactions-such as swinging sports equipment. Therefore, a major challenge here was introducing the Kinect technology to the participants and then build up to explore what novel interaction possibilities it provided.…”