Movement interaction design for immersive media using interactive machine learning

InteractML: Making machine learning accessible for creative practitioners working with movement interaction in immersive media

“…InteractML is a node-based IML tool for designing movement interactions in the Unity 3D game engine [7,16,[27][28][29]. Users can train, modify and run machine learning models in real time, using real-time gesture demonstrations to create new training examples and test trained models.…”

“…This work presents InteractML 1 , a tool that allows creators to use IML to recognise and implement complex movement interaction designs [7,16,[27][28][29]. The development of the tool aims to support creative practitioners and independent developers in designing movement interaction for immersive media, by building tools that allow design by moving and do not require artists or performers to have a background in computer programming.…”

“…InteractML has been designed with a User Centered Design Process based on workshops and longer residencies with artists, dancers and game designers (as described in section 3.1). InteractML has been presented in demos and workshops at several conferences [7,16,[27][28][29]. This paper gives a in more depth description of the design of the tool, describes the methodology of how the tool has been developed and what incites have been learnt through case studies of using the tool than has been presented in previous short papers.…”