Biomechanical analysis of upper limb during the use of touch screen: motion strategies identification

Abstract

Nowadays touch technology is growing and developers try to make it ever more intuitive and easier to use. This present work focused on the upper limb joint coordination during the achievement of puzzles on touch screen. A 5-inch and 10-inch devices were used to perform 9 and 16 pieces puzzles dragged with digits. The conclusions showed an increase in joint solicitation with the number of piece and the touch screen size. Moreover, three interactions strategies proved to be an evidence: the 'wrist strategy' preferentially implying wrist flexion/extension, the 'elbow strategy' preferentially implying the elbow flexion/extension and the 'neutral strategy' mobilising equally the two joints. From an ergonomic point of view, the data about how the upper limb segments are mobilised while interacting with the screen could be relevant to increase the adaptability of the devices to the user, including users with motor impairments. Practitioner Summary: Information about the biomechanical organisation of movement during interaction with touch devices appears relevant in order to develop applications adapted to the motor capacities of users. From the analysis of joint angles when performing several times a puzzle with healthy subjects, three motor strategies were highlighted.

Démarche de co-conception d’une méthode d’observation et d’évaluation multidimensionnelle de l’accessibilité au numérique

“…L'étude expérimentale s'appuie sur un essai contrôlé couplé à des actions sociales (histoire de vie, interactions sociales) en référence au tableau 1. Elle a été définie avec l'objectif de mise à l'épreuve des outils méthodologiques existants et de de Dupuy, Consel et Sauzéon [2016], eux-mêmes inspirés de la norme AttrakDiff [Lallemand et al, 2015], questionnaire sur le profil socioculturel, technologique et de santé, données issues des capteurs de mouvement [Jacquier-Bret et al, 2017], des mouvements oculaires [Caroux, Le Bigot et Vibert, 2011], des logs d'activités et des capteurs ambiants [Van den Bossche et al, 2016]). Ils permettent ainsi de répondre aux objectifs scientifiques des différents partenaires :…”

Characterizing Finger Pitch and Roll Orientation During Atomic Touch Actions

“…Jacquier-Bret et al observed users postures while carrying out their work on touch devices [15]. These researchers analysed which part of the body were used while executing common tasks and found that people's typical usage may increase the risk of developing musculoskeletal disorders.…”

“…typing on a double-touchscreen laptop) or input factors (e.g. position of the screen, such as flat on the lap as identified by [15]).…”

HCI Challenges in Human Movement Analysis

“…Various technologies can be used for tracking movements, such as optical motion-capture systems, large scale trackers, sensors embedded in mobile devices and touchscreens. In Human-Computer Interaction (HCI), the possibility of assessing the movements of users generated new perspectives for understanding and enhancing interaction [1,2], designing advanced interaction techniques [3,4] and manipulating objects in 3D virtual environments [5]. Human movement analysis is also at the heart of several disciplines impacting HCI such as biomechanics, physical medicine, gesture recognition, and signal processing.…”