Systèmes graphématiques et écritures des langues signées

Chiroscript: Transcription System for Studying Hand Gestures in Early Modern Painting

“…Transcription practices have already been implemented in the neighboring disciplines, namely the study of co-speech gestures and sign languages. The creation of annotation and transcription tools for gestures has been a focus of research interest since the 1950s, and it became a growing area over the last two decades (Birdwhistell 1952;Stokoe 1960;Slobin et al 2001;Boutet and Garcia 2006;Kipp et al 2007;Kato 2008;de Courville et al 2010;Garcia and Sallandre 2013;Pak-Hin Kong et al 2015;Bianchini et al 2018;Boutet et al 2018;Power et al 2022). The need to transcribe gestures and signs in order to improve or even make possible their study has been regularly underlined by researchers.…”

Représenter les langues des signes sous forme écrite : questions qui ont besoin (encore aujourd’hui) d’être posées

“…Il faut adopter une approche « grapholinguistique » où le point de vue linguistique (concernant les informations que les linguistes veulent pouvoir coder et ensuite requêter) est toujours mis en relation avec l'aspect graphique (touchant la manière dont les systèmes graphiques permettent de coder ces informations). Un exemple de système développé dans une approche grapholinguistique est Typannot (Boutet et al, 2018 ;Doan et al, 2019), qui permet de transcrire les LS et la gestualité co-verbale. Il voit le jour au sein de l'équipe de recherche GestualScript, établie au sein de l'École Supérieure d'Art et de Design d'Amiens.…”

The body between meaning and form: kinesiological analysis and typographical representation of movement in Sign Languages

“…Bypassing the search for reasons preventing the adoption of these graphic systems by linguists, their comparison brings out another common characteristic: although they were created with the aim of representing SLs shape, these systems offer a limited and frozen vision of signs. Moreover, all these systems are organized around the hand: its shape, location, orientation (all grouped under the revealing name of "manual parameters") are described through their superficial manifestations, offering the vision of a hand "xeroxed" in the graphic space (Boutet et al, 2018). Apart from the hands, any other body element, whether facial expressions or proper body parts (head, bust, arms, forearms, etc.…”

“…The KinApp principles were adopted by the GestualScript research group 15 to develop Typannot (Bianchini et al, 2018;Boutet et al, 2018;Doan et al, 2019;Boutet et al, 2020;Danet et al, 2021), a set of typographic characters, compatible with Unicode and associated with a font family in OpenType format (*.otf), which constitute a system of transcription for SLs and gestures. These characters represent LOCini and MOV, but also HandShape (HS), MouthAction (MAct) and EyeAction (EAct), while other components with similar principles of creation and operation may emerge in the future.…”

“…This innovation, still at an early stage, will drastically reduce the SLs transcription time, from the current 5 hours per minute transcribed (Crasborn, 2015) to almost real-time. It would indeed be possible, by using the body (equipped with MoCap devices) as a paintbrush (Boutet et al, 2018) to simultaneously transcribe information on HS, LOCini, MOV, MAct and EAct. This research phase does not only consist in finding algorithms transforming MoCap data into Typannot characters, but also in identifying a MoCap system combining device portability, non-invasiveness for the "captured" person, ease of handling by the researcher and limited cost.…”