Perception of Emotions in the Hand Movement Quality of Finnish Sign Language

Hietanen, Jari K.; Leppänen, Jukka; Lehtonen, Ulla

doi:10.1023/b:jonb.0000017867.70191.68

Cited by 23 publications

(14 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…It remains to be investigated whether specific hand movement forms are relevant cues for emotion expression. However, few studies on emotional prosody in sign language suggest that emotion can be conveyed via hand movement qualities such as shape and position in space (Hietanen et al 2004;Reilly et al 1992). …”

Section: Methodological Benefits Of the Bap For Emotion Researchmentioning

confidence: 99%

The Body Action and Posture Coding System (BAP): Development and Reliability

2012

View full text Add to dashboard Cite

Several methods are available for coding body movement in nonverbal behavior research, but there is no consensus on a reliable coding system that can be used for the study of emotion expression. Adopting an integrative approach, we developed a new method, the body action and posture coding system, for the time-aligned micro description of body movement on an anatomical level (different articulations of body parts), a form level (direction and orientation of movement), and a functional level (communicative and self-regulatory functions). We applied the system to a new corpus of acted emotion portrayals, examined its comprehensiveness and demonstrated intercoder reliability at three levels: (a) occurrence, (b) temporal precision, and (c) segmentation. We discuss issues for further validation and propose some research applications.

show abstract

Section: Methodological Benefits Of the Bap For Emotion Researchmentioning

confidence: 99%

The Body Action and Posture Coding System (BAP): Development and Reliability

2012

View full text Add to dashboard Cite

show abstract

“…Qualities were mentioned as an important diagnostic aspect of psycho-pathological disorders in the psychiatric literature [19]. For example, the movement behaviour of schizophrenic patients is usually described as "angular, jerky, and uncoordinated, with uneven acceleration and deceleration and as either too slow or too fast a tempo" [10]. Psycho-pathological disturbances are associated to "disturbed, abrupt, halted, and stilted" gestures.…”

Section: Definitionsmentioning

confidence: 99%

Movement qualities as interaction modality

Alaoui

Caramiaux

Serrano³

et al. 2012

Proceedings of the Designing Interactive Systems Conference

View full text Add to dashboard Cite

In this paper, we explore the use of movement qualities as interaction modality. The notion of movement qualities is widely used in dance practice and can be understood as how the movement is performed, independently of its specific trajectory in space. We implemented our approach in the context of an artistic installation called A light touch. This installation invites the participant to interact with a moving light spot reacting to the hand movement qualities. We conducted a user experiment that showed that such an interaction based on movement qualities tends to enhance the user experience favouring explorative and expressive usage.

show abstract

“…It is also found that the perception of finger motion can change the interpretation of the entire displayed scene. In another study [45], it is reported that the underlying emotions conveyed during Finnish sign language communication were recognized by those having no knowledge of the language itself. Furthermore, neuroscientists report engagement of different perceptual and visuomotor processes when observing actions demonstrated on virtual hand-like structures as compared to real hand movements [16], [17], [18].…”

Section: Introductionmentioning

confidence: 99%

A study of human performance in recognizing expressive hand movements

et al. 2011

View full text Add to dashboard Cite

Abstract-This paper presents a study on human performance in recognizing affective expressions conveyed through movements of hand-like structures. One movement sequence, closing and opening the hand, was performed by a demonstrator in 3 sets of 5 repeated trials, each set intending to convey a different affective expression. Three different expressions, sadness, happiness and anger, were considered. Expressive movement animations were replicated with a human-like hand model, a stick hand model and with a model resembling a palm frond structure. The structures tested have identical kinematics but different physical appearance. The ability of a human to correctly identify the intended expressive movements performed on these different structures was tested with 66 users viewing videos of the animated structures and reporting via an online questionnaire. Results show that anger is reliably perceived by observers from animated movements on different structures, while the other emotions are easily misperceived. The physical appearance of the structure has some impact on perception performance, but was not found to be statistically significant in this study. Furthermore, analyzing the participants' responses in the context of the valence-arousal model of emotion shows that the subjects were able to recognize the arousal component of the affective hand movements across all structures.

show abstract

Perception of Emotions in the Hand Movement Quality of Finnish Sign Language

Cited by 23 publications

References 27 publications

The Body Action and Posture Coding System (BAP): Development and Reliability

The Body Action and Posture Coding System (BAP): Development and Reliability

Movement qualities as interaction modality

A study of human performance in recognizing expressive hand movements

Contact Info

Product

Resources

About