Communication Skills Training Intervention Based on Automated Recognition of Nonverbal Signals

Abstract

There have been promising studies that show a potential of providing social signal feedback to improve communication skills. However, these studies have primarily focused on unimodal methods of feedback. In addition to this, studies do not assess whether skills are maintained after a given time. With a sample size of 22 this paper investigates whether multimodal social signal feedback is an efective method of improving communication in the context of media interviews. A pre-post experimental evaluation of media skills training intervention is presented which compares standard feedback with augmented feedback based on automated recognition of multimodal social signals. Results revealed signifcantly diferent training efects between the two conditions. However, the initial experiment study failed to show signifcant diferences in human judgement of performance. A 6-month follow-up study revealed human judgement ratings were higher for the experiment group. This study suggests that augmented selective multimodal social signal feedback is an efective method for communication skills training. CCS CONCEPTS• Human-centered computing → Human computer interaction (HCI); Empirical studies in HCI.

Nonverbal Communication as a Communication Strategy in Hotel Job Interview: A Narrative Inquiry Study

“…This also employs positive experience for the customer and shapes positive perception toward the services given (Mosa, 2021). Thus, non-verbal communication becomes one of the essential communication competencies to master in business contexts (Ananda et al, 2020;Pereira & Hone, 2021). Since nonverbal cue plays an essential value in communication, companies tend to put nonverbal cue as one of the aspect they value in a job interview.…”