Determining child orientation from overhead video: A multiple kernel learning approach

Manner, Marie D.; Jiang, Ming; Zhao, Qi; Gini, Maria; Elison, Jed T.

doi:10.1109/smc.2017.8123169

Cited by 1 publication

(1 citation statement)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A viable option is to use a video camera to record the sessions for later coding. There is an increasing amount of work using cameras as the main sensor placed at a certain distance from the child to automatically recognise their behaviour with computer vision (CV) methods (Dawson et al, 2018; Hashemi et al, 2014, 2015; Manner, Jiang, Zhao, Gini, & Elison, 2017). Additionally, with the advances in ML, there has also been an increasing amount of work studying its application for automatic coding (Abbas, Garberson, Glover, & Wall, 2018; Bone et al, 2015; Chen, Drouhard, Kocielnik, Suh, & Aragon, 2018).…”

Section: Introductionmentioning

confidence: 99%

Towards an automatic coding of observational studies: Coding neurofeedback therapies of children with autism

2020

View full text Add to dashboard Cite

The coding of observational data is commonly used to analyse and evaluate human behaviours. The technique can help researchers inform the design and impact of, for example, an Ubicomp system by studying specific behaviours of interest. There are some tools that can alleviate the burden of observational coding, like those that help to collect and organise data, but can still be error-prone and time-consuming. Moreover, most of these tools lack automation, requiring intense human interaction. In order to mitigate these issues, computer vision (CV) and machine learning (ML) techniques could be used to automate observational coding, but little work has focused on analysing the feasibility of such an approach, with the goal of reducing the total coding time while maintaining accuracy. In this work, we address this question by proposing an automated approach for a real-world case study and compare it to manual coding. The study is composed of 10 videos with an average duration of 17 min each, where the goal is to determine the attention of children with autism that participate in a neurofeedback therapy session. Each video was hand-coded by three human observers to define the ground truth and to measure the manual coding time. Results show that it is feasible to automate the coding of observational behaviours and obtain a noticeable reduction in coding time, but with a slight loss in accuracy. Moreover, we illustrate that the best solution would be a hybrid approach, using a semi-automated system that combines human expertise and

show abstract