Automatic Depression Detection via Learning and Fusing Features from Visual Cues

Abstract

Depression is one of the most prevalent mental disorders, which seriously affects one's life. Traditional depression diagnostics commonly depends on rating with scales, which can be labor-intensive and subjective. In this context, Automatic Depression Detection (ADD) has been attracting more attention for its low cost and objectivity. ADD systems are able to detect depression automatically from some medical records, like video sequences. However, it remains challenging to effectively extract depression-specific information from long sequences, thereby hindering a satisfying accuracy. In this paper, we propose a novel ADD method via learning and fusing features from visual cues. Specifically, we firstly construct Temporal Dilated Convolutional Network (TDCN), in which multiple Dilated Convolution Blocks (DCB) are designed and stacked, to learn the long-range temporal information from sequences. Then, the Feature-Wise Attention (FWA) module is adopted to fuse different features extracted from TDCNs. The module learns to assign weights for the feature channels, aiming to better incorporate different kinds of visual features and further enhance the detection accuracy. Our method achieves the state-of-the-art performance on the DAIC WOZ dataset compared to other visual-feature-based methods, showing its effectiveness.

Multi-modal Depression Estimation based on Sub-attentional Fusion

“…Salimath et al [47] proposed a metric to quantify the depression severity by utilizing negative sentences. Visual cues, which are mainly extracted from facial key points [7,23,25,44,64] or raw video data [1,3,41,42], also serve for depression estimation by capturing slight facial expression changes. Facial Action Units (FAUs), facial landmarks, head pose and gaze direction are utilized as the CNN input for visual data based approach [16].…”