Previous electrophysiological research on human creative cognition has related creative ideation to increased activity in the alpha band, an effect which mainly reflects increased general attentional demands. Research on alpha unrelated to creativity has revealed different functional roles of the upper (semantic processes) and lower (attentional processes) alpha sub-bands. At the same time, the need to dissect creative thinking into specific cognitive operations, such as, semantic processing, re-representation, or conceptual expansion has become evident. The main aim of the reported study was to test whether increased semantic processing demands linked to creating conceptual re-representations of objects required for evaluating alternate uses modulate activity in the upper and/or lower alpha sub-bands. For this purpose, we performed an alternate use evaluation task (AUeT), in which participants saw word pairs representing common uses, alternate uses, and unrelated word pairs, and evaluated whether a given use was common or uncommon (question 1), and how usable it was (question 2). Such an approach allowed us to examine the time-course of semantic processing involved in evaluating alternate uses. Additionally, the results could be contrasted with event-related potential (ERP) studies on creative language and semantic processing. We assumed that demands related to access and integration of semantic information needed to create a re-representation of objects (alternate uses) would be larger than in the case of common uses, which do not require creating a re-representation. This should be reflected in more activity in the alpha band in response to alternate than common uses, which was observed in the analysis of the upper alpha band over parieto-occipital sites. In the lower alpha band, more activity over the left than right anterior sites was observed for alternate uses, which might reflect increased attentional demands. Additionally, in the ERP analysis, alternate uses evoked larger N400 (400–500 ms) amplitudes than common uses, a pattern that extended to later time windows (500–1,000 ms). Overall, the results indicate increased semantic processing demands in alternate use evaluation, possibly linked to the creation of conceptual re-representations.

Analyzing emotional valence in spontaneous speech remains complex and challenging. We present an acoustic and lexical analysis of emotional valence in spontaneous speech of older adults. Data was collected by recalling autobiographical memories through a word association task. Due to the complex and personal nature of memories, we propose a novel coding scheme for emotional valence. We explore acoustic properties of speech as well as the use of affective words to predict emotional valence expressed in autobiographical memories. Using mixed-effect regression modelling, we compared predictive models based on acoustic information only, lexical information only, or a combination of both. Results show that the combined model accounts for the highest proportion of explained variance, with the acoustic features accounting for a smaller share of the total variance than the lexical features. Several acoustic and lexical features predicted valence. As a first attempt at analyzing spontaneous emotional speech in older adults autobiographical memories, the study provides more insight in which acoustic features can be used to predict valence (automatically) in a more ecologically valid setting.

This paper provides an overview of my PhD project that focuses on recognizing emotions in dementia by analyzing multi-modal expressions in autobiographical memories of older adults with dementia. The project aims for a better understanding how dementia influences emotional expressions and how dementia differs from the normal aging process. For this reason, spontaneous emotions will be elicited in autobiographical memories in two groups of older adults, one with dementia the other without, for comparison. Audio, video and physiological data will be collected at their home resulting in real-life environments. The emotional expressions can then be analyzed by extracting verbal, non-verbal, facial and gestural features from the audio, video and physiological data collected. In addition, a longitudinal study will be conducted with the older adults with dementia to investigate the longitudinal effect of dementia on emotions. A database of the emotional memories of these vulnerable groups will then be developed to contribute to the advancement of technologies for (automatic) multi-modal emotion recognition. The database will then be made available for the research community. Lastly, we will also develop visualization and statistical models to assess multi-modal patterns of emotion expression in these groups.

No abstract

Physical Life Story Books are widely used as part of reminiscence interventions, where people with dementia (PWD) recount their life experiences and memories to family and caregivers supported by pictures. This paper reports the design of a tablet app, Emobook, to facilitate the implementation of Digital Life Story Book workshops in the context of therapeutic day care centres specialized in PWD. Our digital app facilitates not only preparing life stories flexibly based on multimedia but also captures emotional responses associated to each memory. This can bring an opportunity to assess how the disease progresses and rely on mood trackers to provide personalized and more positive future interventions, which remain still unexplored. CCS CONCEPTS• Human-centered computing → User centered design; Participatory design; • Social and professional topics → Sociotechnical systems; Seniors.

We compare and discuss representations in two cognitive architectures aimed at representing and processing complex conceptual (sentence-like) structures. First is the Neural Blackboard Architecture (NBA), which aims to account for representation and processing of complex and combinatorial conceptual structures in the brain. Second is IDyOT (Information Dynamics of Thinking), which derives sentence-like structures by learning statistical sequential regularities over a suitable corpus. Although IDyOT is designed at a level more abstract than the neural, so it is a model of cognitive function, rather than neural processing, there are strong similarities between the composite structures developed in IDyOT and the NBA. We hypothesize that these similarities form the basis of a combined architecture in which the individual strengths of each architecture are integrated. We outline and discuss the characteristics of this combined architecture, emphasizing the representation and processing of conceptual structures.

No abstract