We study a class of Hopfield models where the memories are represented by a mixture of Gaussian and binary variables and the neurons are Ising spins. We study the properties of this family of models as the relative weight of the two kinds of variables in the patterns varies. We quantitatively determine how the retrieval phase squeezes toward zero as the memory patterns contain a larger fraction of mismatched variables. As the memory is purely Gaussian retrieval is lost for any positive storage capacity. It is shown that this comes about because of the spherical symmetry of the free energy in the Gaussian case. Introducing two different memory pattern overlaps between spin configurations and each contribution to the pattern from the two kinds of variables one can observe that the Gaussian parts of the patterns act as a noise, making retrieval more difficult. The basins of attraction of the states, the accuracy of the retrieval and the storage capacity are studied by means of Monte Carlo numerical simulations. We uncover that even in the limit where the network capacity shrinks to zero, the (few) retrieval states maintain a large basin of attraction and large overlaps with the mismatched patterns. So the network can be used for retrieval, but with a very small capacity.

Communication can be defined as the understanding and exchanging of meaningful messages. The role of communication is central to the lives of human beings as, everyday, we use language to interact with the world around us. Linguistic skills play a fundamental role in this scenario and Language Disorders (LD) are impairments that limit the processing of linguistic information. Early and accurate identification of LD is thus essential to promote lifelong learning and well-being. From an evolutionary perspective, some human language constructs evolved from an ancestral motor system and share the same neural pathways in the Broca's area of the brain. This suggests a correlation between action and language. If such a relationship is well established and reliable, it would be possible to use the former as a marker of the latter. The hypothesis of our work, in a nutshell, is that movement can be a predictor of language. To study this correlation, we developed C(H)o(L)ordination, a Mixed Reality (MR) application for HoloLens 2. The application offers several activities based on visual stimuli involving motor movements, which tap on the same skills needed to perform some language tasks. We performed an exploratory study with N=22 users to test the application usability and user experience. The results suggest that C(H)o(L)ordination is a usable and powerful tool to gather insights on the ongoing debate about language evolution and language disorders.

Cognitive impairment is a condition that results in a person's inability to remember, learn, concentrate or make decisions that affect his/her everyday life. The assessment of these deficits is usually performed using standardized paper and pencil or computerized tests within a controlled clinical setting. Many traditionally designed tools show only low to moderate levels of ecological validity, limiting the reliability of the collected measures. The proposed system adapts existing screening tests within an immersive virtual reality environment with 360°video, recreating a familiar setting for the patient. This faithful reproduction of everyday environments and situations can enhance the ecological validity of the assessment procedure while maintaining a standardized stimuli delivery, all in a controlled and safe setting. As a computerized system, virtual reality technology allows an error-free computation of the test scores, here collected by means of accuracy for each task. The system involves many technologies aimed at capturing any kind of user input provided by the patient. Additionally, using a visor with integrated eye-tracker sensor, the system can register the visual exploration pattern adopted by the patient during the task execution, providing information concerning the attentional and visuo-spatial functioning which are not obtainable using traditional assessment procedures. Finally, the results of an exploratory study that was conducted with 11 users on the reliability and usability of the system are presented.

Cognitive rigidity and behavioral and communication problems are the most common symptoms that characterize Autism Spectrum Disorder (ASD). In fact, people with ASD face complications in everyday life, from interacting with other persons to being autonomous in the most ordinary daily tasks. To overcome these limitations and improve their quality of life, we developed 5A. 5A exploits cutting-edge technologies such as Virtual Reality (VR), Augmented Reality (AR), and Conversational Agents (CA), combining smartphones and wearable headsets to offer new forms of intervention to persons with ASD. Virtual reality experiences enable learning common tasks, such as using public transport, through simulation in a safe environment. When people are in similar reallife situations, AR can help them generalize the skills they have learned in VR by overlaying interactive media assets on top of the view of the physical world around them. A customizable conversational assistant provides individualized prompts and feedback in both VR and AR to provide maximum user support. CCS CONCEPTS• Human-centered computing → Virtual reality; Mixed / augmented reality.

No abstract