Psychological constructs are commonly quantified with closed-ended rating scales, however, recent advances in natural language processing (NLP) have been shown to allow for the quantification of open-ended language responses with unprecedented accuracy. Here, we showed that emotional events analysed by NLP show higher accuracy in categorizing emotional states than rating scales. One group of participants (N = 297) was asked to generate narratives related to four emotions – depression, anxiety, satisfaction, or harmony and to rate them on four standardized rating scales (i.e., PHQ-9, GAD-7, SWLS, and HILS). The second group of participants (N = 400 controls and N = 34 healthcare professionals), read the narratives produced by the first group, summarized them in five descriptive keywords, and rated the narratives on the same four emotional states. The descriptive words were quantified by NLP methods, and machine learning was used to categorize the responses into the corresponding emotional categories. The results showed a substantially more accurate categorization of the narratives based on descriptive words (64 %) than on rating scales (44 %), indicating that semantic measures have significantly higher predictive accuracy than the corresponding four rating scales. In conclusion, our results show that semantic responses can have a higher validity in categorizing narratives of emotions than validated Likert scales.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.