European Portuguese Version of the User Satisfaction Evaluation Questionnaire (USEQ): Transcultural Adaptation and Validation Study

Abstract

Background Wearable activity trackers have the potential to encourage users to adopt healthier lifestyles by tracking daily health information. However, usability is a critical factor in technology adoption. Older adults may be more resistant to accepting novel technologies. Understanding the difficulties that older adults face when using activity trackers may be useful for implementing strategies to promote their use. Objective The purpose of this study was to conduct a transcultural adaptation of the User Satisfaction Evaluation Questionnaire (USEQ) into European Portuguese and validate the adapted questionnaire. Additionally, we aimed to provide information about older adults’ satisfaction regarding the use of an activity tracker (Xiaomi Mi Band 2). Methods The USEQ was translated following internationally accepted guidelines. The psychometric evaluation of the final version of the translated USEQ was assessed based on structural validity using exploratory and confirmatory factor analyses. Construct validity was examined using divergent and discriminant validity analysis, and internal consistency was evaluated using Cronbach α and McDonald ω coefficients. Results A total of 110 older adults completed the questionnaire. Confirmatory factor analysis supported the conceptual unidimensionality of the USEQ (χ24=7.313, P=.12, comparative fit index=0.973, Tucker-Lewis index=0.931, goodness of fit index=0.977, root mean square error of approximation=0.087, standardized root mean square residual=0.038). The internal consistency showed acceptable reliability (Cronbach α=.677, McDonald ω=0.722). Overall, 90% of the participants reported excellent satisfaction with the Xiaomi Mi Band 2. Conclusions The findings support the use of this translated USEQ as a valid and reliable tool for measuring user satisfaction with wearable activity trackers in older adults, with psychometric properties consistent with the original version.

Usability, Acceptability, and Satisfaction of a Wearable Activity Tracker in Older Adults: Observational Study in a Real-Life Context in Northern Portugal

“…As reported by Domingos et al [36], the CFA supported the conceptual unidimensionality of the USEQ (χ 2 4 =1.83, P=.12, χ 2 /df=1.83; CFI=0.973, TLI=0.931, GFI=0.977, RMSEA=0.087, SRMR=0.038). Furthermore, the CFA for the SUS showed satisfactory values for the following indexes: CFI=0.816, GFI=0.928, and SRMR=0.074.…”

“…Regarding internal consistency, for the SUS questionnaire reliability was calculated only with items included in path analysis (SUS 2, SUS 4, SUS 6, SUS 7, SUS 8, SUS 10). Moreover, the USEQ showed acceptable reliability (Cronbach α=.677; McDonald ω=0.722), as reported by Domingos et al [36]. The McDonald ω coefficients showed acceptable values for the SUS and USEQ questionnaires ranging from 0.712 to 0.722, respectively.…”

“…The User Satisfaction Evaluation Questionnaire (USEQ) was initially designed by Gil-Gómez et al [35] to evaluate the satisfaction of the users with virtual rehabilitation systems. Recently, the USEQ was adapted and validated into European Portuguese by Domingos et al [36] to evaluate an activity tracker (Xiaomi Mi Band 2) in older adults, showing psychometric properties consistent with the original version.…”

“…Upon completing the usage period, participants were also asked to provide information about their user experience. The TAM 3 [19] was used to collect information about technology acceptance, the SUS [25] for perceived usability, and the USEQ [35,36] for user satisfaction.…”

“…The negative item subtracts the numerical value of the response from 6 and then adds this result to the total score. The USEQ score is evaluated using the following classification: poor (0-5), fair (5-10), good (10)(11)(12)(13)(14)(15), very good (15)(16)(17)(18)(19)(20), or excellent (20)(21)(22)(23)(24)(25) satisfaction [35,36].…”