Tools for Evaluating the Content, Efficacy, and Usability of Mobile Health Apps According to the Consensus-Based Standards for the Selection of Health Measurement Instruments: Systematic Review

Abstract

Background There are several mobile health (mHealth) apps in mobile app stores. These apps enter the business-to-customer market with limited controls. Both, apps that users use autonomously and those designed to be recommended by practitioners require an end-user validation to minimize the risk of using apps that are ineffective or harmful. Prior studies have reviewed the most relevant aspects in a tool designed for assessing mHealth app quality, and different options have been developed for this purpose. However, the psychometric properties of the mHealth quality measurement tools, that is, the validity and reliability of the tools for their purpose, also need to be studied. The Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN) initiative has developed tools for selecting the most suitable measurement instrument for health outcomes, and one of the main fields of study was their psychometric properties. Objective This study aims to address and psychometrically analyze, following the COSMIN guideline, the quality of the tools that are used to measure the quality of mHealth apps. Methods From February 1, 2019, to December 31, 2019, 2 reviewers searched PubMed and Embase databases, identifying mHealth app quality measurement tools and all the validation studies associated with each of them. For inclusion, the studies had to be meant to validate a tool designed to assess mHealth apps. Studies that used these tools for the assessment of mHealth apps but did not include any psychometric validation were excluded. The measurement tools were analyzed according to the 10 psychometric properties described in the COSMIN guideline. The dimensions and items analyzed in each tool were also analyzed. Results The initial search showed 3372 articles. Only 10 finally met the inclusion criteria and were chosen for analysis in this review, analyzing 8 measurement tools. Of these tools, 4 validated ≥5 psychometric properties defined in the COSMIN guideline. Although some of the tools only measure the usability dimension, other tools provide information such as engagement, esthetics, or functionality. Furthermore, 2 measurement tools, Mobile App Rating Scale and mHealth Apps Usability Questionnaire, have a user version, as well as a professional version. Conclusions The Health Information Technology Usability Evaluation Scale and the Measurement Scales for Perceived Usefulness and Perceived Ease of Use were the most validated tools, but they were very focused on usability. The Mobile App Rating Scale showed a moderate number of validated psychometric properties, measures a significant number of quality dimensions, and has been validated in a large number of mHealth apps, and its use is widespread. It is suggested that the continuation of the validation of this tool in other psychometric properties could provide an appropriate option for evaluating the quality of mHealth apps.

Development and Validation of Technology for Teaching Basic Life Support in Cardio-Respiratory Arrest

“…In this direction, the SBVida Mobile Application was structured based on the recommendations of the American Heart Association and validated by specialists in Intensive Care and Urgency/Emergency [28][29] . As for the usability, it provides information and indicators that guide conducts for the identification of a possible victim in CRA and directs to the CPR procedures until the implementation of more complex conducts in a specialized care unit.…”

Developing an Unstructured Supplementary Service Data-based mobile phone app to provide adolescents with sexual reproductive health information: a human-centered design approach

“…In one setting that evaluated the reliability of a translated SUS assessing mobile apps, the reliability test showed a Cronbach alpha value of 0.85 indicating the SUS is a reliable tool for usability assessment of mobile apps [ 44 ]. The MARS measures a significant number of mobile apps quality dimensions and has also been validated in more mhealth apps [ 45 ].…”

Desarrollo Y Validación De Tecnología Para La Enseñanza Del Soporte Vital Básico en La Parada Cardíaca

“…En esta dirección, la Aplicación Móvil SBVida fue estructurada con base en las recomendaciones de la American Heart Association y validada por especialistas en Cuidados Intensivos y Urgencia/Emergencia [28][29] . En cuanto a la usabilidad, proporciona información e indicadores que orientan las conductas para la identificación de una posible víctima en la PCR y dirige a los procedimientos de RCP hasta la realización de conductas más complejas en una unidad de atención especializada.…”