The Development of Complex Digital Health Solutions: Formative Evaluation Combining Different Methodologies

Abstract

BackgroundThe development of digital health solutions for current health care settings requires an understanding of the complexities of the health care system, organizational setting, and stakeholder groups and of the underlying interplay between stakeholders and the technology. The digital health solution was founded on the basis of an information and communication technology platform and point-of-care devices enabling home-based monitoring of disease progression and treatment outcome for patients with rheumatoid arthritis (RA).ObjectiveThe aim of this paper is to describe and discuss the applicability of an iterative evaluation process in guiding the development of a digital health solution as a technical and organizational entity in three different health care systems.MethodsThe formative evaluation comprised the methodologies of contextual understanding, participatory design, and feasibility studies and included patients, healthcare professionals, and hardware and software developers. In total, the evaluation involved 45 patients and 25 health care professionals at 3 clinical sites in Europe.ResultsThe formative evaluation served as ongoing and relevant input to the development process of the digital health solution. Through initial field studies key stakeholder groups were identified and knowledge obtained about the different health care systems, the professional competencies involved in routine RA treatment, the clinics’ working procedures, and the use of communication technologies. A theory-based stakeholder evaluation achieved a multifaceted picture of the ideas and assumptions held by stakeholder groups at the three clinical sites, which also represented the diversity of three different language zones and cultures. Experiences and suggestions from the patients and health care professionals were sought through participatory design processes and real-life testing and actively used for adjusting the visual, conceptual, and practical design of the solution. The learnings captured through these activities aided in forming the solution and in developing a common understanding of the overall vision and aim of this solution. During this process, the 3 participating sites learned from each other’s feed-back with the ensuing multicultural inspiration. Moreover, these efforts also enabled the consortium to identify a ‘tipping point’ during a pilot study, revealing serious challenges and a need for further development of the solution. We achieved valuable learning during the evaluation activities, and the remaining challenges have been clarified more extensively than a single-site development would have discovered. The further obstacles have been defined as has the need to resolve these before designing and conducting a real-life clinical test to assess the outcome from a digital health solution for RA treatment.ConclusionsA formative evaluation process with ongoing involvement of stakeholder groups from 3 different cultures and countries have helped to inform and influence the development of a novel digital health ...

mHealth smoking cessation intervention among high school students: 3-month primary outcome findings from a randomized controlled trial

“…The intervention was based on existing evidence-based practice and included key elements from previous text message-based interventions and Internet-based interventions [23-28, 32, 33]. The intervention was developed using formative methods [34][35][36][37], and behavior change technique analysis [38]. The content of the text messages comprised information about the health risks of smoking, tips on behavior change strategies, and activities.…”

Mobile Apps for Medication Management: Review and Analysis

“…However, there are a limited number of studies that provide detailed characteristics of the currently available solutions [15]. The term electronic health (eHealth) solution is a general term that refers to software, telecommunication, and virtual technology related to health [19]. Some of the earlier studies focused on apps with selected features, such as reminders and other medication adherence strategies [20-22], or on a specific population [23].…”

Utilizing the Advances in Digital Health Solutions to Manage Care in Cancer Patients

“…Digital health solutions involve the use of telecommunication and virtual technology to deliver health care outside the traditional health-care facilities. [8] In the same light, Eggersmann[9] defined eHealth as health services and information delivered or enhanced through the Internet and related technologies.…”