Time to act mature—Gearing eHealth evaluations towards technology readiness levels

Abstract

It is challenging to design a proper eHealth evaluation. In our opinion, the evaluation of eHealth should be a continuous process, wherein increasingly mature versions of the technology are put to the test. In this article, we present a model for continuous eHealth evaluation, geared towards technology maturity. Technology maturity can be determined best via Technology Readiness Levels, of which there are nine, divided into three phases: the research, development, and deployment phases. For each phase, we list and discuss applicable activities and outcomes on the end-user, clinical, and societal front. Instead of focusing on a single perspective, we recommend to blend the end-user, health and societal perspective. With this article we aim to contribute to the methodological debate on how to create the optimal eHealth evaluation design.

WtsWrng Interim Comparative Effectiveness Evaluation and Description of the Challenges to Develop, Assess, and Introduce This Novel Digital Application in a Traditional Health System

“…How to assess DAs nowadays is a matter of research. There are more than 40 assessment frameworks for DAs in an advanced stage of development [ 65 ], 21 for eHealth [ 66 ], and some author suggestions for types of studies recommended depending on the maturity of the technology [ 48 ]. Nevertheless, we did not find any internationally accepted high-quality standard guidance to be used in the design of the WW study which is in an intermediate stage of development (TRL6, TRL ranges from 1–9, a technology with TRL = 9 means that it is in the market).…”

“…At the time of clinical testing, WW was in a development stage (Technology Readiness Level 6) [ 48 ]. This meant that an agile iterative analysis was necessary, where quick rounds of testing–redesigning–testing were conducted [ 49 ].…”

Development of Smart Clothing to Prevent Pressure Injuries in Bedridden Persons and/or with Severely Impaired Mobility: 4NoPressure Research Protocol

“…The Technology Readiness Level (TRL) will be used throughout the project's 8 distinct phases, considering its importance in ensuring that each phase is clearly defined in terms of objectives and success criteria. During each phase, the TRL will be employed to assess the readiness of the developed technology and to determine whether it is progressing towards the defined project objectives [37][38][39][40][41].…”

“…It is important to note that Human-Centred Design (HCD) should be integrated into all project phases to ensure that the developed technology meets user needs and is technically and economically viable. The integration of HCD and TRL should be clear and constant in all project phases to ensure a successful and satisfactory outcome [37][38][39][40][41]44,45].…”

Level of Technological Maturity of Telemonitoring Systems Focused on Patients with Chronic Kidney Disease Undergoing Peritoneal Dialysis Treatment: A Systematic Literature Review

“…The TRL [26] is a method developed by the National Aeronautics and Space Administration (NASA) in the 1970s as a tool that measures the degree of maturity of a technology. Among the main advantages of using technology maturity levels in ICT projects related to telemonitoring systems are the following: they generate a standardized analysis of the project's status, they allow the identification and management of risks in projects, and they help to classify the proposed work in terms of research, development, and innovation, which contributes to decision-making in terms of funding and project transition between technology maturity levels [26][27][28]. Therefore, this paper analyzes works that propose telemonitoring systems focused on patients with CKD undergoing PD treatment to determine their level of technological maturity based on the NASA TRL framework.…”