Addressing engagement in technology-based behavioural HIV interventions through paradata metrics

Abstract

Purpose of review The goal of this review was to examine how often researchers report participants’ online engagement using paradata (i.e. intervention usage metrics) when describing the outcomes of online behavioural HIV prevention and care interventions. We also highlight the utility of paradata collection and analysis in future technology-based trials. Recent findings We focused on studies indexed on PubMed and published between January 1, 2016 and March 31, 2017 that reported the development and testing of online behavioural interventions for HIV prevention and/or care. Of the 705 extracted citations, six met study criteria. Summary Only one study reported paradata reflecting participants’ engagement with a technology-based intervention. Researchers should systematically collect and analyze paradata to strengthen the evidence-base for technology-based interventions (do they work?), advance the use of behaviour change theory across modalities and platforms (how/why do they work?), and inform reach and scale-up efforts (for whom do they work?). Researchers may also rely on paradata to examine dose-response relationships due to user engagement, to identify replicable core components linked to behaviour change outcomes, to allocate resources judiciously and drive down development costs, and to pool these metrics for use in future meta-analyses.

Maximizing Digital Interventions for Youth in the Midst of Covid-19: Lessons from the Adolescent Trials Network for HIV Interventions

“…The precise factors that ensure effective engagement in DHIs are still under study [17,18]. However, private sector experts emphasize the importance of an intuitive onboarding experience introducing and educating users on the essential components of the technology, and quickly exposing them to the products' benefits [19].…”

A Multilevel Tailored Web App–Based Intervention for Linking Young Men Who Have Sex With Men to Quality Care (Get Connected): Protocol for a Randomized Controlled Trial

“…We will measure intervention exposure using paradata from the intervention, including counts of user sessions, length of sessions, pages visited, and functions utilized. This information will assist in examining whether intervention dosage influences the overall efficacy of the intervention and in informing the cost analysis and wider implementation and scalability [ 56 ].…”

Reducing HIV Vulnerability Through a Multilevel Life Skills Intervention for Adolescent Men (The iREACH Project): Protocol for a Randomized Controlled Trial

“…We will measure intervention exposure using paradata from the intervention, including counts of user sessions, session lengths, pages visited, and functions utilized [ 54 ]. For the peer mentor component, we will record the number and duration of peer mentor sessions, as well as the domains covered in these sessions.…”