Rethinking Thinking Aloud

Alhadreti, Obead; Mayhew, Pam J.

doi:10.1145/3173574.3173618

Cited by 48 publications

(11 citation statements)

References 25 publications

(34 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…While the Think Aloud technique may not decrease responder burden, it may enable more accurate attribute identification and reconfiguration. Think Aloud data can be obtained according to two methods: concurrent and retrospective [ 28 ]. In the current study, patients were first asked to perform a “warm-up” exercise by doing a Think Aloud task in order to practice and better understand the technique.…”

Section: Methodsmentioning

confidence: 99%

Patients’ preferences for telemedicine versus in-clinic consultation in primary care during the COVID-19 pandemic

et al. 2022

View full text Add to dashboard Cite

Background The Hybrid Patient Care system integrates telehealth and in-clinic consultation. While COVID-19 increased telehealth use, healthcare providers are still seeking the best combination of virtual and in-clinic consultation. Understanding patients’ tele-consultation-related preferences is vital for achieving optimal implementation. The discrete choice experiment (DCE) is the stated preference technique for eliciting individual preferences and is increasingly being used in health-related applications. The study purpose was to evaluate attributes and levels of the DCE regarding patients’ preferences for telemedicine versus traditional, in-clinic consultation in primary care during the COVID-19 pandemic, in order to facilitate successful implementation. Methods A three-phase structure was used in the qualitative stage of the DCE: (1) a literature review and preparation of interview guides; (2) Eight focus group interviews comprised of 26 patients and 33 physicians; and (3) Attribute selection: a ranking exercise among 48 patients. The Think Aloud technique, in which respondents are asked to verbalize their thoughts, was used in the focus groups. Interview data were analyzed by thematic analysis. Results Eight attributes were proposed by the patients in the focus groups. The four most important attributes were then selected in pre-testing, and are described in this study: Availability, time until the appointment, severity of the medical problem, patient-physician relationship, and flexible reception hours. Conclusions This study has a theoretical contribution in post-COVID-19 patients’ preferences in Hybrid Medicine patient care. This provides a foundation to assess the rigors of this stage and provide additional evidence to the limited existing literature on attributes development for DCE patient preferences.

show abstract

Section: Methodsmentioning

confidence: 99%

Patients’ preferences for telemedicine versus in-clinic consultation in primary care during the COVID-19 pandemic

et al. 2022

View full text Add to dashboard Cite

show abstract

“…After completing the eHEALS health literacy questionnaire [39], the participant will be asked to log in to DART. Using an existing or previous musculoskeletal condition to complete the assessment, they will be encouraged to give feedback using the concurrent think-aloud method [40]. This can be repeated for up to 3 different conditions.…”

Section: Data Collectionmentioning

confidence: 99%

Usability Testing of a Digital Assessment Routing Tool: Protocol for an Iterative Convergent Mixed Methods Study

et al. 2021

View full text Add to dashboard Cite

Background Musculoskeletal conditions account for 16% of global disability, resulting in a negative effect on millions of patients and an increasing burden on health care utilization. Digital technologies that improve health care outcomes and efficiency are considered a priority; however, innovations are often inadequately developed and poorly adopted. Further, they are rarely tested with sufficient rigor in clinical trials—the gold standard for clinical proof of efficacy. We have developed a new musculoskeletal Digital Assessment Routing Tool (DART) that allows users to self-assess and be directed to the right care. DART requires usability testing in preparation for clinical trials. Objective This study will use the iterative convergent mixed methods design to assess and mitigate all serious usability issues to optimize user experience and adoption. Using this methodology, we will provide justifiable confidence to progress to full-scale randomized controlled trials when DART is integrated into clinical management pathways. This study protocol will provide a blueprint for future usability studies of mobile health solutions. Methods We will collect qualitative and quantitative data from 20-30 participants aged 18 years and older for 4 months. The exact number of participants recruited will be dependent on the number of iterative cycles required to reach the study end points. Building on previous internal testing and stakeholder involvement, quantitative data collection is defined by the constructs within the ISO 9241-210-2019 standard and the system usability scale, providing a usability score for DART. Guided by the participant responses to quantitative questioning, the researcher will focus the qualitative data collection on specific usability problems. These will then be graded to provide the rationale for further DART system improvements throughout the iterative cycles. Results This study received approval from the Queen Mary University of London Ethics of Research Committee (QMREC2018/48/048) on June 4, 2020. At manuscript submission, study recruitment was on-going, with data collection to be completed and results published in 2021. Conclusions This study will provide evidence concerning mobile health DART system usability and acceptance determining system improvements required to support user adoption and minimize suboptimal system usability as a potential confounder within subsequent noninferiority clinical trials. Success should produce a safe effective system with excellent usability, facilitating quicker and easier patient access to appropriate care while reducing the burden on primary and secondary care musculoskeletal services. This deliberately rigorous approach to mobile health innovation could be used as a guide for other developers of similar apps. International Registered Report Identifier (IRRID) DERR1-10.2196/27205

show abstract

“…In the interview, we first obtained demographic data. We then presented one of the four visualisations (BMono, BColour, RMono, RColour) to the participants and asked them to imagine that the prototypes presented their previous week's activity and think aloud while interpreting the data [4]. Based on what the participants voiced during the think-aloud protocol we then inquired in more detail about aspects such as form, colour and emotions connected to the visualisation.…”

Section: Interview Protocolmentioning

confidence: 99%

Exploring Fitness Tracker Visualisations to Avoid Rumination

Niess

Knaving

Kolb

et al. 2020

22nd International Conference on Human-Computer Interaction With Mobile Devices and Services

View full text Add to dashboard Cite

Fitness trackers encourage users to set goals to improve personal wellbeing, but these goals sometimes remain unmet. Understanding how improved ways of communicating failure to meet fitness goals could help prevent negative thought cycles (rumination) and avoid reduced motivation for physical activity. To address this challenge, we studied how unmet goals can be presented in apps. We designed prototypes that showed unmet fitness goals. Radial and regular bar charts, single-coloured and multicoloured were used in the study. In a survey (n = 165), we compared the four versions and a textual description of the unmet goals. Then, we conducted followup interviews (n = 20) to gain a detailed understanding of the perceptions and feelings evoked by the prototypes. We found that bar graphs offered a significantly better potential for reflection and multicoloured charts triggered significantly more rumination. We contribute in-depth insights into designing systems that use goals and avoid potential negative effects of personal tracking. CCS CONCEPTS • Human-centered computing → Empirical studies in HCI.

show abstract

Rethinking Thinking Aloud

Cited by 48 publications

References 25 publications

Patients’ preferences for telemedicine versus in-clinic consultation in primary care during the COVID-19 pandemic

Patients’ preferences for telemedicine versus in-clinic consultation in primary care during the COVID-19 pandemic

Usability Testing of a Digital Assessment Routing Tool: Protocol for an Iterative Convergent Mixed Methods Study

Exploring Fitness Tracker Visualisations to Avoid Rumination

Contact Info

Product

Resources

About