Identifying Usability Issues for Personalization During Formative Evaluations: A Comparison of Three Methods

Velsen, Lex van; Geest, Thea van der; Klaassen, Randy

doi:10.1080/10447318.2011.555304

Cited by 10 publications

(4 citation statements)

References 40 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In this early phase of evaluation the focus is on the reported points of improvements only, with the aim to generate redesign input [ 34 ]. Therefore, only the points of improvement are reported in this article.…”

Section: Methodsmentioning

confidence: 99%

“…Therefore, only the points of improvement are reported in this article. These comments were further classified as being critical, serious, or minor using the following definitions [ 34 ]: A critical problem prevented participants from completing tasks or was reported by all participants. A serious problem severely increased task completion time or was reported by ≥ 50 % of the participants.…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Co-creation of an ICT-supported cancer rehabilitation application for resected lung cancer survivors: design and evaluation

Timmerman

Tönis

Weering

et al. 2016

BMC Health Serv Res

120

View full text Add to dashboard Cite

BackgroundLung cancer (LC) patients experience high symptom burden and significant decline of physical fitness and quality of life following lung resection. Good quality of survivorship care post-surgery is essential to optimize recovery and prevent unscheduled healthcare use. The use of Information and Communication Technology (ICT) can improve post-surgery care, as it enables frequent monitoring of health status in daily life, provides timely and personalized feedback to patients and professionals, and improves accessibility to rehabilitation programs. Despite its promises, implementation of telehealthcare applications is challenging, often hampered by non-acceptance of the developed service by its end-users. A promising approach is to involve the end-users early and continuously during the developmental process through a so-called user-centred design approach. The aim of this article is to report on this process of co-creation and evaluation of a multimodal ICT-supported cancer rehabilitation program with and for lung cancer patients treated with lung resection and their healthcare professionals (HCPs).MethodsA user-centered design approach was used. Through semi-structured interviews (n = 10 LC patients and 6 HCPs), focus groups (n = 5 HCPs), and scenarios (n = 5 HCPs), user needs and requirements were elicited. Semi-structured interviews and the System Usability Scale (SUS) were used to evaluate usability of the telehealthcare application with 7 LC patients and 10 HCPs.ResultsThe developed application consists of: 1) self-monitoring of symptoms and physical activity using on-body sensors and a smartphone, and 2) a web based physical exercise program. 71 % of LC patients and 78 % of HCPs were willing to use the application as part of lung cancer treatment. Accessibility of data via electronic patient records was essential for HCPs. LC patients regarded a positive attitude of the HCP towards the application essential. Overall, the usability (SUS median score = 70, range 35–95) was rated acceptable.ConclusionsA telehealthcare application that facilitates symptom monitoring and physical fitness training is considered a useful tool to further improve recovery following surgery of resected lung cancer (LC) patients. Involvement of end users in the design process appears to be necessary to optimize chances of adoption, compliance and implementation of telemedicine.

show abstract

Section: Methodsmentioning

confidence: 99%

Section: Methodsmentioning

confidence: 99%

Co-creation of an ICT-supported cancer rehabilitation application for resected lung cancer survivors: design and evaluation

Timmerman

Tönis

Weering

et al. 2016

BMC Health Serv Res

120

View full text Add to dashboard Cite

show abstract

“…The researchers discussed discrepancies and created a final overview; 5) The first researcher awarded each usability issue with a severity score (minor, serious, or critical), following a procedure from [36].…”

Section: Qualitative Analysismentioning

confidence: 99%

Assessing usability of eHealth technology: A comparison of usability benchmarking instruments

Broekhuis

Velsen

Hermens

2019

International Journal of Medical Informatics

View full text Add to dashboard Cite

“…A rehabilitation physician assessed whether or not the physical exercises that were performed during the test were done correctly. Based upon van Velsen et al [42], issues were provided a severity rating by means of the following rules:…”

Section: Discussionmentioning

confidence: 99%

Using socially assistive robots for monitoring and preventing frailty among older adults: a study on usability and user experience challenges

et al. 2019

Self Cite

View full text Add to dashboard Cite

Socially assistive robots can play an important role in the monitoring and training of health of older adults. But before their benefits can be reaped, proper usability and a positive user experience need to be ensured. In this study, we tested the usability and user experience of a socially assistive robot (the NAO humanoid robot) to monitor and train the health of frail older adults. They were asked to complete a set of health monitoring and physical training tasks, once provided by the NAO robot, and once provided by a Tablet PC application (as a reference technology). After using each technology, they completed the System Usability Scale for usability, and a set of rating scales for perceived usefulness, enjoyment, and control. Finally, we questioned the participants' preference for one of the technologies. All interactions were recorded on video and scrutinized for usability issues. Twenty older adults participated. They awarded both technologies 'average' usability scores. Perceived usefulness and enjoyment were rated as very positive for both modalities; control was scored positively. Main usability issues for NAO for these tasks were related to speech interaction (e.g., NAO's limited speech library, NAO's difficulty to cope with Dutch dialect), older adults' difficulties with taking their proper role in human-robot interaction, and a lack of affordances of NAO. Seven participants preferred NAO: it was easier to use and more personal. Social robots have the potential to monitor and train the health of frail older adults, but some critical usability challenges need to be overcome first.

show abstract

Identifying Usability Issues for Personalization During Formative Evaluations: A Comparison of Three Methods

Cited by 10 publications

References 40 publications

Co-creation of an ICT-supported cancer rehabilitation application for resected lung cancer survivors: design and evaluation

Co-creation of an ICT-supported cancer rehabilitation application for resected lung cancer survivors: design and evaluation

Assessing usability of eHealth technology: A comparison of usability benchmarking instruments

Using socially assistive robots for monitoring and preventing frailty among older adults: a study on usability and user experience challenges

Contact Info

Product

Resources

About