A Comparison of Synchronous and Asynchronous Remote Usability Testing Methods

Alhadreti, Obead

doi:10.1080/10447318.2021.1938391

Cited by 15 publications

(14 citation statements)

References 19 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Usability evaluation methods (UEMs) refer to the techniques evaluators use to identify usability problems that need to be addressed through the design and redesign of a system (Nyang'or, De Villiers, & Ssemugabi, 2013). UEMs can be divided into three categories, namely user testing (UT), inspection and inquiry (Alghamdi, Al-badi, Alroobaea, & Mayhew, 2013).…”

Section: Usability Evaluation Methodsmentioning

confidence: 99%

Section: Usability Evaluation Methodsmentioning

confidence: 99%

“…▪ In employing a UT method, users are given specific tasks involving the use of the system, to test to what extent the system supports them in completing their tasks (Alghamdi et al, 2013). ▪ Usability inspection (also known as expert-based evaluation) examines usability-related problems from the system's user interface (Alghamdi et al, 2013). Such inspection methods include cognitive and pluralistic walkthroughs, heuristic evaluation (HE), feature inspection and perspective-based evaluation (Usability Evaluation Website, 2012).…”

Section: Usability Evaluation Methodsmentioning

confidence: 99%

See 2 more Smart Citations

Usability Requirements for Learning Management Systems in Open Distance Electronic Learning Environments: Considering Lecturers’ Views on Students’ Needs

Lehong

Biljon

Sanders

2022

International Journal of Human–Computer Interaction

View full text Add to dashboard Cite

The 2020 health pandemic brought renewed interest in using learning management systems (LMSs) to deliver educational services as routinely done in open distance and electronic learning (ODeL) environments. LMSs usability has been researched but the lecturers' perspective remains unexplored. The purpose of this study was to propose validated usability guidelines for an LMS in an ODeL context. A set of usability requirements was abstracted from the literature and used as the basis for a heuristic evaluation (HE) of the institution's LMS. These results of the HE was triangulated with three other usability evaluation methods including usability testing with eye tracking, a post-test system usability scale (SUS) questionnaire and interviews. The primary contribution is the validated usability requirements for ODeL LMSs based on the lecturers' perspective. A secondary contribution is the triangulation approach to evaluating the guidelines in situ which confirmed HE as a valid evaluation method for LMSs.

show abstract

Section: Usability Evaluation Methodsmentioning

confidence: 99%

Section: Usability Evaluation Methodsmentioning

confidence: 99%

Section: Usability Evaluation Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Usability Requirements for Learning Management Systems in Open Distance Electronic Learning Environments: Considering Lecturers’ Views on Students’ Needs

Lehong

Biljon

Sanders

2022

International Journal of Human–Computer Interaction

View full text Add to dashboard Cite

show abstract

“…The system automatically initializes a tracking window before the face tracking starts, and assigns a Camshift tracker to each face in the video surveillance to realize multiple face recognition. Through many system function tests, it is found that the Camshift algorithm can have a good tracking effect and robustness in practical application, even for large Angle deflection or position change of face [51][52][53][54]. Even if there is a complex situation of people in and out of the area or face interleave, the system can normally start the face detection program and constantly correct the face tracking window, the system can quickly obtain all the face areas in each frame of the image, and is more rapid and stable than the face detection frame by frame.…”

Section: Face Recognition Training Processmentioning

confidence: 99%

Design and Study of Urban Rail Transit Security System Based on Face Recognition Technology

Guo

Xiao

Alroobaea

et al. 2022

IJCAI

View full text Add to dashboard Cite

In the modern world, it is difficult to prevent terrorism due to the relatively closed environment, dense personnel, large passenger flow, long line and wide coverage of urban rail transit. Identity recognition is a core element of security. The design and study of an urban rail transit security system based on face recognition technology are proposed in this paper. Through the study on the face recognition algorithm of intelligent security systems in urban rail transit, the related introduction of face recognition technology is done. The analysis of the main mode of face recognition is carried out utilizing the practical application design ideas. The results by experimental analysis show that if FAR is set to a very low range (such as 0.1% or even 0.01%) meanwhile FRR can reach a very low level (such as less than 1%). Such a system has practical value and otherwise, it may face a large number of passenger affairs and complaints to be handled. When FAR is set to 0.1% and N is 1.6 million, FRR can reach 2.1%. However, according to the test, when the picture quality deteriorates (during image captured by a webcam), the FRR will increase by 2 to 3 times. If a Webcam is used for recognition in Mugshot, the lowest FRR of the three top algorithms is only 5.21%.Povzetek: Tehnologija prepoznavanja obrazov je uporabljena za nadzor osumljencev -teroristov na vlakih.

show abstract

“…Remote usability testing was introduced 20 years ago as a means of conducting usability assessments of participants or users who were in separate locations or separated by time from the researchers or practitioners [ 4 , 5 ]. Since that time, a range of web conferencing platforms have emerged, and an array of features and functions are now available that can advance remote usability testing (eg, Microsoft Teams, Zoom, Skype, and Cisco Webex).…”

Section: Introductionmentioning

confidence: 99%

Remote Moderator and Observer Experiences and Decision-making During Usability Testing of a Web-Based Empathy Training Portal: Content Analysis

Lobchuk¹,

Bathi²,

Ademeyo³

et al. 2022

JMIR Form Res

View full text Add to dashboard Cite

Background COVID-19 restrictions severely curtailed empirical endeavors that involved in-person interaction, such as usability testing sessions for technology development. Researchers and developers found themselves using web-based moderation for usability testing. Skilled remote moderators and observers are fundamental in this approach. However, to date, more empirical work is needed that captures the perceptions and support needs of moderators and observers in testing situations. Objective The aim of this paper was to identify remote moderator and observer participant experiences and their use of certain tools to capture feedback of users as they interact with the web browser application. Methods This research is part of a broader study on an educational web browser application for nursing students to learn perspective taking and enhance their perceptual understanding of a dialogue partner’s thoughts and feelings. The broader study used a quantitative and think-aloud qualitative problem-discovery usability study design. This case study explored written accounts of the remote moderator and observer participants regarding their roles, experiences, and reactions to the testing protocol and their suggestions for improved techniques and strategies for conducting remote usability testing. Content analysis was used to analyze participants’ experiences in the usability testing sessions. Results We collected data from 1 remote moderator and 2 remote observers. Five themes were identified: dealing with personal stressors, dealing with user anxiety, maintaining social presence, ethical response to the study protocol, and communication during sessions. The participants offered recommendations for the design of future remote testing activities as well as evidence-informed training materials for usability project personnel. Conclusions This study’s findings contribute to a growing body of endeavors to understand human-computer interaction and its impact on remote moderator and observer roles. As technology rapidly advances, more remote usability testing will occur where the knowledge gleaned in this study can have an impact. Recommendations based on moderator and observer participant perspectives identify the need for more evidence-informed training materials for their roles that focus on web-based interpersonal communication skills, execution of user testing protocols, troubleshooting technology and test user issues, proficiency in web conferencing platforms, behavior analysis and feedback technologies, and time management.

show abstract

A Comparison of Synchronous and Asynchronous Remote Usability Testing Methods

Cited by 15 publications

References 19 publications

Usability Requirements for Learning Management Systems in Open Distance Electronic Learning Environments: Considering Lecturers’ Views on Students’ Needs

Usability Requirements for Learning Management Systems in Open Distance Electronic Learning Environments: Considering Lecturers’ Views on Students’ Needs

Design and Study of Urban Rail Transit Security System Based on Face Recognition Technology

Remote Moderator and Observer Experiences and Decision-making During Usability Testing of a Web-Based Empathy Training Portal: Content Analysis

Contact Info

Product

Resources

About