Manual versus automated qualitative usability assessment of interactive systems

Sagar, Kalpna; Gupta, Deepak; Sangaiah, Arun Kumar

doi:10.1002/cpe.5091

Cited by 3 publications

(2 citation statements)

References 48 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Still others address the use of tools to evaluate the usability of particular applications like mobile applications [33], specific domain languages [58], or application programming interfaces (APIs) [57]. For example, Sagar et al compared the results of tool-based and end-user usability evaluation of the top fifty academic websites [65].…”

Section: Related Workmentioning

confidence: 99%

Impact of usability mechanisms: An experiment on efficiency, effectiveness and user satisfaction

Ferreira

Acuña

Dieste

et al. 2020

Information and Software Technology

View full text Add to dashboard Cite

This is a PDF file of an article that has undergone enhancements after acceptance, such as the addition of a cover page and metadata, and formatting for readability, but it is not yet the definitive version of record. This version will undergo additional copyediting, typesetting and review before it is published in its final form, but we are providing this version to give early visibility of the article. Please note that, during the production process, errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

show abstract

Section: Related Workmentioning

confidence: 99%

Impact of usability mechanisms: An experiment on efficiency, effectiveness and user satisfaction

Ferreira

Acuña

Dieste

et al. 2020

Information and Software Technology

View full text Add to dashboard Cite

show abstract

“…The former study how to implement or evaluate usability characteristics in the different software development lifecycle activities [12], [25], [26]. The latter focus on validating the usability of products, technologies and applications [27]- [30]. Below, we describe empirical studies on usability, making a distinction between single experiments and families of experiments.…”

Section: Related Workmentioning

confidence: 99%

Impact of Usability Mechanisms: A Family of Experiments on Efficiency, Effectiveness and User Satisfaction

Ferreira

Rodríguez²,

Santos

et al. 2023

IIEEE Trans. Software Eng.

View full text Add to dashboard Cite

The usability software quality characteristic aims to improve system user performance. In a previous study, we found evidence of the impact of a set of usability features from the viewpoint of users in terms of efficiency, effectiveness and satisfaction. However, the impact level appears to depend on the usability feature and suggest priorities with respect to their implementation depending on how they promote user performance. Objectives: We use a family of three experiments to increase the precision and generalization of the results in the baseline experiment and provide findings regarding the impact on user performance of the Abort Operation, Progress Feedback and Preferences usability mechanisms. Method: We conduct two replications of the baseline experiment in academic settings. We analyse the data of 366 experimental subjects and apply aggregation (meta-analysis) procedures. Results: We find that the Abort Operation and Preferences usability mechanisms appear to improve system usability a great deal with respect to efficiency, effectiveness and user satisfaction. Conclusions: We find that the family of experiments further corroborates the results of the baseline experiment. Most of the results are statistically significant, and, because of the large number of experimental subjects, the evidence that we gathered in the replications is sufficient to outweigh other experiments.

show abstract

Exploring the Effect of Tasks Difficulty on Usability Scores of Academic Websites Computed Using SUS

Sagar

Saha

2020

Advances in Intelligent Systems and Computing

Self Cite

View full text Add to dashboard Cite

The prime objective of this study is to empirically determine the effect of tasks difficulty on usability scores computed using the System Usability Scale (SUS). Usability dataset is created by involving twelve end-users that evaluate the usability of 15 academic websites in a laboratory. Each end-user performs three subsets of six tasks whose difficulty is varying from easy to impossible under six different categories. Results are obtained after applying two statistical techniques, one is ANOVA and other is the correlation with regression. Results show that the SUS scores vary from higher to lower values when end-users conduct usability assessment with a list of easy, moderate, and impossible tasks on academic websites. The results also indicate the effect of tasks difficulty on the correlation between the SUS scores and task success rate. Though, the strength of the correlation is strong with each subset of tasks but it varies that depends on the nature of the tasks.

show abstract

Manual versus automated qualitative usability assessment of interactive systems

Cited by 3 publications

References 48 publications

Impact of usability mechanisms: An experiment on efficiency, effectiveness and user satisfaction

Impact of usability mechanisms: An experiment on efficiency, effectiveness and user satisfaction

Impact of Usability Mechanisms: A Family of Experiments on Efficiency, Effectiveness and User Satisfaction

Exploring the Effect of Tasks Difficulty on Usability Scores of Academic Websites Computed Using SUS

Contact Info

Product

Resources

About