Usability evaluation methods

Kock, Estelle de; Biljon, Judy van; Pretorius, Marco

doi:10.1145/1632149.1632166

Cited by 34 publications

(31 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Notably there is a large difference between the highest Figure 2: Global usability score global score of 58.9 and the lowest of 42.9 for Global (overall usability). This supports earlier findings on the importance of selecting appropriate experts and monitoring the differences in evaluation scores to ensure valid feedback [39]. In this case the HE results are triangulated with the survey results to mitigate individual evaluators influence.…”

Section: Heuristic Evaluationsupporting

confidence: 84%

“…Heuristic evaluation involves a small number of experts inspecting the system, and evaluating the user interface against a list of recognized usability principles, named the heuristics [38]. De Kock, van Biljon & Pretorius [39] highlight the advantages of this evaluation method as being inexpensive, intuitive and relatively easy to implement. Additional factors that were taken into consideration for selecting heuristic evaluation were a pragmatic research strategy and the appropriateness of heuristic evaluation within the specific context.…”

Section: Usability Evaluation Methods Usedmentioning

confidence: 99%

“…The ISO9241 standard and the seminal texts on usability informs guidelines that tend to focus on specific application areas, i.e., commerce [37] or learning [39], but none could be found for BI. From the sources mentioned above the following keywords were extracted as a basis for usability criteria: User language, Visible instructions, Use of metaphors, Self-descriptiveness, Flexibility, Responsiveness, Controllability, Learnability, Efficiency, Familiarity, Predictability, Consistency, Error tolerance, Explore-able interface, Visible navigation, Customization, Task migration, Synthesizability, Help, Documentation, Satisfaction, System speed, System status display, Memorability, Colour blindness, Default values.…”

Section: Usability Evaluation Criteria For Bimentioning

confidence: 99%

See 2 more Smart Citations

Usability Evaluation for Business Intelligence Applications: A User Support Perspective

Jooste¹,

Biljon²,

Mentz³

2014

SACJ

View full text Add to dashboard Cite

Business Intelligence (BI) applications provide business information to drive decision support. Usability is one of the factors determining the optimal use and eventual benefit derived from BI applications. The documented need for more BI usability research together with the practical necessity for BI evaluation guidelines in the mining industry provides the rationale for this study. The purpose of the study was to investigate the usability evaluation of BI applications in the context of a coal mining organization. The research is guided by the question: How can existing usability criteria be customized to evaluate the usability of BI applications. The research design included user observation, heuristic evaluation and a survey. Based on observations made during user support on a BI application used at a coal mining organization a log of usability issues was compiled. The usability issues extracted from this log was compared and contrasted with general usability criteria from literature to synthesize an initial set of BI usability evaluation criteria. These criteria were used as the basis for a heuristic evaluation of the BI application used at the coal mining organization. The same BI application was also evaluated using the Software Usability Measurement Inventory (SUMI) standardized questionnaire. The results from the two evaluations were triangulated and then compared with the BI user issues again to contextualize the findings and synthesize a validated and refined set of criteria. The main contribution of the study is the usability evaluation criteria for BI applications presented as guidelines. These guidelines deviate from existing evaluation guidelines in the emphasis on information architecture, learnability and operability.

show abstract

Section: Heuristic Evaluationsupporting

confidence: 84%

Section: Usability Evaluation Methods Usedmentioning

confidence: 99%

Section: Usability Evaluation Criteria For Bimentioning

confidence: 99%

See 1 more Smart Citation

Usability Evaluation for Business Intelligence Applications: A User Support Perspective

Jooste¹,

Biljon²,

Mentz³

2014

SACJ

View full text Add to dashboard Cite

show abstract

“…In heuristic evaluation, evaluators inspect a user interface against a guideline to identify usability problems that violate any items on the guideline [36]. Our list of quality attributes and UI features (cf.…”

Section: Research and Technology Challengesmentioning

confidence: 99%

User interfaces for semantic authoring of textual content: A systematic literature review

Khalili

Auer

2013

Journal of Web Semantics

View full text Add to dashboard Cite

“…These measures lead to a fine-grained analysis thus generating more refined conclusions. Although there are many eye tracking studies related to evaluating user interfaces [3,9,10,14,19,20], there are very few studies done by few researchers on how programmers read and comprehend source code [1,2,8,25]. To bridge this gap, we conducted an eye-tracking replication of Binkley et al's [4] study since the topic lends itself well to eye tracking analysis.…”

Section: Research Questionsmentioning

confidence: 99%

An Eye Tracking Study on camelCase and under_score Identifier Styles

Sharif

Maletic

2010

2010 IEEE 18th International Conference on Program Comprehension

110

View full text Add to dashboard Cite

Abstract-An empirical study to determine if identifiernaming conventions (i.e., camelCase and under_score) affect code comprehension is presented. An eye tracker is used to capture quantitative data from human subjects during an experiment. The intent of this study is to replicate a previous study published at ICPC 2009 (Binkley et al.) that used a timed response test method to acquire data. The use of eye-tracking equipment gives additional insight and overcomes some limitations of traditional data gathering techniques. Similarities and differences between the two studies are discussed. One main difference is that subjects were trained mainly in the underscore style and were all programmers. While results indicate no difference in accuracy between the two styles, subjects recognize identifiers in the underscore style more quickly.

show abstract

Usability evaluation methods

Cited by 34 publications

References 16 publications

Usability Evaluation for Business Intelligence Applications: A User Support Perspective

Usability Evaluation for Business Intelligence Applications: A User Support Perspective

User interfaces for semantic authoring of textual content: A systematic literature review

An Eye Tracking Study on camelCase and under_score Identifier Styles

Contact Info

Product

Resources

About