No need to read: Developing a pictorial single-item scale for measuring perceived usability

Abstract

To facilitate the measurement of perceived usability in product evaluation, we have developed a oneitem pictorial scale called PSIUS (Pictorial Single-Item Usability Scale), which aims to measure the satisfaction component of the usability construct. This bipolar scale consists of three main visual elements: satisfaction with the system, emotions experienced during system use and system to be evaluated. Employing a user-centred iterative design process, the scale was tested in two validation studies (N=60; N=38) using student participants. Sensitivity, convergent validity, divergent validity and criterion-related validity of the scale were determined. The results showed that satisfactory convergent validity was achieved, with the pictorial scale showing strong correlations with sum scores of established usability scales such as the System Usability Scale (SUS) and the Post Study System Usability Questionnaire (PSSUQ). The other validity coefficients also showed overall positive results, suggesting that the development of the pictorial scale may be a promising endeavour. The PSIUS represents an initial attempt to provide a nonverbal approach to the summative evaluation of technical systems.

Standardized Questionnaires for User Experience Evaluation: A Systematic Literature Review

“…AttrakDiff, UEQ, and meCUE are the three most recognized questionnaires for UX evaluation. This is stated in studies such as those presented by Lallemand et al [5], Baumgartner et al [6], Forster et al [7] and Klammer et al [8], and it is also reaffirmed in a preliminary study conducted by us in October 2018, prior to this SLR. In the mentioned papers [5][6][7][8], the three questionnaires are described and cited as the recognized scales for UX evaluation.…”

“…This is stated in studies such as those presented by Lallemand et al [5], Baumgartner et al [6], Forster et al [7] and Klammer et al [8], and it is also reaffirmed in a preliminary study conducted by us in October 2018, prior to this SLR. In the mentioned papers [5][6][7][8], the three questionnaires are described and cited as the recognized scales for UX evaluation. For example, Forster et al [7] differentiate UX from the three other constructs Usability, Acceptance, and Trust, and for each of these constructs the authors identify the following standardized questionnaires: AttrakDiff, UEQ, and meCUE for UX, SUS and PSSUQ for Usability, UTAUT and TAM for Acceptance, and ATS for Trust.…”

“…This paper also describes the mechanics of using the questionnaires according to the planning phases, the application of the questionnaire, the analysis, and the presentation of results. For their part, the questionnaires AttrakDiff, UEQ, and meCUE are listed in [6] as the standardized questionnaires for UX evaluation, and the difference between these three questionnaires for UX from Usability evaluation questionnaires is also explained. For their part, in [8], the three standardized questionnaires are cited as the validated instruments for measuring UX.…”

Pictorial System Usability Scale (P-SUS)

“…A broad choice of instruments assessing the subjective experience of users interacting with technical devices is available (for an overview, see [4]), differing considerably with regard to their scope, detail, and length. With regard to the scope of measurement, it can be distinguished between instruments that assess exclusively usability as a subjective aitude towards the interaction with a system and others that open the scope towards the evaluation of user experience.…”

“…ese instruments are exclusively dedicated to the measurement of emotion or mood, such as SAM (Self Assessment Manikin; [7]), PREMO (Product Emotion Measurement Tool; [16]), PAM (Pick-A-Mood; [18]), LEMtool (Layered Emotion Measurement Tool; [13]) and AniSAM/AniAvatar [57]. With regard to usability, a pictorial single-item scale has been developed recently [4].…”