Procuring Usability: Experiences of Usability Testing in Tender Evaluation

Riihiaho, Sirpa; Nieminen, Marko; Westman, Stina; Addams-Moring, Ronja; Katainen, Jukka

doi:10.1007/978-3-319-21783-3_8

Cited by 6 publications

(6 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Conducting research involving children or other special categories (such as pupils with disabilities) requires great attention to the aforementioned issues and should follow all recent legislations and regulations, such as the General Data Protection Regulation (European Commission, 2012), Directive 95/46/EC (European Parliament, 1995), Directive 2002/58/EC (European Parliament, 2002), and Charter of Fundamental Right (European Parliament, 2000). The study also found that the number of end users participating in the assessment of the final solution is critical in obtaining valid results (Riihiaho, 2000). However, this remains a challenge, as only 19.18% of studies used 1 to 20 end users to evaluate the application, 20.55% used 21 to 40, 16.44% used 41 to 60, 9.59% used 61 to 80, and 21.92% used more than 80 end users.…”

Section: Discussionmentioning

confidence: 92%

Revealing the true potential and prospects of augmented reality in education

Koumpouros

2024

Smart Learn. Environ.

View full text Add to dashboard Cite

Augmented Reality (AR) technology is one of the latest developments and is receiving ever-increasing attention. Many researches are conducted on an international scale in order to study the effectiveness of its use in education. The purpose of this work was to record the characteristics of AR applications, in order to determine the extent to which they can be used effectively for educational purposes and reveal valuable insights. A Systematic Bibliographic Review was carried out on 73 articles. The structure of the paper followed the PRISMA review protocol. Eight questions were formulated and examined in order to gather information about the characteristics of the applications. From 2016 to 2020 the publications studying AR applications were doubled. The majority of them targeted university students, while a very limited number included special education. Physics class and foreign language learning were the ones most often chosen as the field to develop an app. Most of the applications (68.49%) were designed using marker detection technology for the Android operating system (45.21%) and were created with Unity (47.95%) and Vuforia (42.47%) tools. The majority of researches evaluated the effectiveness of the application in a subjective way, using custom-made not valid and reliable tools making the results not comparable. The limited number of participants and the short duration of pilot testing inhibit the generalization of their results. Technical problems and limitations of the equipment used are mentioned as the most frequent obstacles. Not all key-actors were involved in the design and development process of the applications. This suggests that further research is needed to fully understand the potential of AR applications in education and to develop effective evaluation methods. Key aspects for future research studies are proposed.

show abstract

Section: Discussionmentioning

confidence: 92%

Revealing the true potential and prospects of augmented reality in education

Koumpouros

2024

Smart Learn. Environ.

View full text Add to dashboard Cite

show abstract

“…When the evaluation was done, all results of the usability interface will be collected and reported. In addition, heuristic assessment can improve the validity of the construction during the software development [18].…”

Section: Heuristic Evaluationmentioning

confidence: 99%

“…Items in each construct were measured in five-point Likert scale (1 = strongly disagree, 2 = disagree, 3 = neutral, 4 = agree, 5 = strongly agree).To identify the problem of the courseware, the CPRF was used. The CPRF was adapted from [18], [39]. In this study, web based environment was used in developing the courseware.…”

Section: Research Instrumentsmentioning

confidence: 99%

Heuristic Evaluation on Augmented Reality Basic Reading Courseware (AR BACA-MV-SindD) for Down Syndrome Learner

Ramli,

Badioze Zaman

2020

MyJICT

View full text Add to dashboard Cite

The development of Augmented Reality (AR) courseware for down syndrome learner should not only take advantage of the technological advances, but also pay close attention to the usability of the product that meet the target user’s requirement. In this paper, we describe the heuristic evaluation of AR BACA-MV-SindD; a courseware for down syndrome learner in learning basic reading by using Augmented Reality technology. This study employs heuristic evaluation (HE), which is one of the inspection methods. Heuristic evaluation was chosen because it does not involve the end user. Previous studies have shown that more problems can be identified using this kind of evaluation. Several experts from different fields were involved in this evaluation. Based on the evaluation made, several disadvantages of AR BACA-MV-SindD have been identified. In addition, experts have provided some feedbacks to further improve the courseware. This paper includes a report of a heuristic evaluation which used a five point Likert scale. A questionnaire for this heuristic evaluation consists of three constructs: interface, education and augmented reality technology. As conclusion, the heuristic evaluation can be an effective and efficient way to identify usability problems in the early stage of software development. Thus, usability should be given high priority in the development of AR courseware especially for special needs students like down syndrome learner

show abstract

“…The majority had never operated a tablet before and only received a short introduction of a few minutes before they had to perform the assigned tasks under the scrutiny of 2 observers. Observer effects and the think-aloud protocol are known to decrease performance for complex tasks in usability studies [36][37][38]. It is plausible that the participants would have performed better in the privacy of their own home where they feel more free from prying eyes.…”

Section: Principal Findingsmentioning

confidence: 99%

Supporting Older Adults in Exercising With a Tablet: A Usability Study (Preprint)

Mehra¹,

Visser²,

Cila³

et al. 2018

Preprint

View full text Add to dashboard Cite

BACKGROUND For older adults, physical activity is vital for maintaining their health and ability to live independently. Home-based programs can help them achieve the recommended exercise frequency. An application for a tablet computer was developed to support older adults in following a personal training program. It featured goal setting, tailoring, progress tracking, and remote feedback. OBJECTIVE In line with the Medical Research Council Framework, which prescribes thorough testing before evaluating the efficacy with a randomized controlled trial, the aim of this study was to assess the usability of a tablet-based app that was designed to support older adults in doing exercises at home. METHODS A total of 15 older adults, age ranging from 69 to 99 years old, participated in a usability study that utilized a mixed-methods approach. In a laboratory setting, novice users were asked to complete a series of tasks while verbalizing their ongoing thoughts. The tasks ranged from looking up information about exercises and executing them to tailoring a weekly exercise schedule. Performance errors and time-on-task were calculated as proxies of effective and efficient usage. Overall satisfaction was assessed with a posttest interview. All responses were analyzed independently by 2 researchers. RESULTS The participants spent 13-85 seconds time-on-task. Moreover, 79% (11/14)-100% (14/14) participants completed the basic tasks with either no help or after having received 1 hint. For expert tasks, they needed a few more hints. During the posttest interview, the participants made 3 times more positive remarks about the app than negative remarks. CONCLUSIONS The app that was developed to support older adults in doing exercises at home is usable by the target audience. First-time users were able to perform basic tasks in an effective and efficient manner. In general, they were satisfied with the app. Tasks that were associated with behavior execution and evaluation were performed with ease. Complex tasks such as tailoring a personal training schedule needed more effort. Learning effects, usefulness, and long-term satisfaction will be investigated through longitudinal follow-up studies.

show abstract

Procuring Usability: Experiences of Usability Testing in Tender Evaluation

Cited by 6 publications

References 13 publications

Revealing the true potential and prospects of augmented reality in education

Revealing the true potential and prospects of augmented reality in education

Heuristic Evaluation on Augmented Reality Basic Reading Courseware (AR BACA-MV-SindD) for Down Syndrome Learner

Supporting Older Adults in Exercising With a Tablet: A Usability Study (Preprint)

Contact Info

Product

Resources

About