Unmoderated Remote Usability Testing: An Approach during Covid-19 Pandemic

Abstract

Online Nurse Test for Indonesian Nurse Competency (ONT UKNI) is a mobile application that was developed to help increase the success rate of nurse competency test participants. By using this application, users can learn more about the materials tested and conduct try out as a competency test simulation. However, ONT UKNI has not yet passed adequate testing stages, especially in terms of User Interface/User Experience (UI/UX). The Covid-19 pandemic situation presents challenges in the UI/UX testing process. Testing process which is ideally carried out face-to-face with respondents to get further insight, have to be carried out using another approach following the new normal protocol. This study aims to test the usability of UI/UX with an unmoderated remote testing approach on ONT UKNI application using a USE questionnaire. The test was performed using 26 respondents and all were nursing profession students of Universitas Muhammadiyah Yogyakarta. Respondents performed 8 tasks on ONT UKNI and answered set of questionnaire that will be tabulated and analyzed. The results indicate that usefulness, ease of learning, and satisfaction variables get the Very Good category while the ease of use variable gets the Good category. Overall, usability testing using an unmoderated remote testing approach can be carried out and able to provide information about areas where users are satisfied with ONT UKNI application. However, some areas still have room for improvement such as better UI design and implementation of gamification.

Multilingual Assessment Instrument for Narratives: Recent developments and new language adaptations

“…a.o. Hertzum et al, 2015, for unmoderated testing He, 2021Relawati & Primanda, 2022) (abbreviated here as remote testing B). Such a testing method differs from in-person testing for all variables.…”

Perancangan User Interface Dan User Experience Pada Customer Interface Website Perusahaan Transportasi Menggunakan Metode Usability Testing

“…Dalam pengembangan website terbagi menjadi beberapa bagian yaitu User Interface (UI) dan User Experience (UX) (Oktaviani, Candra, and Irsyad 2022). Melihat potensi di atas, penulis mengusulkan untuk merancang User Interface (UI) dan User Experience (UX) (Relawati, Primanda, and Zamroni 2022). Saat mendesain antarmuka pengguna (UI) dan pengalaman pengguna (UX), beberapa pendekatan dapat digunakan termasuk desain yang berpusat pada manusia, pemikiran desain, dual diamond, UX Lean, menilai berdasarkan pengalaman, dll (Hasibuan et al 2022).…”

“…Usability Testing perlu dilakukan untuk mengetahui lebih dulu kemungkinan kendala penggunaan aplikasi yang akan dihadapi oleh pengguna. Usability juga berkaitan dengan kualitas dari pengalaman yang dirasakan user pada saat menggunakan aplikasi baik berupa peralatan ataupun aplikasi berbasis website, berbasis desktop, hingga berbasis mobile (Relawati, Primanda, and Zamroni 2022).…”

Analisis Usability pada Website Narasi.tv Menggunakan Metode Unmoderated Remote Usability Testing dan User Experience Questionnaire (UEQ)

“…Situasi di masa pandemi Covid-19 dan era New Normal menyebabkan proses pengujian usability yang semula dilakukan secara tatap muka, kini harus dilakukan melalui cara lain yaitu menggunakan Unmoderated Remote Usability Testing [8]. Untuk melihat temuan permasalahan usability secara komprehensif, maka metode pengukuran Unmoderated Remote Usability Testing perlu ditambahkan metode lain yaitu perhitungan menggunakan metode User Experience Questionnaire (UEQ) yang bertujuan untuk mengetahui tingkat kepuasan dan kenyamanan para user dalam menggunakan website "Narasi.tv", sehingga dapat menganalisis apa yang dialami dan dirasakan oleh user [9].…”