Textual evaluation vs. User testing: a comparative analysis

Abstract

One of the ways to evaluate a system is from Textual Evaluation. This type of evaluation consider the textual user’s opinions to infer aspects of the interaction with the system. Although this method covers many texts and consi- ders spontaneous narratives of the users, it takes a lot of time and effort. Some authors have reported on the need to compare evaluations techniques in order to investigate their effectiveness in revealing issue or to supplement the results of a systems assessment. This study presents a comparative analysis between the textual evaluation and user testing. A case study was performed evaluating the usability and user experience of a health app. As a result, the techniques were analyzed based on aspects that involved describing the results, resources needed and description of problems and users.