EISEval, a generic reconfigurable environment for evaluating agent-based interactive systems

Towards Qualitative and Quantitative Data Integration Approach for Enhancing HCI Quality Evaluation

“…They concern various methods and approaches for evaluating HCI quality (e.g. the questionnaires or the interviews as subjective tools [ 19] and the electronic informer as an objective tool [ 3]). Recent researches have investigated the possibility of employing different methods to improve evaluation results [ 10] [ 11].…”

“…Over the past decades, several quality evaluation methods and tools have been proposed. Some of them provide a quantitative (objective) evaluation based on analytic and quantitative data retrieved from various tools such as electronic informers [ 3]. Other methods perform a qualitative (subjective) evaluation exploiting for instance questionnaire and/or interview methods [ 4] [ 5].…”

MenuErgo

“…Cet article présente MenuErgo (Fig. 1), un environnement logiciel de conception d'une barre de menu avec ses menus déroulants et sous-menus qui tente de bénéficier du meilleur des deux approches : une critique en cours de conception (et non pas après la conception) sur une interface finale (et non pas seulement une interface représentée) sur base d'une évaluation automatique qui est paramétrable en fonction de la préférence du concepteur (et non pas fixe dans tous les cas de figure) et qui permet d'assurer la continuité avec le reste du cycle de vie de développement de l'interface (ici par génération automatique d'un code correspondant), comme le font les outils les plus avancés [17,37]. Dans MenuErgo, le concepteur conçoit sa barre de menus exactement comme il le ferait dans un environnement de développement intégré, sur base des mêmes paramètres.…”

UXAml Framework

“…An approach towards resolving several of the shortcomings involved in the process of using guidelines is the development of tools for working with guidelines. Tools for working with guidelines (TFWWG) can be broadly classified in two main categories, namely tools for access and retrieval of guidelines and tools for automatically or semi-automatically evaluating user interface layout representations (Tran, Ezzedine, & Kolski, 2013).…”

“…Then several usability indicators can be calculated, such as the number of backtracks, correct flow ratio, or the number of users who failed to accomplish the task. EISEval (Tran et al, 2013) is a tool extending usability evaluation automation by capturing data concerning not only the interactions between users and the UI, but between agents themselves as well, thus supporting the evaluation of UIs' dynamic behaviour. EISEval then performs data analysis on the collected data through measurements and statistics (e.g., frequencies, times, successes and failures), and generates PetriNets to visually reproduce the activities of the user in the target system.…”