Evaluation methods and cultural differences

Oyugi, Cecilia; Dunckley, Lynne; Smith, Andy

doi:10.1145/1463160.1463195

Cited by 34 publications

(20 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Likewise, research by Biru (2008), and Oyugi et al (2008) indicate studies in Europe and North America might only tell little about the practices in developing countries relating to a different context. Besides cultural differences, differences in application requirements, jobs and work environments, attitudes…”

Section: Usability Evaluationmentioning

confidence: 99%

User Involvement and Usability Evaluation in Ethiopian Software Organizations

Teka

Dittrich

Kifle

et al. 2017

E J Info Sys Dev Countries

View full text Add to dashboard Cite

Usability is central especially in contexts with highly heterogeneous user groups as it is the case in developing countries. User involvement and participation has positive impacts towards developing usable software and system success and it is one of the core principles in user centered design (UCD). But how does the industry in developing countries work with UCD and usability evaluation? The article reports from a survey on usability evaluation and UCD practices in Ethiopian software organizations. It aims at exploring the practice of usability evaluation, user involvement and participation in the software organizations in Ethiopia. Some part of the survey question is adapted from a previously conducted survey in Italy and Denmark and further expanded with a set of questions referring to user involvement and participation. The survey was triangulated with interviews with a subset of the respondents. The results show that the percentage of organizations performing some form of usability evaluation is low in Ethiopia. The challenges of usability evaluation observed in the study was analyzed with respect to the challenges of 'digital divide' against the publicly available methods and practices and among developed and developing nations using real access/ real impact criteria. The result shows that there are some unique challenges of usability not discussed in the literature reviewed in any detail such as less IT skills, lack of trained professionals, and lack of awareness. The result for user involvement shows also some unique challenges: lack of user motivation, acceptance of change and cultural influence. However, more than 80% of the surveyed organizations claim involving users in some kind in product development. The implications of these findings with respect to the need to contextualize UCD and usability methods are discussed.

show abstract

Section: Usability Evaluationmentioning

confidence: 99%

User Involvement and Usability Evaluation in Ethiopian Software Organizations

Teka

Dittrich

Kifle

et al. 2017

E J Info Sys Dev Countries

View full text Add to dashboard Cite

show abstract

“…Therefore, if software is targeting child users in other countries, the applicability and limitations of current evaluation methods needs to be examined. User experience studies with adults have shown that cultural differences might affect the results, for example, Oyugi, Dunkley, and Smith (2008) found that Kenyan users, when compared to UK users, were much less comfortable with probing questions. It is therefore likely that cultural differences will be evident when using user experience evaluation methods with children.…”

Section: Children As Evaluators Of Technologymentioning

confidence: 99%

From England to Uganda: Children Designing and Evaluating Serious Games

Sim

Read

Gregory

et al. 2014

Human–Computer Interaction

View full text Add to dashboard Cite

The participation of end-users in the design and evaluation of technologies has long been an important principle in human-computer interaction. This article reports a study to ascertain to what extent children using participatory methods could effectively design for a surrogate population. Fifty children, from a UK primary school, participated in a design activity to specify a serious game for children in Uganda. The children's designs were analyzed and were shown to have effectively incorporated learning and gaming aspects. Based on these designs a serious game was developed. This new serious game and the commercial game Angry Birds were both evaluated for fun with 25 children in Uganda, using the Fun Toolkit and the This or That method. The results suggested that the children found both games fun, thus confirming that the children in the United Kingdom could effectively design a fun game for a surrogate population. Despite the positive results, the reliability of the evaluation methods is questioned. Inconsistencies were noted within the individual evaluation tools and the comparative results for some constructs yielded a low reliability score. We conclude that further research is required to establish suitable evaluation methods for evaluating fun with children in developing countries.Gavin Sim (grsim@uclan.ac.uk) is a computer scientist with an interest in human-computer interaction, usability, user experience, and child-computer interaction; he is a Senior Lecturer in the School of Computing Engineering and Physical Sciences of the University of Central Lancashire. Janet C. Read (jcread@uclan.ac.uk) is a computer scientist with an interest in child-computer interaction, handwriting recognition, and interaction design; she is a Professor in the School of Computing Engineering and Physical Sciences of the University of Central Lancashire. Peggy Gregory (ajgregory@uclan.ac.uk) is a computer scientist with an interest in agile methodologies, health informatics, and child-computer interaction; she is a Senior Lecturer in the School of Computing Engineering and Physical Sciences of the University of Central Lancashire. Diana Xu (YFXu@uclan.ac.uk) is a researcher with an interest in child-computer interaction, tangible computing, and serious games; she is a Research Assistant in the School of Computing Engineering and Physical Sciences of the University of Central Lancashire.Color versions of one or more of the figures in the article can be found online at www.tandfonline. com/hhci. 264Sim et al.

show abstract

“…The‗situated-paradigm' applies to perspectives that respond to the social situation of interactions and the varied non-technological factors that affect design and use (Harrison, 2007).A range of studies illustrate how pairing evaluators with users from different cultural backgrounds influences outcomes (e.g. ; Vatrapu & Perez-Quiñones 2008, Clemmensen & Plocher, 2007Oyugi et al, 2008). In Eastern societies, for example, users' socio-emotional orientations are acutely influenced by the presence of foreign evaluators.…”

Section: Situating the Self In Designmentioning

confidence: 99%

Toward an Afro-Centric Indigenous HCI Paradigm

Winschiers‐Theophilus

Bidwell

2013

International Journal of Human-Computer Interaction

120

View full text Add to dashboard Cite

Current HCI paradigms are deeply rooted in a western epistemology which attests its partiality and bias of its embedded assumptions, values, definitions, techniques and derived frameworks and models.Thus tensions created between local cultures and HCI principles require us to pursue a more critical research agenda within an indigenous epistemology. In this paper we present an Afro-centric paradigm, as promoted by African scholars, as an alternative perspective to guide interaction design in a situated context in Africa and promote the reframing of HCI. We illustrate a practical realization of this paradigm shift within our own community driven designin Southern Africa.

show abstract

Evaluation methods and cultural differences

Cited by 34 publications

References 11 publications

User Involvement and Usability Evaluation in Ethiopian Software Organizations

User Involvement and Usability Evaluation in Ethiopian Software Organizations

From England to Uganda: Children Designing and Evaluating Serious Games

Toward an Afro-Centric Indigenous HCI Paradigm

Contact Info

Product

Resources

About