Data-Driven Retrospective Interviewing (DDRI): A proposed methodology for formative evaluation of pervasive games

El-Nasr, Magy Seif; Durga, S.; Shiyko, Mariya; Sceppa, Carmen

doi:10.1016/j.entcom.2015.07.002

Cited by 23 publications

(17 citation statements)

References 44 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Lower summaries from this study may be an artifact of design differences. The length of the qualitative study was 1 month, with interviews conducted regularly at one-week intervals, and interview questions informed by the play data [ 33 ]. This setup likely enforced more play than would occur naturally, without external reinforcement.…”

Section: Discussionmentioning

confidence: 99%

“…The game SpaPlay was developed based on the outlined principles of the PENS model [ 31 ] and gamification strategies [ 21 , 31 ]. Our previous qualitative study demonstrated overall acceptability of the game [ 32 - 33 ]. The focus of the current study is to evaluate the extent of game play derived from objective gamification data and examine initial evidence of play effectiveness on BMI and nutritional knowledge.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Effects of Playing a Serious Computer Game on Body Mass Index and Nutrition Knowledge in Women

Shiyko¹,

Skyler²,

M³

et al. 2016

JMIR Serious Games

Self Cite

View full text Add to dashboard Cite

BackgroundObesity and weight gain is a critical public health concern. Serious digital games are gaining popularity in the context of health interventions. They use persuasive and fun design features to engage users in health-related behaviors in a non-game context. As a young field, research about effectiveness and acceptability of such games for weight loss is sparse.ObjectiveThe goal of this study was to evaluate real-world play patterns of SpaPlay and its impact on body mass index (BMI) and nutritional knowledge. SpaPlay is a computer game designed to help women adopt healthier dietary and exercise behaviors, developed based on Self-Determination theory and the Player Experience of Need Satisfaction (PENS) model. Progress in the game is tied to real-life activities (e.g., eating a healthy snack, taking a flight of stairs).MethodsWe recruited 47 women to partake in a within-subject 90-day longitudinal study, with assessments taken at baseline, 1-, 2-, and 3- months. Women were on average, 29.8 years old (±7.3), highly educated (80.9% had BA or higher), 39% non-White, baseline BMI 26.98 (±5.6), who reported at least contemplating making changes in their diet and exercise routine based on the Stages of Change Model. We computed 9 indices from game utilization data to evaluate game play. We used general linear models to examine inter-individual differences between levels of play, and multilevel models to assess temporal changes in BMI and nutritional knowledge.ResultsPatterns of game play were mixed. Participants who reported being in the preparation or action stages of behavior change exhibited more days of play and more play regularity compared to those who were in the contemplation stage. Additionally, women who reported playing video games 1-2 hours per session demonstrated more sparse game play. Brief activities, such as one-time actions related to physical activity or healthy food, were preferred over activities that require a longer commitment (e.g., taking stairs every day for a week). BMI decreased significantly (P<.001) from baseline to 3-month follow-up, yielding a large effect size of 1.28. Nutritional knowledge increased significantly (P<.001) from first to third month follow-ups, with an effect size of .86. The degree of change in both outcomes was related to game play, baseline readiness to change, and the extent of video game play in general.ConclusionsThis work demonstrates initial evidence of success for using a serious game as an intervention for health behavior change in real world settings. Our findings also highlight the need to understand not only game effectiveness but also inter-individual differences. Individualizing content and the intervention medium appears to be necessary for a more personalized and long-lasting impact.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Effects of Playing a Serious Computer Game on Body Mass Index and Nutrition Knowledge in Women

Shiyko¹,

Skyler²,

M³

et al. 2016

JMIR Serious Games

Self Cite

View full text Add to dashboard Cite

show abstract

“…Uma vez que esse método possui a capacidade de revelar dimensões emocionais de uma experiência que nem sempre estão evidentes no comportamento de um indivíduo [30], diversos pesquisadores têm explorado seu potencial, elaborando novas técnicas e abordagens para aplicá-lo em diferentes áreas e contextos. Por exemplo, El-Nasr et al [20] propuseram um método de avaliação formativa que usa de entrevistas retrospectivas para investigar como jogadores aceitam e integram um jogo em suas vidas -método particularmente adequado para pesquisas com jogos pervasivos em cenários naturalistas. Crawford, Monks e Wells [13] elaboraram uma técnica de entrevista baseada em realidade virtual para avaliar candidatos a residência em emergência médica e identificar suas habilidades de comunicação, resolução de problemas e trabalho em equipe.…”

Section: Entrevistas E Games User Researchunclassified

Uso de Entrevistas na Avaliação de Jogos Baseados em Localização: Lições e Desafios

Carneiro¹,

Darin²,

Viana³

2019

Anais Do Workshop Sobre Interação E Pesquisa De Usuários No Desenvolvimento De Jogos (WIPlay)

View full text Add to dashboard Cite

RESUMOGames User Research (GUR) é um campo de estudo que tem buscado formar um conjunto de técnicas para avaliar a interação dos jogadores em diversos tipos de jogos. Buscando somar esforços aos avanços nessa área, este trabalho foca na avaliação da interação com jogos baseados em localização (JBL), buscando compreender quais aspectos da player experience em JBL podem ser explorados por meio de entrevistas e como isso tem sido feito pelas comunidades de prática e pesquisa. Para isso, foram analisados trabalhos que aplicaram o método em tal contexto e conduzido um survey de opinião com os respectivos autores. Como resultado, são apresentadas desafios de pesquisa e lições para o uso de entrevistas nesse tipo de avaliação, visando incentivar sua aplicação consciente e sistematizada, além de prover auxílio a praticantes e pesquisadores, especialmente iniciantes. PALAVRAS-CHAVEJogos baseados em localização, Métodos de avaliação, Interação, Entrevistas

show abstract

“…A common source of game metrics is the telemetry data of the player's behavior [12,13]. According to [14], there are three types of indicators used by game user experience researchers: (1) user metrics (related to the player), (2) performance metrics (related to software or hardware) and (3) process metrics (related to developing the game). When the game is measured, aspects of the game must be included, but there is something more important, the player's experience.…”

Section: Game Metricsmentioning

confidence: 99%

Effectiveness and Fun Metrics in a Pervasive Game Experience: A Systematic Literature Review

Taborda

Arango‐López

Collázos

et al. 2019

Advances in Intelligent Systems and Computing

View full text Add to dashboard Cite

The progress of video games, hand in hand with the technological development, has been exponential in recent years. Its diffusion in society through multiple existing formats (computer, console, mobile devices, etc.) is growing. The number of video game players increases every year. As a result, the technical and user experience requirements also increase, and the behavior of the players with the game experience is unknown. Therefore, it is necessary to have the elements that allow evaluating and measuring this behavior from several perspectives. Therefore, it is necessary to have elements that allow evaluating and measuring the behavior of players with the game experience from different perspectives. It is important to have these different points of view to continuing the contribution in this aspect. Having that in mind, it has been made an analysis of measurement of effectiveness' measure and entertainment that will serve as a basis to approach studies in search of improvements in the user experience, a topic of great interest among the current generators or manufacturers of these video games.

show abstract

Data-Driven Retrospective Interviewing (DDRI): A proposed methodology for formative evaluation of pervasive games

Cited by 23 publications

References 44 publications

Effects of Playing a Serious Computer Game on Body Mass Index and Nutrition Knowledge in Women

Effects of Playing a Serious Computer Game on Body Mass Index and Nutrition Knowledge in Women

Uso de Entrevistas na Avaliação de Jogos Baseados em Localização: Lições e Desafios

Effectiveness and Fun Metrics in a Pervasive Game Experience: A Systematic Literature Review

Contact Info

Product

Resources

About