Is once enough?

Hornbæk, Kasper; Sander, Søren; Bargas-Avila, Javier A.; Simonsen, Jakob Grue

doi:10.1145/2556288.2557004

Cited by 82 publications

(18 citation statements)

References 47 publications

(85 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Replication is still not very common within HCI [35] despite various efforts to encourage more replications such as the repliCHI panel and workshops between 2011 and 2014 (see www.replichi.com for details and reports) as well as the "repliCHI badge" given to some CHI articles published at CHI'13/14. Original results are generally higher valued than confirmations or refutations of existing knowledge.…”

Section: Need For Replicationmentioning

confidence: 99%

How Relevant are Incidental Power Poses for HCI?

Jansen¹,

Hornbæk

2018

Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Self Cite

View full text Add to dashboard Cite

The concept of power pose originates from a Psychology study from 2010 which suggested that holding an expansive pose can change hormone levels and increase risk-taking behavior. Follow-up experiments suggested that expansive poses incidentally imposed by the design of an environment lead to more dishonest behaviors. While multiple replication attempts of the 2010 study failed, the follow-up experiments on incidental postures have so far not been replicated. As UI design in HCI can incidentally lead to expansive body postures, we attempted two conceptual replications: we first asked 44 participants to tap areas on a wall-sized display and measured their self-reported sense of power; we then asked 80 participants to play a game on a large touch-screen and measured risk-taking. Based on Bayesian analyses we find that incidental power poses had little to no effect on our measures but could cause physical discomfort. We conclude by discussing our findings in the context of theory-driven research in HCI.

show abstract

Section: Need For Replicationmentioning

confidence: 99%

How Relevant are Incidental Power Poses for HCI?

Jansen¹,

Hornbæk

2018

Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Self Cite

View full text Add to dashboard Cite

show abstract

“…[59]. For example there have been heated debates about (mis)use of methods from ethnography [15] and design research [24,56] within HCI, and about whether HCI research needs to become more 'scientific' by focusing on replicating existing results [28].…”

Section: Hci Must Promote a Culture Of Respect For Other Fieldsmentioning

confidence: 99%

Misrepresentation of Health Research in Exertion Games Literature

Marshall

Linehan

2017

Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

HCI often requires scholars to build upon research from fields outside their expertise, creating the risk that foundational work is misunderstood and misrepresented. The prevailing goal of "exergames" research towards ameliorating obesity appears to be built on just such a misunderstanding of health research. In this paper, we analyse all citations to a single influential study, which has been extensively cited to justify research on exergames. We categorise the 375 citations based on whether they represent the findings of that study accurately or inaccurately. Our findings suggest that 69% of exergames papers citing this study misrepresent the findings, demonstrating a systematic failure of scholarship in exergames research. We argue that exergaming research should cease focusing on games as treatment for obesity, and that HCI publications should demand more critical and scholarly engagement with research from outside HCI.

show abstract

“…Thus, it makes sense to compare the effects of visualization that we see to those that Micallef et al (2012) saw. Hornbaek et al (2014) also recommended effect size comparisons as a way to make comparisons across replications more content rich. To compare the effect sizes, we first calculated an effect size of the manipulations in Micallef et al (2012) from the available log files, finding a small effect d ¼ 0:11 for the frequency grid (condition V3 in Micallef et al (2012) experiment 1) and a small effect d ¼ 0:1 for the Euler array (condition V4 in Micallef et al (2012) experiment 2) over the text only condition (Micallef et al (2012) V0).…”

Section: Effect Sizementioning

confidence: 99%