Do you know the Wooly Bully? Testing era-based knowledge to verify participant age online

Hartman, Rachel; Moss, Aaron J.; Rabinowitz, Israel; Bahn, Nathaniel; Rosenzweig, Cheskie; Robinson, Jonathan; Litman, Leib

doi:10.3758/s13428-022-01944-y

Cited by 3 publications

(2 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, the end-of-study test was particularly tailored to the experimental paradigm used in the current study, while the initial test is more general. In future research we plan to investigate whether one task-tailored test (e.g., asking about some important feature of the experiment, such as the highest/lowest observed payoff) is enough to differentiate between participants who did versus did not take the experiment seriously (see a related idea in Hartman et al 2023, showing the advantage of using particular questions to verify participants' age or ethnicity).…”

Section: Discussionmentioning

confidence: 99%

Attention! Do We Really Need Attention Checks?

Roth,

Yakobi

2024

Behavioral Decision Making

View full text Add to dashboard Cite

There is ongoing debate over the usefulness of and need for attention checks in online experiments. This paper investigates the value of these tests in decisions‐from‐experience (i.e., multi‐trial repeated choice) tasks. In five studies (Ntotal = 1519), we comprehensively compared the behavior of attentive and inattentive participants (i.e., those who passed or failed a simple attention check) among online participants; and also compared those results to the results of lab studies reported elsewhere. We found meaningful differences between the behavior of attentive and inattentive participants even at the first trial. Overall, attentive participants were more likely to notice less‐obvious average values of the different alternatives, while inattentive participants exhibited higher sensitivity to typical outcomes. The findings show that even one simple attention test is sufficient to differentiate between attentive and inattentive participants in repetitive tasks. Importantly, our results fully replicated three previously run lab studies among attentive participants, but not inattentive ones. This finding highlights the importance of using attention tests to avoid spurious conclusions.

show abstract

Section: Discussionmentioning

confidence: 99%

Attention! Do We Really Need Attention Checks?

Roth,

Yakobi

2024

Behavioral Decision Making

View full text Add to dashboard Cite

show abstract

“…The propensity for individuals to favor music from this period later in life is not merely a reflection of nostalgic attachment but indicates the pivotal role these preferences play in the identity consolidation process (Holbrook & Schindler, 1989, 1996). As such, music preferences acquired during the reminiscence bump are integral to the narrative of self, acting as markers of personal and generational identity, echoing the socio-cultural backdrop for developing the self-concept (Hartman et al, 2022).…”

Section: Five Everyday Memory Phenomenamentioning

confidence: 99%

Memory Can Define Individual Beliefs and Identity—and Shape Society

Madan

2023

Policy Insights from the Behavioral and Brain Sciences

View full text Add to dashboard Cite

Memory profoundly define individual beliefs and identity, shaping how societies make decisions. Five key memory phenomena include—first impressions and the primacy effect, risky decision-making and memory availability, information reliability and source memory, music preferences and the reminiscence bump, and long-term planning and episodic future thinking. Each phenomenon is explored for its impact on policy, revealing the profound ways that memory biases and processes shape critical societal choices, such as judicial decisions, hiring practices, financial planning, and pro-environmental behavior. Although memory's importance in daily life is widely recognized, its central role in shaping self-identity and influencing societal structures is often underestimated. Memory biases, evident in various aspects, from cultural exposures to decision-making heuristics, play a pivotal role in individual and collective behavior. These biases, often manifesting subtly, guide the formation of beliefs and preferences, with strong implications for policy making. Taken together, this work advocates for a multidisciplinary approach to bridge memory theory and policy practice.

show abstract

Who misreports on internet health surveys, and do images of watching eyes discourage misreporting? An online experiment from China

Guo,

Cao,

Wang

et al. 2024

Discov Psychol

View full text Add to dashboard Cite

Background Few studies in China have examined correlates of internet health survey misreporting or the effect of interventions to mitigate misreporting. We conducted an experiment to: (1) identify correlates of survey misreporting, and (2) assess the impact of “watching eyes” images on survey misreporting. Exposure to watching eyes has been shown to discourage socially deviant behavior. Methods In 2022, a contract survey company recruited 1655 online survey respondents who were ≥ 18 years old and living in China. Participants were randomized to one of four arms. Participants randomized to arms 1 and 3 were asked to report their blood type. Participants randomized to arms 2 and 4 were also asked to report their blood type, but were additionally told they could end the survey early if they reported AB blood type. Participants randomized to arm 3 or 4 (but not arms 1 or 2) were shown an image of watching eyes before being asked to report their blood type. Results Among participants with lower educational attainment, the probability of reporting AB blood type was higher if incentivized to report AB blood (19.05% vs 9.26%), though this difference was not statistically significant (p = 0.189). Among participants incentivized to report AB blood type, the probability of reporting AB blood type was significantly greater among individuals shown watching eyes (19.93% vs 11.56%, p < 0.01). Conclusion Internet health surveys in China must begin assessing and mitigating participant misreporting. Larger studies are needed to elucidate potential mechanisms of association between socioeconomic status, participation incentives, and internet survey misreporting. Exposure to watching eyes may decrease participatory engagement and cooperation.

show abstract

Do you know the Wooly Bully? Testing era-based knowledge to verify participant age online

Cited by 3 publications

References 26 publications

Attention! Do We Really Need Attention Checks?

Attention! Do We Really Need Attention Checks?

Memory Can Define Individual Beliefs and Identity—and Shape Society

Who misreports on internet health surveys, and do images of watching eyes discourage misreporting? An online experiment from China

Contact Info

Product

Resources

About