Motivating User-Generated Content with Performance Feedback: Evidence from Randomized Field Experiments

Abstract

We design a series of online performance feedback interventions that aim to motivate the production of user-generated content (UGC). Drawing on social value orientation (SVO) theory, we develop a novel set of alternative feedback message framings, aligned with cooperation (e.g., your content benefited others), individualism (e.g., your content was of high quality), and competition (e.g., your content was better than others). We hypothesize how gender (a proxy for SVO) moderates response to each framing, and we report on two randomized experiments, one in partnership with a mobile-app–based recipe crowdsourcing platform, and a follow-up experiment on Amazon Mechanical Turk involving an ideation task. We find evidence that cooperatively framed feedback is most effective for motivating female subjects, whereas competitively framed feedback is most effective at motivating male subjects. Our work contributes to the literatures on performance feedback and UGC production by introducing cooperative performance feedback as a theoretically motivated, novel intervention that speaks directly to users’ altruistic intent in a variety of task settings. Our work also contributes to the message-framing literature in considering competition as a novel addition to the altruism–egoism dichotomy oft explored in public good settings. The online appendix is available at https://doi.org/10.1287/mnsc.2017.2944 . This paper was accepted by Chris Forman, information systems.

Attention or Appreciation? The Impact of Feedback on Online Volunteering

“…The number of page views (attention) had a negative effect on volunteers' likelihood to accept additional consultations; this finding is different from past research [18]. There are two plausible explanations for this.…”

“…Previous studies have identified several factors that affect participation in voluntary behaviors, with effortbased feedback receiving much attention [18,20,29]. We focus on two technological manifestations of feedback.…”

How to Share Prosocial Behavior without Being Considered a Braggart?

“…Therefore, it is critical to understand individual's self-presentation of prosocial behavior. The existing literature in user content generation has covered many motivators including financial incentive, social norms, collectivism, individualism, and social comparison to encourage content generation [5,12,13]. To the best of our knowledge, no prior work has considered the negative consequence of content generation.…”

“…Huang, Chen [13] conducted a field experiment to find that users' social sharing is encouraged by monetary incentive as well as relational and cognitive capital framings. Huang, Burtch [12] studied novel message framings based on performance feedback and disentangled the moderation role of gender. Our study differs from these works by directly looking at the likability of different framings from an audience perspective.…”

Externalities in Knowledge Production: Evidence from a Randomized Field Experiment

“…More generally, the paper belongs to the literature that analyzes what drives contributions to user-generated content. 3 The topics addressed in the prior related literature include the role of personal gain (Shah, 2006), group size (Zhang and Zhu, 2011), networks (Fershtman and Gandal, 2011;Ransbotham, Kane, and Lurie, 2012), spillovers (Kummer, 2014), symbolic awards (Gallus, 2017), performance feedback (Huang, Burtch, Gu, Hong, Liang, Wang, Fu, and Yang, 2018), monetary rewards vs social motives (Sun, Dong, and McIntyre, 2017), contributor diversity (Ren, Chen, and Riedl, 2015), and economic conditions, such as unemployment (Kummer, Slivko, and Zhang, 2015) and migration (Slivko, 2018). More closely related to our work is Kane and Ransbotham (2016) who study the relationship between contributions and consumption of content.…”