Methodological variables in Web-based research that may affect results: Sample type, monetary incentives, and personal information

O’Neil, Kevin M.; Penrod, Steven D.

doi:10.3758/bf03195369

Cited by 82 publications

(70 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…First, would we find the same pattern of effects for learning the opposite effect (O'Neil & Penrod, 2001). Pilot testing of instructions and providing contact information for questions (Michalak & Szabo, 1998) may also reduce dropout.…”

Section: The Gizmo Problem-solving Taskmentioning

confidence: 99%

Comparing online and lab methods in a problem-solving experiment

Dandurand

Shultz

Onishi

2008

Behavior Research Methods

175

113

View full text Add to dashboard Cite

428The Internet has revolutionized the way in which people communicate and retrieve information. Powerful communication tools are transforming many scientific disciplines, including experimental and clinical psychology. The Web allows access to much wider populations-as well as to populations that were previously difficult to reach-in an inexpensive, fast, and convenient way. In clinical psychology, for example, psychological testing and assessment can be done online (see, e.g., Buchanan, 2002).In experimental psychology, the Web is increasingly being used as an alternative to traditional lab settings for running experiments. In the present article, we review the major advantages and disadvantages of online experiments in comparison with traditional lab experiments; then we compare online versus lab results in problem solving-an area in which this comparison has received less attention. Online Experiment Pros and ConsThere are many potential advantages for doing an experiment online as opposed to in the lab (see Birnbaum, 2004, for a review of pros and cons). First, experimental procedures can be automated, thus reducing costs and the amount of time spent managing the experiment (Reips, 2002a). This also increases the uniformity of the procedure across participants and may reduce demand characteristics (Reips, 2002a). Second, online experiments can be done in a wider array of settings-not just in the highly constrained setting of the lab (Reips, 2000)-and can include 24-h access (Reips, 2002a), considerations that can increase participants' comfort (Salgado & Moscoso, 2003). Third, ethical standards can be maintained because the experiment is publicly available for criticism and the possibility for the coercion of participants is reduced (Reips, 2002a). Finally, online accessibility allows the targeting of specific audiences (through mailing lists or newsgroups) and broadens the participant pool to Web users, rather than, for example, undergraduate students at a particular university, which may allow increased generalizability of the results (Reips, 2000).There are also disadvantages to running an experiment online rather than in the lab. First, the environments will be more variable, including noise, lighting, and technical aspects of the equipment. Effects of this variability may be reduced by asking participants to do the study in a particular sort of environment and by checking for statistical outliers. Second, online experiments are vulnerable to multiple submissions. This seems to be generally rare (Reips, 2000), but it may be more likely when participants have strong opinions about the topic (see, e.g., Konstan, Rosser, Ross, Stanton, & Edwards, 2005). The risk of multiple submissions can be reduced by asking for personal information, using password protection or an IP address verification (Reips, 2002b), and by reducing external incentives, such as winning money or a prize. Finally, there may be biases in the final sample: Only interested and motivated participants may start (self-selection) and complete...

show abstract

Section: The Gizmo Problem-solving Taskmentioning

confidence: 99%

Comparing online and lab methods in a problem-solving experiment

Dandurand

Shultz

Onishi

2008

Behavior Research Methods

175

113

View full text Add to dashboard Cite

show abstract

“…The first study sought to replicate the effects of sample type and financial incentives shown in previous studies (Frick et al, 1999;K. M. O'Neil & Penrod, 2001) and to explore the impact of two new methodologicalvariablesmethod of obtaining consent and Web page table design.…”

Section: Studymentioning

confidence: 99%

Web-based research: Methodological variables’ effects on dropout and sample characteristics

O’Neil

Penrod

Bornstein

2003

Behavior Research Methods, Instruments, & Computers

Self Cite

View full text Add to dashboard Cite

“…Brevity is desirable because in a psychological experiment the MIP often precedes the actual experiment and should not take time from it. Third, the MIP should not contain elements that prevent potential participants from taking part because their computer hardware or software or their connection to the Internet does not support the experiment (O'Neil & Penrod, 2001). Fourth, there should be no difference in dropout rates between the negative and the positive mood induction (Göritz, 2002;Göritz & Moser, 2006).…”

Section: Demands On An Online Mipmentioning

confidence: 99%

Plain Texts as an Online Mood-Induction Procedure

Verheyen

Göritz

2009

Social Psychology

View full text Add to dashboard Cite

Abstract. This experiment examined six short texts for their effectiveness in inducing positive or negative mood in an online environment. Compared to two control groups, the texts successfully changed mood in the desired direction for mood measured on a single-item self-report scale. In accordance with previous research, negative mood was induced more effectively than positive mood. In addition to the self-report mood measure, two non-self-report mood measures are used; namely, word-pleasantness ratings and subjective probabilities of negative life-events. Pleasantness ratings of uncommon words seemed to be a suitable measure for mood, whereas subjective probabilities of negative life-events were not.

show abstract

Methodological variables in Web-based research that may affect results: Sample type, monetary incentives, and personal information

Cited by 82 publications

References 24 publications

Comparing online and lab methods in a problem-solving experiment

Comparing online and lab methods in a problem-solving experiment

Web-based research: Methodological variables’ effects on dropout and sample characteristics

Plain Texts as an Online Mood-Induction Procedure

Contact Info

Product

Resources

About