Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the replicability of thirteen classic and contemporary effects across 36 independent samples totaling 6,344 participants. In the aggregate, ten effects replicated consistently.One effect -imagined contact reducing prejudice -showed weak support for replicability. And two effects -flag priming influencing conservatism and currency priming influencing system justification -did not replicate. We compared whether the conditions such as lab versus online or U.S. versus international sample predicted effect magnitudes. By and large they did not. The results of this small sample of effects suggest that replicability is more dependent on the effect itself than on the sample and setting used to investigate the effect. Word Count = 121 words Many Labs 3 Investigating variation in replicability: A "Many Labs" Replication ProjectReplication is a central tenet of science; its purpose is to confirm the accuracy of empirical findings, clarify the conditions under which an effect can be observed, and estimate the true effect size (Brandt et al., 2013; Open Science Collaboration, 2012. Successful replication of an experiment requires the recreation of the essential conditions of the initial experiment. This is often easier said than done. There may be an enormous number of variables influencing experimental results, and yet only a few tested. In the behavioral sciences, many effects have been observed in one cultural context, but not observed in others. Likewise, individuals within the same society, or even the same individual at different times (Bodenhausen, 1990), may differ in ways that moderate any particular result.Direct replication is infrequent, resulting in a published literature that sustains spurious findings (Ioannidis, 2005) and a lack of identification of the eliciting conditions for an effect. While there are good epistemological reasons for assuming that observed phenomena generalize across individuals and contexts in the absence of contrary evidence, the failure to directly replicate findings is problematic for theoretical and practical reasons. Failure to identify moderators and boundary conditions of an effect may result in overly broad generalizations of true effects across situations (Cesario, 2013) or across individuals (Henrich, Heine, & Norenzayan, 2010). Similarly, overgeneralization may lead observations made under laboratory observations to be inappropriately extended to ecological contexts that differ in important ways (Henry, MacLeod, Phillips, & Crawford, 2004). Practically, attempts to closely replicate research findings can reveal important differences in what is considered a direct replication (Schimdt, 2009), thus leading to refinements of the initial theory (e.g., Aronson, 1992, Greenwald et al., 1986. Close replication can also lead to Many Labs 4 the clarification of tacit methodological knowledge that is necessary to elicit the effect of interest (Collins,...

We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was administered to approximately half of 125 samples that comprised 15,305 participants from 36 countries and territories. Using the conventional criterion of statistical significance ( p < .05), we found that 15 (54%) of the replications provided evidence of a statistically significant effect in the same direction as the original finding. With a strict significance criterion ( p < .0001), 14 (50%) of the replications still provided such evidence, a reflection of the extremely high-powered design. Seven (25%) of the replications yielded effect sizes larger than the original ones, and 21 (75%) yielded effect sizes smaller than the original ones. The median comparable Cohen’s ds were 0.60 for the original findings and 0.15 for the replications. The effect sizes were small (< 0.20) in 16 of the replications (57%), and 9 effects (32%) were in the direction opposite the direction of the original effect. Across settings, the Q statistic indicated significant heterogeneity in 11 (39%) of the replication effects, and most of those were among the findings with the largest overall effect sizes; only 1 effect that was near zero in the aggregate showed significant heterogeneity according to this measure. Only 1 effect had a tau value greater than .20, an indication of moderate heterogeneity. Eight others had tau values near or slightly above .10, an indication of slight heterogeneity. Moderation tests indicated that very little heterogeneity was attributable to the order in which the tasks were performed or whether the tasks were administered in lab versus online. Exploratory comparisons revealed little heterogeneity between Western, educated, industrialized, rich, and democratic (WEIRD) cultures and less WEIRD cultures (i.e., cultures with relatively high and low WEIRDness scores, respectively). Cumulatively, variability in the observed effect sizes was attributable more to the effect being studied than to the sample or setting in which it was studied.

The university participant pool is a key resource for behavioral research, and data quality is believed to vary over the course of the academic semester. This crowdsourced project examined time of semester variation in 10 known effects, 10 individual differences, and 3 data quality indicators over the course of the academic semester in 20 participant pools (N = 2,696) and with an online sample (N = 737). Weak time of semester effects were observed on data quality indicators, participant sex, and a few individual differences-conscientiousness, mood, and stress. However, there was little evidence for time of semester qualifying experimental or correlational effects. The generality of this evidence is unknown because only a subset of the tested effects demonstrated evidence for the original result in the whole sample. Mean characteristics of pool samples change slightly during the semester, but these data suggest that those changes are mostly irrelevant for detecting effects. Word count = 151Keywords: social psychology; cognitive psychology; replication; participant pool; individual differences; sampling effects; situational effects 4 Many Labs 3: Evaluating participant pool quality across the academic semester via replication University participant pools provide access to participants for a great deal of published behavioral research. The typical participant pool consists of undergraduates enrolled in introductory psychology courses that require students to complete some number of experiments over the course of the academic semester. Common variations might include using other courses to recruit participants or making study participation an option for extra credit rather than a pedagogical requirement. Research-intensive universities often have a highly organized participant pool with a participant management system for signing up for studies and assigning credit. Smaller or teaching-oriented institutions often have more informal participant pools that are organized ad hoc each semester or for an individual class.To avoid selection bias based on study content, most participant pools have procedures to avoid disclosing the content or purpose of individual studies during the sign-up process.However, students are usually free to choose the time during the semester that they sign up to complete the studies. This may introduce a selection bias in which data collection on different dates occurs with different kinds of participants, or in different situational circumstances (e.g., the carefree semester beginning versus the exam-stressed semester end).If participant characteristics differ across time during the academic semester, then the results of studies may be moderated by the time at which data collection occurs. Indeed, among behavioral researchers there are widespread intuitions, superstitions, and anecdotes about the "best" time to collect data in order to minimize error and maximize power. It is common, for example, to hear stories of an effect being obtained in the first part of the semester that then "d...

One hundred eighty-two patients were evaluated after functional endoscopic sinus surgery. The goal was to establish whether any anatomical finding correlated with symptoms and to find any historical predictors of symptomatic failure. Of all physical findings reviewed, only scarring of middle meatal antrostomy and scarring of the ethmoids approached significance in predicting poor outcome. Surprisingly, of the historical factors reviewed, only gastroesophageal reflux disease was statistically significant as a predictor of poor symptomatic outcome.

Four studies tested the prediction that positive affect (PA) would relate more strongly to meaning in life (MIL) as a function of perceived time limitations. In Study 1 (N = 360), adults completed measures of PA and MIL. As predicted, PA related more strongly to MIL for older, compared to younger, participants. In Studies 2 and 3, adults (N = 514) indicated their current position in their life span, and rated their MIL. PA, whether naturally occurring (Study 2) or induced (Study 3), was a stronger predictor of MIL for individuals who perceived themselves as having a limited amount of time left to live. Finally, in Study 4 (N = 98) students completed a measure of PA, MIL, and future time perspective (FTP). Results showed that PA was more strongly linked to MIL for those who believed they had fewer opportunities left to pursue their goals. Overall, these findings suggest that the experience of PA becomes increasingly associated with the experience of MIL as the perception of future time becomes limited. The contribution of age related processes to judgments of well-being are discussed.

The accumulated circulating Tfh-like cells in lupus patients share phenotypic and functional properties with GC-Tfh cells. Tfh-like cells may serve as perpetuators in the pathogenesis of SLE by enhancing the self-reactive B cell clones to further differentiate into auto antibody-producing plasmablasts, and ultimately cause autoimmunity.

We report on a series of 33 consecutive cases of antrochoanal polyp (ACP) treated by endoscopic sinus surgery over a five-year period. All but one patient was treated by endoscopic sinus surgery alone. This method of treatment was quite effective for ACPs. These 33 patients represent 22.3% of all nasal polyp patients on whom we operated during the same period. This incidence of ACP is greater than that generally reported in the literature. Some authors have attempted to distinguish ACPs from common nasal polyps primarily on the basis of morphology, histology, and the clinical behavior of the ACPs. In our series, a multivariate analysis, including histopathologic correlation, did not support the notion that ACPs are clearly distinct from common nasal polyps. Some interesting differences between the polyp groups did, however, become evident in our data analysis. Generally, ACPs are not thought to be associated with allergic disease; however, in our series we found the association of allergic disease with ACPs to be statistically significant (Chi-square=4.575, p<.05).

The present research used multiple methods to examine the hypothesis that perceived true self-knowledge and decision satisfaction are inextricably linked together by a widely held "true-self-as-guide" lay theory of decision making. Consistent with this proposition, Study 1 found that participants rated using the true self as a guide as more important for achieving personal satisfaction than a variety of other potential decision-making strategies. After establishing the prevalence of this lay theory, the remaining studies then focused on examining the proposed consequent relationship between perceived true self-knowledge and decision satisfaction. Consistent with hypotheses, 2 cross-sectional correlational studies (Studies 2 and 3) found a positive relationship between perceived true self-knowledge and decision satisfaction for different types of major decisions. Study 4 used daily diary methods to demonstrate that fluctuations in perceived true self-knowledge reliably covary with fluctuations in decision satisfaction. Finally, 2 studies directly examined the causal direction of this relationship through experimental manipulation and revealed that the relationship is truly bidirectional. More specifically, Study 5 showed that manipulating perceived knowledge of the true self (but not other self-concepts) directly affects decision satisfaction. Study 6 showed that this effect also works in reverse by manipulating feelings of decision satisfaction, which directly affected perceived knowledge of the true self (but not other self-concepts). Taken together, these studies suggest that people believe the true self should be used as a guide when making major life decisions and that this belief has observable consequences for the self and decision making.