52% Yes, a signiicant crisis 3% No, there is no crisis 7% Don't know 38% Yes, a slight crisis 38% Yes, a slight crisis 1,576 RESEARCHERS SURVEYED M ore than 70% of researchers have tried and failed to reproduce another scientist's experiments, and more than half have failed to reproduce their own experiments. Those are some of the telling figures that emerged from Nature's survey of 1,576 researchers who took a brief online questionnaire on reproducibility in research. The data reveal sometimes-contradictory attitudes towards reproduc-ibility. Although 52% of those surveyed agree that there is a significant 'crisis' of reproducibility, less than 31% think that failure to reproduce published results means that the result is probably wrong, and most say that they still trust the published literature. Data on how much of the scientific literature is reproducible are rare and generally bleak. The best-known analyses, from psychology 1 and cancer biology 2 , found rates of around 40% and 10%, respectively. Our survey respondents were more optimistic: 73% said that they think that at least half of the papers in their field can be trusted, with physicists and chemists generally showing the most confidence. The results capture a confusing snapshot of attitudes around these issues, says Arturo Casadevall, a microbiologist at the Johns Hopkins Bloomberg School of Public Health in Baltimore, Maryland. "At the current time there is no consensus on what reproducibility is or should be. " But just recognizing that is a step forward, he says. "The next step may be identifying what is the problem and to get a consensus. "
We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was administered to approximately half of 125 samples that comprised 15,305 participants from 36 countries and territories. Using the conventional criterion of statistical significance ( p < .05), we found that 15 (54%) of the replications provided evidence of a statistically significant effect in the same direction as the original finding. With a strict significance criterion ( p < .0001), 14 (50%) of the replications still provided such evidence, a reflection of the extremely high-powered design. Seven (25%) of the replications yielded effect sizes larger than the original ones, and 21 (75%) yielded effect sizes smaller than the original ones. The median comparable Cohen’s ds were 0.60 for the original findings and 0.15 for the replications. The effect sizes were small (< 0.20) in 16 of the replications (57%), and 9 effects (32%) were in the direction opposite the direction of the original effect. Across settings, the Q statistic indicated significant heterogeneity in 11 (39%) of the replication effects, and most of those were among the findings with the largest overall effect sizes; only 1 effect that was near zero in the aggregate showed significant heterogeneity according to this measure. Only 1 effect had a tau value greater than .20, an indication of moderate heterogeneity. Eight others had tau values near or slightly above .10, an indication of slight heterogeneity. Moderation tests indicated that very little heterogeneity was attributable to the order in which the tasks were performed or whether the tasks were administered in lab versus online. Exploratory comparisons revealed little heterogeneity between Western, educated, industrialized, rich, and democratic (WEIRD) cultures and less WEIRD cultures (i.e., cultures with relatively high and low WEIRDness scores, respectively). Cumulatively, variability in the observed effect sizes was attributable more to the effect being studied than to the sample or setting in which it was studied.
Conspiracy theories can form a monological belief system: A self-sustaining worldview comprised of a network of mutually supportive beliefs. The present research shows that even mutually incompatible conspiracy theories are positively correlated in endorsement. In Study 1 ( n = 137), the more participants believed that Princess Diana faked her own death, the more they believed that she was murdered. In Study 2 ( n = 102), the more participants believed that Osama Bin Laden was already dead when U.S. special forces raided his compound in Pakistan, the more they believed he is still alive. Hierarchical regression models showed that mutually incompatible conspiracy theories are positively associated because both are associated with the view that the authorities are engaged in a cover-up (Study 2). The monological nature of conspiracy belief appears to be driven not by conspiracy theories directly supporting one another but by broader beliefs supporting conspiracy theories in general.
Recent research into the psychology of conspiracy belief has highlighted the importance of belief systems in the acceptance or rejection of conspiracy theories. We examined a large sample of conspiracist (pro-conspiracy-theory) and conventionalist (anti-conspiracy-theory) comments on news websites in order to investigate the relative importance of promoting alternative explanations vs. rejecting conventional explanations for events. In accordance with our hypotheses, we found that conspiracist commenters were more likely to argue against the opposing interpretation and less likely to argue in favor of their own interpretation, while the opposite was true of conventionalist commenters. However, conspiracist comments were more likely to explicitly put forward an account than conventionalist comments were. In addition, conspiracists were more likely to express mistrust and made more positive and fewer negative references to other conspiracy theories. The data also indicate that conspiracists were largely unwilling to apply the “conspiracy theory” label to their own beliefs and objected when others did so, lending support to the long-held suggestion that conspiracy belief carries a social stigma. Finally, conventionalist arguments tended to have a more hostile tone. These tendencies in persuasive communication can be understood as a reflection of an underlying conspiracist worldview in which the details of individual conspiracy theories are less important than a generalized rejection of official explanations.
The present study investigates the characteristics of discussion of conspiracy theories about the Zika virus outbreak of 2015–16 on Twitter. Content and social network analysis of a dataset of 25,162 original Tweets about Zika virus conspiracy theories showed that relative to debunking messages, conspiracy theories spread through a more decentralized network, are more likely to invoke supposedly knowledgeable authorities in making arguments, and ask more rhetorical questions. These trends can be understood in the context of previous work on conspiracy theories, including the “just asking questions” style of rhetoric, the importance of sourcing and authority, and the tendency to simultaneously consider many different potential conspiracies that might underlie an important topic or event.
“Conspiracy theory” is widely acknowledged to be a loaded term. Politicians use it to mock and dismiss allegations against them, while philosophers and political scientists warn that it could be used as a rhetorical weapon to pathologize dissent. In two empirical studies conducted on Amazon Mechanical Turk, I present an initial examination of whether this concern is justified. In Experiment 1, 150 participants judged a list of historical and speculative theories to be no less likely when they were labeled “conspiracy theories” than when they were labeled “ideas.” In Experiment 2 (N = 802), participants who read a news article about fictitious “corruption allegations” endorsed those allegations no more than participants who saw them labeled “conspiracy theories.” The lack of an effect of the conspiracy‐theory label in both experiments was unexpected and may be due to a romanticized image of conspiracy theories in popular media or a dilution of the term to include mundane speculation regarding corruption and political intrigue.
Studies of expertise have typically shown that experts have better memory for materials from their fields than do novices. However, previous research on memory for maps has not shown the expected effect of expertise. The present study differed from previous studies by using contour maps as well as planimetric maps. In Experiment 1 the expected superiority in memory performance was found for skilled map readers when contour maps were used, but not when planimetric maps were used. In Experiment 2, the main results of Experiment 1 were replicated, and, in addition, process tracing data were obtained during both study and test phases of contour map learning. Objective measures of attentional and retrieval focussing revealed almost no differences between the skilled and unskilled subjects. However, analyses of verbal protocols showed that the skilled subjects made more use of specialist schemata, whereas the unskilled subjects spent more time in reading place names. During recall, the skilled subjects made more use of both specialist and “lay” schemata, whereas the unskilled retrieved more place-name information. The results are interpreted in terms of a schema-based approach to expertise.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.