52% Yes, a signiicant crisis 3% No, there is no crisis 7% Don't know 38% Yes, a slight crisis 38% Yes, a slight crisis 1,576 RESEARCHERS SURVEYED M ore than 70% of researchers have tried and failed to reproduce another scientist's experiments, and more than half have failed to reproduce their own experiments. Those are some of the telling figures that emerged from Nature's survey of 1,576 researchers who took a brief online questionnaire on reproducibility in research. The data reveal sometimes-contradictory attitudes towards reproduc-ibility. Although 52% of those surveyed agree that there is a significant 'crisis' of reproducibility, less than 31% think that failure to reproduce published results means that the result is probably wrong, and most say that they still trust the published literature. Data on how much of the scientific literature is reproducible are rare and generally bleak. The best-known analyses, from psychology 1 and cancer biology 2 , found rates of around 40% and 10%, respectively. Our survey respondents were more optimistic: 73% said that they think that at least half of the papers in their field can be trusted, with physicists and chemists generally showing the most confidence. The results capture a confusing snapshot of attitudes around these issues, says Arturo Casadevall, a microbiologist at the Johns Hopkins Bloomberg School of Public Health in Baltimore, Maryland. "At the current time there is no consensus on what reproducibility is or should be. " But just recognizing that is a step forward, he says. "The next step may be identifying what is the problem and to get a consensus. "
An academic scientist’s professional success depends on publishing. Publishing norms emphasize novel, positive results. As such, disciplinary incentives encourage design, analysis, and reporting decisions that elicit positive results and ignore negative results. Prior reports demonstrate how these incentives inflate the rate of false effects in published science. When incentives favor novelty over replication, false results persist in the literature unchallenged, reducing efficiency in knowledge accumulation. Previous suggestions to address this problem are unlikely to be effective. For example, a journal of negative results publishes otherwise unpublishable reports. This enshrines the low status of the journal and its content. The persistence of false findings can be meliorated with strategies that make the fundamental but abstract accuracy motive – getting it right – competitive with the more tangible and concrete incentive – getting it published. We develop strategies for improving scientific practices and knowledge accumulation that account for ordinary human motivations and biases.
No abstract
An academic scientist's professional success depends on publishing. Publishing norms emphasize novel, positive results. As such, disciplinary incentives encourage design, analysis, and reporting decisions that elicit positive results and ignore negative results. Prior reports demonstrate how these incentives inflate the rate of false effects in published science. When incentives favor novelty over replication, false results persist in the literature unchallenged, reducing efficiency in knowledge accumulation. Previous suggestions to address this problem are unlikely to be effective. For example, a journal of negative results publishes otherwise unpublishable reports. This enshrines the low status of the journal and its content. The persistence of false findings can be meliorated with strategies that make the fundamental but abstract accuracy motive-getting it right-competitive with the more tangible and concrete incentive-getting it published. This article develops strategies for improving scientific practices and knowledge accumulation that account for ordinary human motivations and biases.
Here, we advance the ideological migration hypothesis -individuals choose to live in communities with ideologies similar to their own to satisfy their need to belong. In Study 1, incongruity between personal and community ideology predicted greater residential mobility and attraction to more ideologically-congruent communities. In Study 2, participants who perceived their ideology to be at odds with their community's displayed a decreased sense of belonging and an increased desire to migrate. In Studies 3 and 4, participants induced to view their current community as growing more incongruent with their own ideology expressed a decreased sense of belonging and an increased desire to migrate. Ideological migration may contribute to the rise in cultural, moral, and ideological segregation and polarization of the American electorate.
Research suggesting that political conservatives are happier than political liberals has relied exclusively on self-report measures of subjective well-being. We show that this finding is fully mediated by conservatives' self-enhancing style of self-report (study 1; N = 1433) and then describe three studies drawing from "big data" sources to assess liberal-conservative differences in happiness-related behavior (studies 2 to 4; N = 4936). Relative to conservatives, liberals more frequently used positive emotional language in their speech and smiled more intensely and genuinely in photographs. Our results were consistent across large samples of online survey takers, U.S. politicians, Twitter users, and LinkedIn users. Our findings illustrate the nuanced relationship between political ideology, self-enhancement, and happiness and illuminate the contradictory ways that happiness differences can manifest across behavior and self-reports.
The scientific quality of social and personality psychology has been debated at great length in recent years. Despite research on the prevalence of Questionable Research Practices (QRPs) and the replicability of particular findings, the impact of the current discussion on research practices is unknown. The current studies examine whether and how practices have changed, if at all, over the last 10 years. In Study 1, we surveyed 1,166 social and personality psychologists about how the current debate has affected their perceptions of their own and the field's research practices. In Study 2, we coded the research practices and critical test statistics from social and personality psychology articles published in 2003-2004 and 2013-2014. Together, these studies suggest that (a) perceptions of the current state of the field are more pessimistic than optimistic; (b) the discussion has increased researchers' intentions to avoid QRPs and adopt proposed best practices, (c) the estimated replicability of research published in 2003-2004 may not be as bad as many feared, and (d) research published in 2013-2014 shows some improvement over research published in 2003-2004, a result that suggests the field is evolving in a positive direction. (PsycINFO Database Record
Number of citations and the h-index are popular metrics for indexing scientific impact. These, and other existing metrics, are strongly related to scientists' seniority. This article introduces complementary indicators that are unrelated to the number of years since PhD. To illustrate cumulative and career-stage approaches for assessing the scientific impact across a discipline, citations for 611 scientists from 97 U.S. and Canadian social psychology programs are amassed and analyzed. Results provide benchmarks for evaluating impact across the career span in psychology and other disciplines with similar citation patterns. Career-stage indicators provide a very different perspective on individual and program impact than cumulative impact, and may predict emerging scientists and programs. Comparing social groups, Whites and men had higher impact than non-Whites and women, respectively. However, average differences in career stage accounted for most of the difference for both groups.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.