Open-source tutorials benefit the field

Wan, Freda; Toivo, Wilhelmiina; Paterson, Helena; Nordmann, Emily; McAleer, Phil; Mavromati, Kalliopi; Lai, Rebecca J.; Kuepper-Tetzel, Carolina E.; DeBruine, Lisa; Bartlett, James E.; Barr, Dale J.

doi:10.1038/s44159-022-00058-8

Cited by 3 publications

(1 citation statement)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In terms of incentives, sharing of data and other research materials is promoted through community guidelines such as FAIR (58) and TOP (34), as well as policies such as the European Union strategy for open science (7). How these schemes translate into changes in how hiring or promotion committees act, for example, or alter the academic prestige economy, will be key for changing stimulus presentation code sharing behaviour (11,57). Some prior work has suggested that data sharing can lead to the relevant work being cited more (9,41,60).…”

Section: Discussionmentioning

confidence: 99%

A survey of experimental stimulus presentation code sharing in major areas of psychology

Rawal,

Truong,

et al. 2024

Behav Res

View full text Add to dashboard Cite

Computer code plays a vital role in modern science, from the conception and design of experiments through to final data analyses. Open sharing of code has been widely discussed as being advantageous to the scientific process, allowing experiments to be more easily replicated, helping with error detection, and reducing wasted effort and resources. In the case of psychology, the code used to present stimuli is a fundamental component of many experiments. It is not known, however, the degree to which researchers are sharing this type of code. To estimate this, we conducted a survey of 400 psychology papers published between 2016 and 2021, identifying those that openly share stimulus presentation code. For those that did, we established if it would run following download and also appraised the code's usability in terms of style and documentation. It was found that only 8.4% of papers shared stimulus code, compared to 17.9% sharing analysis code and 31.7% sharing data. Of shared code, 70% ran directly or after minor corrections. For code that did not run, the main error was missing dependencies (66.7%). The usability of the code was moderate, with low levels of code annotation and minimal documentation provided. These results suggest that stimulus presentation code sharing lags behind other forms of code and data sharing, potentially due to less emphasis on such code in open-science discussions and in journal policies. The results also highlight a need for improved documentation to maximise code utility.

show abstract

Section: Discussionmentioning

confidence: 99%

A survey of experimental stimulus presentation code sharing in major areas of psychology

Rawal,

Truong,

et al. 2024

Behav Res

View full text Add to dashboard Cite

show abstract

New constraints on the Middle-Late Pleistocene Campi Flegrei explosive activity and Mediterranean tephrostratigraphy (∼160 ka and 110–90 ka)

Fernandez,

Giaccio,

Costa

et al. 2024

Quaternary Science Reviews

View full text Add to dashboard Cite

How do you Behave as a Psychometrician? Research Conduct in the Context of Psychometric Research

Flores-Kanter

Mosquera

2023

Span. J. Psychol.

View full text Add to dashboard Cite

The identification of fraudulent and questionable research conduct is not something new. However, in the last 12 years the aim has been to identify specific problems and concrete solutions applicable to each area of knowledge. For example, previous work has focused on questionable and responsible research conducts associated with clinical assessment, measurement practices in psychology and related sciences; or applicable to specific areas of study, such as suicidology. One area of study that merits further study of questionable and responsible research behaviors is psychometrics. Focusing on psychometric research is important and necessary, as without adequate evidence of construct validity the overall validity of the research is at least debatable. Our interest here is to (a) identifying questionable research conduct specifically linked to psychometric studies; and (b) promoting greater awareness and widespread application of responsible research conduct in psychometrics research. We believe that the identification and recognition of these conducts is important and will help us to improve our daily work as psychometricians.

show abstract

Open-source tutorials benefit the field

Cited by 3 publications

References 9 publications

A survey of experimental stimulus presentation code sharing in major areas of psychology

A survey of experimental stimulus presentation code sharing in major areas of psychology

New constraints on the Middle-Late Pleistocene Campi Flegrei explosive activity and Mediterranean tephrostratigraphy (∼160 ka and 110–90 ka)

How do you Behave as a Psychometrician? Research Conduct in the Context of Psychometric Research

Contact Info

Product

Resources

About