The Experiment Factory: Reproducible Experiment Containers

Sochat, Vanessa

doi:10.21105/joss.00521

Cited by 21 publications

(17 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Stroop . The Stroop task [63] was administered via computer using a preprogrammed script from Experiment Factory [69]. Experiment Factory is an online repository that publishes experiments with the intent of improving replicability.…”

Section: Methodsmentioning

confidence: 99%

Single session high definition transcranial direct current stimulation to the cerebellum does not impact higher cognitive function

et al. 2019

View full text Add to dashboard Cite

The prefrontal cortex is central to higher order cognitive function. However, the cerebellum, generally thought to be involved in motor control and learning, has also been implicated in higher order cognition. Recent work using transcranial direct current stimulation (tDCS) provides some support for right cerebellar involvement in higher order cognition, though the results are mixed, and often contradictory. Here, we used cathodal high definition tDCS (HD-tDCS) over the right cerebellum to assess the impact of HD-tDCS on modulating cognitive performance. We predicted that stimulation would result in performance decreases, which would suggest that optimal cerebellar function is necessary for cognitive performance, much like the prefrontal cortex. That is, it is not simply a structure that lends support to complete difficult tasks. While the expected cognitive behavioral effects were present, we did not find effects of stimulation. This has broad implications for cerebellar tDCS research, particularly for those who are interested in using HD-tDCS as a way of examining cerebellar function. Further implications, limitations, and future directions are discussed with particular emphasis on why null findings might be critical in developing a clear picture of the effects of tDCS on the cerebellum.

show abstract

Section: Methodsmentioning

confidence: 99%

Single session high definition transcranial direct current stimulation to the cerebellum does not impact higher cognitive function

et al. 2019

View full text Add to dashboard Cite

show abstract

“…Familiarity with Docker is also helpful because major tools in neighboring fields have moved to using the Docker format, such as the standardized fMRI preprocessing pipeline fmriprep (fmriprep.org; Esteban et al, 2019). In psychology, similar trends are emerging with projects like the Experiment Factory, which allows creating Docker containers to ensure behavioral experiments can run smoothly across platforms (expfactory.github.io; Sochat, 2018).…”

Section: Docker Id Username On Docker Hubmentioning

confidence: 99%

Leveraging Containers for Reproducible Psychological Research

Wiebels¹,

Moreau²

2021

Preprint

View full text Add to dashboard Cite

Containers have become increasingly popular in computing and software engineering, and are gaining traction in scientific research. They allow packaging up all code and dependencies to ensure that analyses run reliably across a range of operating systems and software versions. Despite being a crucial component for reproducible science, containerization has yet to become mainstream in psychology. In this tutorial, we describe the logic behind containers, what they are, and the practical problems they can solve. We walk the reader through the implementation of containerization within a research workflow, with examples using Docker and R. Specifically, we describe how to use existing containers, build personalized containers, and share containers alongside publications. We provide a worked example that includes all steps required to set up a container for a research project and can easily be adapted and extended. We conclude with a discussion of the possibilities afforded by the large-scale adoption of containerization, especially in the context of cumulative, open science, toward a more efficient and inclusive research ecosystem.

show abstract

“…Another export option creates the code required for integration in survey tools such as the proprietary services Qualtrics (Qualtrics, 2016) or SoSci Survey (Leiner, 2014), and open-source alternatives like the powerful survey frameworks Formr (Arslan, Walther, & Tata, in press) or LimeSurvey (Limesurvey GmbH, 2018). Beyond that, the builder provides a direct export to The Experiment Factory (Sochat et al, 2016;Sochat, 2018) Through all of these deployment options, we aim to support a wide range of data collection scenarios, so that lab.js can be used by researchers regardless of their technical experience and the infrastructure at their disposal. Across all alternatives, we automatically implement best practices for online research wherever possible, with the least amount of effort on part of the user.…”

Section: Deploying a Study For Data Collectionmentioning

confidence: 99%

lab.js: A free, open, online study builder

Henninger¹,

Shevchenko²,

Mertens³

et al. 2019

Preprint

View full text Add to dashboard Cite

Web-based data collection is increasingly popular in both experimental and survey-based research, because it is flexible, efficient and location-independent. While dedicated software for laboratory-based experimentation and online surveys is commonplace, researchers looking to implement experiments in the browser have, heretofore, often had to manually construct their studies’ content and logic using code. We introduce lab.js, a free, open-source experiment builder that makes it easy to build experiments for both online and in-laboratory data collection. Through its visual interface, stimuli can be designed and combined into a study without programming, though studies’ appearance and behavior can be fully customized using HTML, CSS and JavaScript code if required. Presentation and response times are kept and measured with high accuracy and precision heretofore unmatched in browser-based studies. Experiments constructed with lab.js can be run directly on a local computer, and published online with ease, with direct deployment to cloud hosting, export to any web server, and integration with popular data collection tools. Studies can also be shared in an editable format, archived, re-used and adapted, enabling effortless, transparent replications, and thus facilitating open, cumulative science. The software is provided free of charge under an open-source license; further information, code and extensive documentation are available from https://lab.js.org/.

show abstract

The Experiment Factory: Reproducible Experiment Containers

Cited by 21 publications

References 9 publications

Single session high definition transcranial direct current stimulation to the cerebellum does not impact higher cognitive function

Single session high definition transcranial direct current stimulation to the cerebellum does not impact higher cognitive function

Leveraging Containers for Reproducible Psychological Research

lab.js: A free, open, online study builder

Contact Info

Product

Resources

About