Pipelines Bent, Pipelines Broken: Interdisciplinary Self-Reflection on the Impact of COVID-19 on Current and Future Research (Position Paper)

Abstract

Among the many changes brought about by the COVID-19 pandemic, one of the most pressing for scientific research concerns user testing. For the researchers who conduct studies with human participants, the requirements for social distancing have created a need for reflecting on methodologies that previously seemed relatively straightforward. It has become clear from the emerging literature on the topic and from first-hand experiences of researchers that the restrictions due to the pandemic affect every aspect of the research pipeline. The current paper offers an initial reflection on user-based research, drawing on the authors' own experiences and on the results of a survey that was conducted among researchers in different disciplines, primarily psychology, human-computer interaction (HCI), and visualization communities. While this sampling of researchers is by no means comprehensive, the multidisciplinary approach and the consideration of different aspects of the research pipeline allow us to examine current and future challenges for user-based research. Through an exploration of these issues, this paper also invites others in the VISas well as in the wider-research community, to reflect on and discuss the ways in which the current crisis might also present new and previously unexplored opportunities.

Process and Pitfalls of Online Teaching and Learning with Design Study “Lite” Methodology: A Retrospective Analysis

“…Following the outbreak of the COVID‐19 global pandemic, the need to revisit previously‐straightforward methodologies and research pipelines of studies that require human participation at different levels has gained amplified interest. There are challenges involved in shifting user‐centric studies to alternative or online methods [BAM * 20]. It should be noted that many of the lessons learned while implementing DSLM online, especially those in regard to collaboration and communication, can also have implications for online design studies in general, be it in pedagogy or research.…”

ReActLab: A Custom Framework for Sensorimotor Experiments “in-the-wild”

“…In these settings, participants are usually recruited on-site among students or other interested visitors. Unsurprisingly, when the COVID-19 pandemic began in early 2020, the work pipeline revolving around this type of research was heavily disrupted, and researchers needed to adapt almost overnight to the unprecedented situation in order to continue collecting experimental data ( Balestrucci et al, 2020 ).…”