CrowdXR - Pitfalls and Potentials of Experiments with Remote Participants

Zhao, Jiayan; Simpson, Mark; Sajjadi, Pejman; Wallgrün, Jan Oliver; Li, Ping; Bagher, Mahda M.; Oprean, Danielle; Padilla, Lace; Klippel, Alexander

doi:10.1109/ismar52148.2021.00062

Cited by 11 publications

(12 citation statements)

References 39 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Similar observations were made by Mottelson et al (2021), reporting on the validity and reliability of remote iVR data while admitting to sampling issues (predominantly male). These findings are also corroborated by Zhao et al (2021).…”

Section: Feasibility and Reliabilitysupporting

confidence: 72%

“…In relation to iVR, Previous work has shown that headset owners that are recruited for remote experiments are not radically different from participants used in in-lab experimental settings at universities, and the data obtained in remote experiments are generally comparable to inlab counterparts (Mottelson and Hornbaek, 2017). While this seems to be a general theme reported in the literature, some researchers, (e.g., Zhao et al, 2021), have noted that the spatial abilities, gender distribution, and gaming frequency of iVR device owner population are very different than the general public.…”

Section: Participantsmentioning

confidence: 83%

“…Gustarini et al (2013) however, have discussed the challenges involved with using user-owned smartphone devices for in-the-wild experiments, including collection and storage of data, user device heterogeneity, recruitment (selfselection) biases, participants' motivation, privacy, and cheating. Notwithstanding, numerous studies have demonstrated the feasibility and validity of this approach in both conventional HCI domains, (e.g., Andreasen et al, 2007;Germine et al, 2012) as well as iVR, (e.g., Steed et al, 2016;Mottelson and Hornbaek, 2017;Saffo et al, 2020;Zhao et al, 2021).…”

Section: Remote Ivr Experimentsmentioning

confidence: 99%

See 2 more Smart Citations

Remote iVR for Nutrition Education: From Design to Evaluation

Sajjadi

Edwards

Zhao

et al. 2022

Front. Comput. Sci.

Self Cite

View full text Add to dashboard Cite

While different crowdsourcing platforms promote remote data collection, experiments in the immersive Virtual Reality (iVR) research community are predominantly performed in person. The COVID-19 pandemic, however, has forced researchers in different disciplines, including iVR, to seriously consider remote studies. In this paper, we present a remote study using the Immersive Virtual Alimentation and Nutrition (IVAN) application, designed to educate users about food-energy density and portion size control. We report on the results of a remote experiment with 45 users using the IVAN app. In IVAN, users actively construct knowledge about energy density by manipulating virtual food items, and explore the concept of portion size control through hypothesis testing and assembling virtual meals in iVR. To explore the feasibility of conducting remote iVR studies using an interactive health-related application for nutrition education, two conditions were devised (interactive vs. passive). The results demonstrate the feasibility of conducting remote iVR studies using health-related applications. Furthermore, the results also indicate that regardless of level of interactivity learners significantly improved their knowledge about portion size control after using the IVAN (p < 0.0001). Adding interactivity, however, suggests that the perceived learning experience of users could be partially affected. Learners reported significantly higher scores for immediacy of control in the interactive condition compared to those in the passive condition (p < 0.05). This study demonstrates the feasibility of conducting an unsupervised remote iVR experiment using a complex and interactive health-related iVR app.

show abstract

Section: Feasibility and Reliabilitysupporting

confidence: 72%

Section: Participantsmentioning

confidence: 83%

Section: Remote Ivr Experimentsmentioning

confidence: 99%

See 1 more Smart Citation

Remote iVR for Nutrition Education: From Design to Evaluation

Sajjadi

Edwards

Zhao

et al. 2022

Front. Comput. Sci.

Self Cite

View full text Add to dashboard Cite

show abstract

“…A few studies have explicitly attempted to replicate lab-based (and sometimes real-world) research findings using a remote sample of participants who own their own VR equipment. In one study [34], lab and remote samples first attempted to memorize locations of 3D points within a VE and, after exiting the VE, performed memory-based distance judgments about inter-point separations. Memorization time was faster for remote participants compared to lab participants, which could reflect differences in spatial ability or differences in familiarity with the controllers and equipment used in this stage of the task.…”

Section: Remote Vr Researchmentioning

confidence: 99%

“…There may also be important differences between participant samples recruited for lab and remote studies [10,34]. For example, remote participants are likely to be older and more diverse than those recruited through the typical university community.…”

Section: Introductionmentioning

confidence: 99%

Remote research on locomotion interfaces for virtual reality: Replication of a lab-based study on teleporting interfaces

Kelly

Hoover

Doty

et al. 2022

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

Fig. 1. The diagram on the left depicts the triangle completion task. The participant traveled sequentially to three locations marked by vertical posts (green, then yellow, then red) before attempting to point to the remembered location of the green post. Screenshots show perspective views of the three posts marking the triangle as well as the response. The top row shows the partially concordant teleporting interface, where the participant teleports to translate but rotates using the body. The top row also depicts the large virtual environment. The bottom row shows the discordant teleporting interface, where the participant teleports to translate and rotate. The bottom row also depicts the small virtual environment.

show abstract

Isovists compactness and stairs as predictors of evacuation route choice

Snopková

Cock

Juřík

et al. 2023

Sci Rep

View full text Add to dashboard Cite

The building design is a crucial factor that can be actively adjusted and optimized to prevent human and property threats in emergency scenarios. Previous research suggests that specific building layouts may significantly influence human behaviour during evacuation. However, detailed empirical data about human behaviour in various types of buildings with different layouts are still missing and only marginal recommendations from this field are reflected in actual construction practice. In this study, desktop VR technologies were employed to study human decision-making in problematic T-intersections in the context of an emergency evacuation. More specifically, we studied fundamental attributes of buildings such as the width and length of the corridors and the presence of stairs to explore how they influence the choice of the evacuation route. The space-syntax isovist method was used to describe spatial parameters of corridors, which makes the results applicable to all buildings. Behavioural data from 208 respondents were analysed using multilevel regression models. Our results support previous claims concerning the importance of specific spatial layouts of evacuation corridors because respondents systematically chose wider and shorter corridors with visible staircases as the preferred evacuation route. The present findings further promote the ongoing discussion on the design of marked evacuation routes and building design that takes human factors into consideration.

show abstract

CrowdXR - Pitfalls and Potentials of Experiments with Remote Participants

Cited by 11 publications

References 39 publications

Remote iVR for Nutrition Education: From Design to Evaluation

Remote iVR for Nutrition Education: From Design to Evaluation

Remote research on locomotion interfaces for virtual reality: Replication of a lab-based study on teleporting interfaces

Isovists compactness and stairs as predictors of evacuation route choice

Contact Info

Product

Resources

About