Conducting unsupervised virtual reality user studies online
Research output: Contribution to journal › Journal article › Research › peer-review
Standard
Conducting unsupervised virtual reality user studies online. / Mottelson, Aske; Petersen, Gustav Bøg Lassen; Lilija, Klemen; Makransky, Guido.
In: Frontiers in Virtual Reality, 28.05.2021.Research output: Contribution to journal › Journal article › Research › peer-review
Harvard
APA
Vancouver
Author
Bibtex
}
RIS
TY - JOUR
T1 - Conducting unsupervised virtual reality user studies online
AU - Mottelson, Aske
AU - Petersen, Gustav Bøg Lassen
AU - Lilija, Klemen
AU - Makransky, Guido
PY - 2021/5/28
Y1 - 2021/5/28
N2 - Conducting user studies online and unsupervised instead of in laboratories gives quick access to a large and inexpensive participant pool. It is however unclear if data sourced this way is valid, and what the best practices for conducting unsupervised VR studies are. The restrictions on laboratory access experienced during COVID-19 further necessitate the development of valid procedures for remote data collection, especially for research fields such as VR that heavily rely on laboratory studies. In this paper we report our experiences with conducting two unsupervised VR studies amidst the pandemic, by recruiting participants online on relevant fora and employing participants’ own standalone VR equipment. We investigate whether it is feasible to collect valid data across in-VR survey responses and hand tracking. We report a good reliability of collected data, which requires only slightly more sanitation than a comparable laboratory study. We synthesize our experiences into practical recommendations for conducting unsupervised VR user studies using online recruitment, which can greatly reduce barriers to conducting empirical VR research and improve the quantity of VR user studies, regardless of laboratory availability.
AB - Conducting user studies online and unsupervised instead of in laboratories gives quick access to a large and inexpensive participant pool. It is however unclear if data sourced this way is valid, and what the best practices for conducting unsupervised VR studies are. The restrictions on laboratory access experienced during COVID-19 further necessitate the development of valid procedures for remote data collection, especially for research fields such as VR that heavily rely on laboratory studies. In this paper we report our experiences with conducting two unsupervised VR studies amidst the pandemic, by recruiting participants online on relevant fora and employing participants’ own standalone VR equipment. We investigate whether it is feasible to collect valid data across in-VR survey responses and hand tracking. We report a good reliability of collected data, which requires only slightly more sanitation than a comparable laboratory study. We synthesize our experiences into practical recommendations for conducting unsupervised VR user studies using online recruitment, which can greatly reduce barriers to conducting empirical VR research and improve the quantity of VR user studies, regardless of laboratory availability.
KW - Faculty of Social Sciences
KW - virtual reality
KW - COVID-19
KW - user studies
KW - crowdsourcing
KW - online experiments
U2 - 10.3389/frvir.2021.681482
DO - 10.3389/frvir.2021.681482
M3 - Journal article
JO - Frontiers in Virtual Reality
JF - Frontiers in Virtual Reality
SN - 2673-4192
M1 - 681482
ER -
ID: 291679183