Anwyl-Irvine, Alexander L. Armstrong, Thomas Dalmaijer, Edwin S.
Published in
Behavior Research Methods
Psychological research is increasingly moving online, where web-based studies allow for data collection at scale. Behavioural researchers are well supported by existing tools for participant recruitment, and for building and running experiments with decent timing. However, not all techniques are portable to the Internet: While eye tracking works in...
Eyal, Peer David, Rothschild Andrew, Gordon Zak, Evernden Ekaterina, Damer
Published in
Behavior Research Methods
We examine key aspects of data quality for online behavioral research between selected platforms (Amazon Mechanical Turk, CloudResearch, and Prolific) and panels (Qualtrics and Dynata). To identify the key aspects of data quality, we first engaged with the behavioral research community to discover which aspects are most critical to researchers and ...
Sprengholz, Philipp Betsch, Cornelia
Published in
Behavior Research Methods
Because of the increasing popularity of voice-controlled virtual assistants, such as Amazon’s Alexa and Google Assistant, they should be considered a new medium for psychological and behavioral research. We developed Survey Mate, an extension of Google Assistant, and conducted two studies to analyze the reliability and validity of data collected th...
Fysh, Matthew C. Trifonova, Iliyana V. Allen, John McCall, Cade Burton, A. Mike Bindemann, Markus
Published in
Behavior Research Methods
Experimental psychology research typically employs methods that greatly simplify the real-world conditions within which cognition occurs. This approach has been successful for isolating cognitive processes, but cannot adequately capture how perception operates in complex environments. In turn, real-world environments rarely afford the access and co...
Correia, Ana Isabel Vincenzi, Margherita Vanzella, Patrícia Pinheiro, Ana P. Lima, César F. Schellenberg, E. Glenn
Published in
Behavior Research Methods
We sought to determine whether an objective test of musical ability could be successfully administered online. A sample of 754 participants was tested with an online version of the Musical Ear Test (MET), which had Melody and Rhythm subtests. Both subtests had 52 trials, each of which required participants to determine whether standard and comparis...
Holmqvist, Kenneth Örbom, Saga Lee Zemblys, Raimondas
Published in
Behavior Research Methods
We empirically investigate the role of small, almost imperceptible balance and breathing movements of the head on the level and colour of noise in data from five commercial video-based P-CR eye trackers. By comparing noise from recordings with completely static artificial eyes to noise from recordings where the artificial eyes are worn by humans, w...
Agley, Jon Xiao, Yunyu Nolan, Rachael Golzarri-Arroyo, Lilian
Published in
Behavior Research Methods
Crowdsourced psychological and other biobehavioral research using platforms like Amazon’s Mechanical Turk (MTurk) is increasingly common – but has proliferated more rapidly than studies to establish data quality best practices. Thus, this study investigated whether outcome scores for three common screening tools would be significantly different amo...
Bonavita, Alessia Teghil, Alice Pesola, Maria Chiara Guariglia, Cecilia D’Antonio, Fabrizia Di Vita, Antonella Boccia, Maddalena
Published in
Behavior Research Methods
Several studies investigating environmental navigation require participants to navigate in virtual environments, in which the proprioceptive and vestibular components present during real environmental navigation are lost. Here, we aimed to provide a novel computerized ecological navigational battery, investigating whether the absence of propriocept...
Anwyl-Irvine, Alexander Dalmaijer, Edwin S Hodges, Nick Evershed, Jo K
Published in
Behavior research methods
Due to increasing ease of use and ability to quickly collect large samples, online behavioural research is currently booming. With this popularity, it is important that researchers are aware of who online participants are, and what devices and software they use to access experiments. While it is somewhat obvious that these factors can impact data q...
Bignardi, Giacomo Dalmaijer, Edwin S Anwyl-Irvine, Alexander Astle, Duncan E
Published in
Behavior research methods
Collecting experimental cognitive data with young children usually requires undertaking one-on-one assessments, which can be both expensive and time-consuming. In addition, there is increasing acknowledgement of the importance of collecting larger samples for improving statistical power Button et al. (Nature Reviews Neuroscience 14(5), 365-376, 201...
