This perspective paper explores challenges associated with online crowdsourced data collection, particularly focusing on longitudinal tasks with time-sensitive outcomes like response latencies. Based on our research, we identify two significant sources of bias: technical shortcomings such as low, variable frame rates, and human factors, contributing to high attrition rates. We explored potential solutions to these problems, such as enforcing hardware acceleration and defining study-specific frame rate thresholds, as well as pre-screening participants and monitoring hardware performance and task engagement over each experimental session. With this discussion, we intend to provide recommendations on how to improve the quality and reliability of data collected via online crowdsourced platforms and emphasize the need for researchers to be cognizant of potential pitfalls in online research.
Download full-text PDF |
Source |
|---|---|
| http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10987629 | PMC |
| http://dx.doi.org/10.1038/s41598-024-58300-7 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
The QUIC-SP: A Spanish language tool assessing unpredictability in early life is linked to physical and mental health.
PLoS One
January 2025
Department of Psychology, Crean College of Health and Behavioral Sciences, Chapman University, Orange, California, United States of America.
Accumulating evidence indicates that unpredictable signals in early life represent a unique form of adverse childhood experiences (ACEs) associated with disrupted neurodevelopmental trajectories in children and adolescents. The Questionnaire of Unpredictability in Childhood (QUIC) was developed to assess early life unpredictability [1], encompassing social, emotional, and physical unpredictability in a child's environment, and has been validated in three independent cohorts. However, the importance of identifying ACEs in diverse populations, including non-English speaking groups, necessitates translation of the QUIC.
View Article and Find Full Text PDFMeasuring Talker Age Estimates Through Crowdsourced Listeners' Ratings: A Pilot Study for Voice Research.
J Speech Lang Hear Res
January 2025
Department of Otolaryngology-Head and Neck Surgery, New York University Grossman School of Medicine, NY.
Purpose: Most auditory-perceptual voice research utilizes the judgments of trained listeners rather than everyday listeners with no previous training in speech pathology. Online crowdsourcing of behavioral data from untrained participants is rapidly increasing in popularity but has yet to be a common procedure for auditory-perceptual studies of the voice. The objective of this pilot study was to assess the functionality of this model for judgments of voice by using an online experiment platform to replicate a lab-based, voice-specific age estimation study.
View Article and Find Full Text PDFPHARAOH: A collaborative crowdsourcing platform for phenotyping and regional analysis of histology.
Nat Commun
January 2025
Princess Margaret Cancer Centre, 101 College Street, Toronto, ON, Canada.
Deep learning has proven capable of automating key aspects of histopathologic analysis. However, its context-specific nature and continued reliance on large expert-annotated training datasets hinders the development of a critical mass of applications to garner widespread adoption in clinical/research workflows. Here, we present an online collaborative platform that streamlines tissue image annotation to promote the development and sharing of custom computer vision models for PHenotyping And Regional Analysis Of Histology (PHARAOH; https://www.
View Article and Find Full Text PDFSurgical Dressing Cosmesis in the Immediate Postoperative Setting: A Crowdsourcing-based Study.
Plast Reconstr Surg Glob Open
January 2025
Emory Division of Plastic and Reconstructive Surgery, Atlanta, GA.
Background: Postoperative dressings expedite wound healing and decrease the rate of infection. Options for wound dressings vary based on cost, time to apply, method of wound healing, and availability at the hospital; however, a significant difference in postoperative complications between each type has not been found. As such, this study evaluates patient cosmetic preferences for various wound dressings as it relates to early postoperative satisfaction.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!