Repli-scooping some of what I find in a soon-to-be finished paper about correlations and effects between reflective reasoning and philosophical thought experiments across multiple participant samples, the Brauer lab finds
- mTurk workers offered lower quality and lower value data than Prolific workers, students, and even CloudResearch's approved mTurk workers
- Qualtrics panels had the least value but moderate quality
- Students seemed to offer the highest value
I forgot to share the #mTurk data quality result that got scooped:
“In late 2020…. Participants from the United States were recruited from Amazon Mechanical Turk, - #CloudResearch, #Prolific, and a #university. One participant source yielded up to 18 times as many low-quality respondents as the other three.”
https://doi.org/10.1093/analys/anaf015
#psychology #philosophy #surveyMethods #quantMethods #dataScience #qualityControl
Reflection-philosophy order effects and correlations across samples