Is a Non-Representative Convenience Sample Good Enough? Insights from an Economic Experiment
Date
2022-11-19
Journal Title
Journal ISSN
Volume Title
Publisher
Department of Applied Economics and Statistics, University of Delaware, Newark, DE.
Abstract
Keywords: Non-representative convenience sampling, field experiments, online recruitment, representative sampling
Recruitment of representative and generalizable samples is a major challenge for researchers conducting economic field experiments. Limited access to representative samples or the high cost of obtaining them often leads to the recruitment of non-representative convenience samples. This research compares the findings from two field experiments involving 860 adults: one from a non-representative in-person convenience sample and one from a representative online counterpart. We find no meaningful differences in the key behaviors of interest between these two samples. These findings contribute to a growing body of literature demonstrating that non-representative convenience samples can be sufficient in certain contexts.
Recruitment of representative and generalizable samples is a major challenge for researchers conducting economic field experiments. Limited access to representative samples or the high cost of obtaining them often leads to the recruitment of non-representative convenience samples. This research compares the findings from two field experiments involving 860 adults: one from a non-representative in-person convenience sample and one from a representative online counterpart. We find no meaningful differences in the key behaviors of interest between these two samples. These findings contribute to a growing body of literature demonstrating that non-representative convenience samples can be sufficient in certain contexts.