Litman, L., Robinson, J. (2020). Conducting Online Research on Amazon Mechanical Turk and Beyond. April, 2020. Sage Publications. https//
A guide to the world of online research and how to optimally carry out research projects with online samples.

Peer-Reviewed Publications:

Litman, L., Robinson, J., & Abberbock, T. (2017). A versatile crowdsourcing data acquisition platform for the behavioral sciences. Behavior research methods, 49(2), 433-442.
A description of the purposes and features of the CloudResearch MTurk Toolkit.

Chandler, J., Rosenzweig, C., Moss, A. J., Robinson, J., & Litman, L. (2019). Online panels in social science research: Expanding sampling methods beyond Mechanical Turk. Behavior research methods, 51(5), 2022-2038.
Study examining data quality and participants representativeness of Prime Panels as a participant recruitment platform.

Robinson, J., Rosenzweig, C., Moss, A.J., Litman, L. (2019) Tapped out or barely tapped? Recommendations for how to harness the vast and largely unused potential of the Mechanical Turk participant pool. PLoS ONE 14(12): e0226394.
Analysis of the size of the MTurk participant tool, and suggestions for how to apply better sampling strategies to reach less experienced high-quality participants.

Moss, A. J., Rosenzweig, C., Robinson, J., & Litman, L. (2020). Is it Ethical to Use Mechanical Turk for Behavioral Research? Relevant Data from a Representative Survey of MTurk Participants and Wages. Manuscript submitted for publication.
Exploration of MTurk workers’ views of MTurk, satisfaction with requesters, and hourly wages.

Moss, A. J., Rosenzweig, C., Robinson, J., & Litman, L. (2020). Demographic Stability on Mechanical Turk Despite COVID-19. Trends in Cognitive Sciences.
Commentary on the stability of participant demographics on MTurk from Jan. 2019 through May 2020, a time frame that includes the first three months of the COVID-19 pandemic.

Litman, L., Robinson, J., & Rosenzweig, C. (2015). The relationship between motivation, monetary compensation, and data quality among US-and India-based workers on Mechanical Turk. Behavior research methods, 47(2), 519-528.
Examination of the impacts of compensation on data quality on MTurk.

Fordsham, N., Moss, A. J., Krumholtz, S., Roggina, T., Robinson, J., & Litman, L. (2019).Variation among Mechanical Turk Workers Across Time of Day Presents an Opportunity and a Challenge for Research. Manuscript submitted for publication.
How participant demographics and clinical symptomatology differ across time of day, and best practices for recruitment.

Litman, L., Robinson, J., Rosen, Z., Rosenzweig, C., Waxman, J., & Bates, L. M. (2020). The persistence of pay inequality: The gender wage gap in an anonymous online labor market. PloS ONE 15(2): e0229383.
Description of the gender pay gap on MTurk and suggestions for how to pay equally.

Litman, L., Robinson, J., Weinberger-Litman, S. L., & Finkelstein, R. (2019). Both intrinsic and extrinsic religious orientation are positively associated with attitudes toward cleanliness: Exploring multiple routes from godliness to cleanliness. Journal of Religion and Health, 58(1), 41-52.
Best practices for sampling specific groups of individuals on MTurk.

Litman, L., Williams, M. T., Rosen, Z., Weinberger-Litman, S. L., & Robinson, J. (2018). Racial disparities in cleanliness attitudes mediate purchasing attitudes toward cleaning products: A serial mediation model. Journal of Racial and Ethnic Health Disparities, 5(4), 838-846.
Best practices for accurately sampling minorities.

Schnur, J. B., Chaplin, W. F., Khurshid, K., Mogavero, J. N., Goldsmith, R. E., Lee, Y. S., … & Montgomery, G. H. (2017). Development of the Healthcare Triggering Questionnaire in adult sexual abuse survivors. Psychological Trauma: Theory, Research, Practice, and Policy, 9(6), 714.
Collecting open-ended data for scale development using online participants.

Litman, L., Rosen, Z., Spierer, D., Weinberger-Litman, S., Goldschein, A., & Robinson, J. (2015). Mobile exercise apps and increased leisure time exercise activity: A moderated mediation analysis of the role of self-efficacy and barriers. Journal of medical Internet research, 17(8), e195.
Explored how health behaviors of MTurkers conform to expected results and explored new behavioral health models relating to the relationship between the use of exercise apps and health.

CloudResearch Blogs and Other Resources:

New Solutions Dramatically Improve Research Data Quality on MTurk

Best Practices That Can Affect Data Quality on MTurk

After the Bot Scare: Understanding What’s Been Happening with Data Collection on MTurk and How to Stop it

Mask Wearing Is Not Just About Political Party: Regional Infection-Rate Density Plays a Big Role in Who Is Wearing a Mask, and This Has Important Implications for Survey Sampling

No, Americans Are Not Gargling Bleach: How Bad Survey Data Inflated Estimates in the Latest CDC Report – and How to Prevent This from Happening in the Future

Surveying the First Quarantined Community in the United States: Lessons Learned About Psychology and Public Health

What Is It Like To Participate In Online Research On Amazon Mechanical Turk?

The Superworker Sampling Bias on Mechanical Turk

Data quality on MTurk compared to other online panels

The size of the MTurk population

Running Longitudinal Studies on CloudResearch

What is Prime Panels?

The Gender Pay gap on MTurk and how to address it

Anonymize Mechanical Turk Worker IDs

A Guide to Statistical Significance

A Guide to Market Segmentation

A Guide to Sampling Methodology

A Guide to Data Quality