Whether you’re new to the field of online research or looking to improve your skills on new platforms, we’re here to help. Our guide will you walk you through the basic concepts and terminology behind data quality, teach you to effectively evaluate and groom your own data sets, and give you a practical introduction to implementing data quality processes at your company.
If you were a researcher studying human behavior 30 years ago, your options for identifying participants to take part in your studies were limited. If you worked at a university, you might be able to rely on a student subject pool, or, with a lot of legwork, identify people in the community to participate in your studies. If you worked in industry, your company might conduct a focus group, or hire an outside firm to conduct a phone survey, mail survey, or an in-person study with your target audience. Either way, the options for finding participants were slow, costly, and restrictive.
As a researcher, you know that planning studies, designing materials, and collecting data takes a lot of work. So, when you get your hands on a new dataset, the first thing you want to do is start testing your ideas. Were your hypotheses supported? Which marketing campaign should you launch? How do consumers feel about your new product? These are the types of questions you want answers to. But before you can draw conclusions from your data, you need to inspect and clean them, which entails identifying and removing problem participants.
Technology has transformed behavioral science research. Researchers today can quickly access participants from all over the world and collect data in ways not possible in the past. Key to this transformation has been online participant recruitment platforms like Mechanical Turk and market research panels. Although these panels offer the opportunity to conduct research quickly and efficiently, they also pose some unique opportunities and challenges for managing data quality. Not all platforms are built the same way or are equally valid for different types of research.
Collecting quality data begins with selecting the right participants. A phrase common in many research circles is that participant selection should be “fit for purpose.” This means that the participants a researcher selects for a study should be well-suited for finding answers to the questions that motivated the study.