Yes! We are committed to ensuring the highest quality of results from our testing, and one key component of this is sample quality.
We address this at two levels:
Panel side:
Realeyes’ panels are composed of a diverse group of suppliers. Each supplier has a variety of recruitment/sourcing methods. Drawing from a wide range of suppliers and recruitment methods enables buyers to reach the broadest spectrum of respondents.
Some of those sourcing methods include: ads and promotions across various digital networks, search engine results, word of mouth and membership referrals, social networks, online and mobile games, affiliate marketing, banner ads, offerwalls, TV and radio ads, and offline recruitment. A few of the most common supply partner categories include double opt-in panels, publishing networks, real time social media campaigns, and other types of online communities. The majority of respondents originate from double opt-in suppliers.
In terms of respondent verification, panels can authenticate demographic information of its panelists in multiple ways - the methods utilised depends upon the panel. All survey data is 1st party. That is, it is collected by suppliers directly from their panelists. Typically this self-reported information is collected via profiling quizzes or other forms of questions.
Suppliers use a variety of methods to validate the identities of their respondents, which includes text messages, postcards, or other forms of public data validation. Some even track answers over time to ensure consistency and flag any discrepancies they find.
Each supplier will be different and will recruit, verify and advertise surveys in different ways, and as such there is no one all encompassing solution.
Realeyes side:
Our quality control process makes sure that the participants that take are surveys are valid. However, we don’t have control over what they are writing. As in a real environment, we do get a few participants that are not interested in spending their time and writing quality responses. They usually comprise ~2% of the overall sample - not significant enough to shift any of the other analyses, and are marked as Ambiguous in our sentiment analysis.
Realeyes' testing process is designed to maximize the prospects of participants reacting naturally to content. Intrusive quality checks would put participants on high alert and pollute the quality of their response (because it is altered by the test conditions).
As part of our QC, we exclude sessions where:
- Participants don’t meet the technical requirements (webcam, browser, IP address, OS, etc.).
- Participants with poor quality recording, low emotion read, or if no face was detected in the recording.
- Our panel partners have their own quality control process before sending their participants to our test.
The above criteria, together with a big enough sample size, assure the quality of our participants.
