Борьба за качество и надежность данных в онлайн исследованиях: основные результаты панельной конференции CASRO 2009 г.
The considerable growth in the number of smart mobile devices with a fast Internet connection provides new challenges for survey researchers. In this article, I compare the data quality between two survey modes: self-administered web surveys conducted via personal computer and those conducted via mobile phones. Data quality is compared based on five indicators: (a) completion rates, (b) response order effects, (c) social desirability, (d) non-substantive responses, and (e) length of open answers. I hypothesized that mobile web surveys would result in lower completion rates, stronger response order effects, and less elaborate answers to open-ended questions. No difference was expected in the level of reporting in sensitive items and in the rate of non-substantive responses. To test the assumptions, an experiment with two survey modes was conducted using a volunteer online access panel in Russia. As expected, mobile web was associated with a lower completion rate, shorter length of open answers, and similar level of socially undesirable and non-substantive responses. However, no stronger primacy effects in mobile web survey mode were found.
The results of the Russian Census of 2010 lay on the table several topics requiring further discussion. Prerequisites for this discussion are the change of the administrative-territorial structure of Russia after the reform of municipal government in 2006 and the amendments to the Census Law made prior to Census 2010. During 2002-2010 increase in rural population was almost twice higher than that in urban areas: +11% and +6.3% correspondingly. Rural population increased up to 30-50% in some municipalities, while changes of the urban population were fairly minor or even negative over the intercensal period. This significant rise in the rural population could be related with changes concerning data capture of the population living in collective households. This ‘non-demographic’ factor distorts denominator for demographic rates for municipalities, affects on an allocation budget funds depending on the population in the municipality.
The edition includes two documents. The first one contains a list of 17 questions that users of the survey data should be asked to draw conclusions about the validity of the results. The proposed system of criteria is applicable to assess the quality of the results of almost any survey. The second paper deals with qualities of the data, which the social media are ready to provide the students of public opinion. Both documents were prepared by the AAPOR working group on emerging technologies (Emerging Technologies Task Force), whose activities had to focus on two key areas: (1) smartphones as devices data collection, (2) social media as a platform and information resource.