• A
  • A
  • A
  • ABC
  • ABC
  • ABC
  • А
  • А
  • А
  • А
  • А
Regular version of the site

Methodology of Online Research

The key to the success of any research project is a well-thought-out methodology and the absence of random and systematic errors. Most research in higher education uses online surveys as a data collection method. Therefore, the development of the methodology for conducting online surveys is one of the important areas of research and teaching activities of the Center.We carry out experimental research aimed at achieving the following goals:

  • Identifying effective ways to improve response to online surveys
  • Identifying opportunities to improve the quality of online survey data through the use of various ways of visual and verbal presentation of survey too
  • Assessment of possible data bias due to the design of online surveys.


The staff of the Center are the developers and teachers of the course "Methodology of online research" for graduate students of the Institute of Education, enrolled in the program "Evidence-based educational policy".

Within the framework of this direction, the project "Development of an interactive methodological infrastructure to improve the quality of data from longitudinal sociological research" is being implemented, supported by a grant from the Russian Science Foundation, No. 17-78-2017.

About the project
The proliferation and development of computer technology and the Internet have significantly influenced academic research and government statistics. Over the past 20 years, computer assisted personal interviewing (CAPI) and online research have become the most popular and discussed methods of collecting empirical data in the social sciences. The development of computer (including mobile) technologies and the Internet opens up new opportunities for academic researchers and state statistics bodies to collect representative data on the population. The Russian Monitoring of the Economic Situation and Health of the Population of the Higher School of Economics (RLMS) is a unique national representative survey of households in Russia. Its results are actively used by researchers and state statistics bodies. Since 1992, the Russian Monitoring of the Economic Situation and Health of the Population of the Higher School of Economics (RLMS) has been collecting data exclusively using the “paper” data collection format, when the interviewer, according to the respondent, fills out a paper questionnaire (PAPI - paper and pencil interview - personal interview with the interviewer filling out a paper questionnaire ). The aim of this project is to investigate the capabilities of the CAPI method using tablet computers for data collection in a national longitudinal representative panel survey of the RLMS. There are three main advantages of collecting data using the CAPI method. Firstly, this collection method allows to reduce the burden on respondents and interviewers: the computer version of the survey tool makes it possible to adapt complex and relatively long questionnaires for households and individuals, taking into account the earlier data of respondents' answers. Thus, in the case of using longitudinal design, it becomes possible to take into account the data obtained during the previous waves of research. Such changes in the design of the questionnaire can significantly shorten the average interview time, which can improve the quality of the data. Secondly, it becomes possible to use the paradata for greater control over the interviewers and the field stage of the survey. Thus, the use of GPS data and data on the time of filling out the questionnaire (the time of the interview, the beginning and end of filling out the questionnaire, the time of filling out each question, etc.) will make it possible to more effectively monitor the process of the interview itself and the quality of filling out the questionnaire. Thirdly, the use of CAPI will reduce the time spent on collecting field data and will provide the ability to automatically check the quality of the received data in real time. The use of CAPI in longitudinal panel research is a widespread international practice. Some household panels have switched from PAPI to CAPI in an experimental format, others without additional experimental research. The results obtained in relation to other panel surveys can be used in this study, however, it is important to conduct an additional pilot study within the framework of the RLMS. First, the use of CAPI can have a negative impact on measurement errors and non-responses, which can threaten the quality of the collected data. Second, the results of the transition from PAPI to CAPI can vary depending on the specifics of the questionnaires used in the survey, as well as how the CAPI method is implemented in practice. Thirdly, in Russia there has not yet been an experimental study of this scale comparing the CAPI and PAPI methods, and there are almost no scientific publications on this topic. Moreover, as part of the project, we will explore additional possibilities of using tablet computers to improve the quality of the collected data. For example, it is planned to test the possibility of using voice typing for data entry in open questions. In addition, the tablet computer can include various sensors that can be used to monitor public health (for example, using various applications that measure heart rate, blood pressure, etc.). We are investigating the possibility of using such sensors in panel surveys to collect data on population health. The results of experimental studies within the framework of this project will make it possible to develop practical recommendations for the use of the CAPI method in both cross-sectional and longitudinal representative surveys of the population. These recommendations can be used by both statistical authorities and scientific institutes that conduct representative surveys both in Russia and in the world.

Our publications

Terentev E., Maloshonok N. The Impact of Response Options Ordering on Respondents’ Answers to Rating Questions: Results of Two Experiments // International Journal of Social Research Methodology. 2018. doi.org/10.1080/13645579.2018.1510660.

Maloshonok N., Terentev E. The impact of visual design and response formats on data quality in a web survey of MOOC students // Computers in Human Behavior. 2016. Vol. 62. P. 506-515.

Mavletova A. M., Devyatko I. F., Maloshonok N. Invitation Design Elements in Web Surveys – Can One Ignore Interactions? // Bulletin of Sociological Methodology. 2014. Vol. 123. No. 1. P. 68-79.

 


 

Have you spotted a typo?
Highlight it, click Ctrl+Enter and send us a message. Thank you for your help!
To be used only for spelling or punctuation mistakes.