Interviewer effects on patterns of nonresponse: Evaluating the impact on the reasons for contraceptive nonuse in the Indonesia and the Philippines DHS

Mark Amos

doi:10.4054/DemRes.2018.39.14

Volume 39 - Article 14 | Pages 415–430

Interviewer effects on patterns of nonresponse: Evaluating the impact on the reasons for contraceptive nonuse in the Indonesia and the Philippines DHS

By Mark Amos

Date received:

3 Aug 2017

Date published:

6 Sep 2018

Word count:

3073

Keywords:

contraceptive use, data quality, Demographic and Health Surveys (DHS), Indonesia, interviewer effects, multilevel model

DOI:

10.4054/DemRes.2018.39.14

Download PDF
Submit a Response Letter

Abstract

Background: Much social science research is reliant on generating data through questionnaires and interviews. Understanding the processes by which this data is generated is therefore vital for ensuring validity of scientific results. Interviewers, as a primary means of collecting responses, are one mode through which the generation of data can be affected.

Methods: This paper uses the reason for contraceptive non-use module of the Indonesian DHS to examine the effect of differential effects of interviewers on response patterns. A cross-classified multilevel model is used to examine the effect of question order on the probability of providing a positive response.

Results: The probability of providing a response declines across the module, an effect which is robust to the introduction of controls. We are able to partition the effect of this decline into respondent and interviewer effects by cross-classified residuals in the multilevel model. We find that although significant, the substantive effect of interviewers on the response profile is small and the majority of variation is accounted for by interviewee-level variation.

Conclusions: While data collection via interviewers seems to be a reliable mechanism within the DHS, care should be taken to minimise respondent burden to ensure valid responses.

Contribution: This submission confirms the high quality of DHS interviewing practices, while finding evidence of some systematic effects of data collection on responses.