Reducing Bias in Phone Survey Samples Effectiveness of Reweighting Techniques Using Face-to-Face Surveys as Frames in Four African Countries

Several developing countries are currently implementing phone surveys in response to immediate data needs to monitor the socioeconomic impact of COVID-19. However, phone surveys are often subject to coverage and non-response bias that can compromise the representativeness of the sample and the exter...

Full description

Bibliographic Details
Main Author: Ambel, Alemayehu
Other Authors: Tsegay, Asmelash, McGee, Kevin
Format: eBook
Language:English
Published: Washington, D.C The World Bank 2021
Online Access:
Collection: World Bank E-Library Archive - Collection details see MPG.ReNa
LEADER 02366nmm a2200229 u 4500
001 EB002179484
003 EBX01000000000000001317018
005 00000000000000.0
007 cr|||||||||||||||||||||
008 231006 ||| eng
100 1 |a Ambel, Alemayehu 
245 0 0 |a Reducing Bias in Phone Survey Samples  |h Elektronische Ressource  |b Effectiveness of Reweighting Techniques Using Face-to-Face Surveys as Frames in Four African Countries  |c Alemayehu Ambel 
260 |a Washington, D.C  |b The World Bank  |c 2021 
300 |a 54 pages 
700 1 |a Tsegay, Asmelash 
700 1 |a McGee, Kevin 
041 0 7 |a eng  |2 ISO 639-2 
989 |b WOBA  |a World Bank E-Library Archive 
028 5 0 |a 10.1596/1813-9450-9676 
856 4 0 |u http://elibrary.worldbank.org/doi/book/10.1596/1813-9450-9676  |x Verlag  |3 Volltext 
082 0 |a 330 
520 |a Several developing countries are currently implementing phone surveys in response to immediate data needs to monitor the socioeconomic impact of COVID-19. However, phone surveys are often subject to coverage and non-response bias that can compromise the representativeness of the sample and the external validity of the estimates obtained from the survey. Using data from high-frequency phone surveys in Ethiopia, Malawi, Nigeria, and Uganda, this study investigates the magnitude and source of biases present in these four surveys and explores the effectiveness of techniques applied to reduce bias. Varying levels of coverage and non-response bias are found in all four countries. The successfully contacted samples in these four countries were biased toward wealthier households with higher living standards. Left unaddressed, this bias would result in biased estimates from the interviewed sample that do not fully reflect the situation of poorer households in the country. However, phone survey biases can be substantially reduced by applying survey weight adjustments using information from the representative survey from which the sample is drawn. Applying these methods to the four surveys resulted in a substantial reduction in bias, although the bias was not fully eradicated. This highlights one of the potential advantages of drawing phone survey samples from existing face-to-face, representative surveys over random digit dialing or using lists from telecom providers where such adjustment methods can be more limited