Measuring the Unmeasured Combining Technology and Behavioral Insights to Improve Measurement of Business Outcomes

Business survey outcomes for micro and small firms are notoriously noisy, with multiple sources of measurement and recall error. This paper introduces a new survey methodology that combines automatic consistency checks of electronic data collection with triangulation and dynamic adjustment to arrive...

Full description

Bibliographic Details
Main Author: Anderson, Stephen J.
Other Authors: Zia, Bilal Husnain, Lazicky, Christy Marie
Format: eBook
Language:English
Published: Washington, D.C The World Bank 2019
Series:World Bank E-Library Archive
Online Access:
Collection: World Bank E-Library Archive - Collection details see MPG.ReNa
Description
Summary:Business survey outcomes for micro and small firms are notoriously noisy, with multiple sources of measurement and recall error. This paper introduces a new survey methodology that combines automatic consistency checks of electronic data collection with triangulation and dynamic adjustment to arrive at more precise estimates of business performance. The methodology uses insights from behavioral science to lower the cognitive cost of initial recall and establishes salient and relevant anchors to allow for dynamic triangulation and adjustment toward a final estimate. The validity of this method is field tested against traditional performance measures as well as administrative data across three emerging markets: Ghana, Rwanda, and Uganda. The results show significant upward adjustment from traditional measures for both sales and profits, a lower coefficient of variation in the cross-section, and higher autocorrelation in panel data. Comparisons with administrative data further confirm a higher correlation and closer magnitude relative to traditional measures. This research reconciles recommendations for increased attention to survey design with a method to leverage electronic survey technology beyond consistency checks
Physical Description:49 pages