Learning from the Experiments That Never Happened Lessons from Trying to Conduct Randomized Evaluations of Matching Grant Programs in Africa

Matching grants are one of the most common policy instruments used by developing country governments to try to foster technological upgrading, innovation, exports, use of business development services and other activities leading to firm growth. However, since they involve subsidizing firms, the ris...

Full description

Bibliographic Details
Main Author: Campos, Francisco
Other Authors: Coville, Aidan, Fernandes, Ana M., McKenzie, David
Format: eBook
Language:English
Published: Washington, D.C The World Bank 2012
Online Access:
Collection: World Bank E-Library Archive - Collection details see MPG.ReNa
LEADER 02591nmm a2200241 u 4500
001 EB002100705
003 EBX01000000000000001240795
005 00000000000000.0
007 cr|||||||||||||||||||||
008 221013 ||| eng
100 1 |a Campos, Francisco 
245 0 0 |a Learning from the Experiments That Never Happened  |h Elektronische Ressource  |b Lessons from Trying to Conduct Randomized Evaluations of Matching Grant Programs in Africa  |c Francisco Campos 
260 |a Washington, D.C  |b The World Bank  |c 2012 
300 |a 36 p 
700 1 |a Coville, Aidan 
700 1 |a Fernandes, Ana M. 
700 1 |a McKenzie, David 
041 0 7 |a eng  |2 ISO 639-2 
989 |b WOBA  |a World Bank E-Library Archive 
028 5 0 |a 10.1596/1813-9450-6296 
856 4 0 |u http://elibrary.worldbank.org/doi/book/10.1596/1813-9450-6296  |x Verlag  |3 Volltext 
082 0 |a 330 
520 |a Matching grants are one of the most common policy instruments used by developing country governments to try to foster technological upgrading, innovation, exports, use of business development services and other activities leading to firm growth. However, since they involve subsidizing firms, the risk is that they could crowd out private investment, subsidizing activities that firms were planning to undertake anyway, or lead to pure private gains, rather than generating the public gains that justify government intervention. As a result, rigorous evaluation of the effects of such programs is important. The authors attempted to implement randomized experiments to evaluate the impact of seven matching grant programs offered in six African countries, but in each case were unable to complete an experimental evaluation. One critique of randomized experiments is publication bias, whereby only those experiments with "interesting" results get published. The hope is to mitigate this bias by learning from the experiments that never happened. This paper describes the three main proximate reasons for lack of implementation: continued project delays, politicians not willing to allow random assignment, and low program take-up; and then delves into the underlying causes of these occurring. Political economy, overly stringent eligibility criteria that do not take account of where value-added may be highest, a lack of attention to detail in "last mile" issues, incentives facing project implementation staff, and the way impact evaluations are funded, and all help explain the failure of randomization. Lessons are drawn from these experiences for both the implementation and the possible evaluation of future projects