Simulation-based comparison of methods for meta-analysis of proportions and rates

For each scenario we generated 1000 random meta-analyses, on which we applied fixed and random effects analyses for two families of methods: (1) methods that approximate within-study variability with a normal distribution--not using a transformation, using a canonical transformation (logit and logar...

Full description

Bibliographic Details
Main Authors: Trikalinos, Thomas A., Trow, Paul (Author), Schmid, Christopher H. (Author)
Corporate Authors: Tufts Evidence-based Practice Center, United States Agency for Healthcare Research and Quality
Format: eBook
Language:English
Published: Rockville, MD Agency for Healthcare Research and Quality, U.S. Department of Health and Human Services 2013, November 2013
Series:Methods research reports
Subjects:
Online Access:
Collection: National Center for Biotechnology Information - Collection details see MPG.ReNa
LEADER 04428nam a2200325 u 4500
001 EB000943910
003 EBX01000000000000000737500
005 00000000000000.0
007 tu|||||||||||||||||||||
008 150223 r ||| eng
100 1 |a Trikalinos, Thomas A. 
245 0 0 |a Simulation-based comparison of methods for meta-analysis of proportions and rates  |h Elektronische Ressource  |c prepared for Agency for Healthcare Research and Quality, U.S. Department of Health and Human Services ; prepared by Tufts Medical Center Evidence-based Practice Center ; investigators, Thomas A. Trikalinos, M.D., Ph.D. Paul Trow, Ph.D., Christopher H. Schmid, Ph.D. 
260 |a Rockville, MD  |b Agency for Healthcare Research and Quality, U.S. Department of Health and Human Services  |c 2013, November 2013 
300 |a 1 PDF file (vii, 79, 12 pages)  |b illustrations 
505 0 |a Includes bibliographical references 
653 |a Meta-Analysis as Topic 
653 |a Review Literature as Topic 
700 1 |a Trow, Paul  |e [author] 
700 1 |a Schmid, Christopher H.  |e [author] 
710 2 |a Tufts Evidence-based Practice Center 
710 2 |a United States  |b Agency for Healthcare Research and Quality 
041 0 7 |a eng  |2 ISO 639-2 
989 |b NCBI  |a National Center for Biotechnology Information 
490 0 |a Methods research reports 
500 |a Title from PDF title page 
856 4 0 |u https://www.ncbi.nlm.nih.gov/books/NBK179162  |3 Volltext  |n NLM Bookshelf Books  |3 Volltext 
082 0 |a 800 
520 |a For each scenario we generated 1000 random meta-analyses, on which we applied fixed and random effects analyses for two families of methods: (1) methods that approximate within-study variability with a normal distribution--not using a transformation, using a canonical transformation (logit and logarithmic for proportions and rates, respectively), or using a variance stabilizing transformation (arcsine and square root for proportions and rates, respectively); and (2) "discrete likelihood" methods that use the theoretically motivated binomial or Poisson distribution to model within study variability. We measured the performance of each method relative to the true values set in the simulation by their mean squared error, bias, and coverage. RESULTS: In general, and for both proportions and rates, the discrete likelihood approaches performed better than the approximate methods in terms of the three metrics.  
520 |a BACKGROUND: In many systematic reviews it is appropriate to summarize proportions and rates (e.g., incidence rates) using meta-analysis. For example, researchers commonly perform meta-analyses of sensitivity and specificity to summarize medical test performance, or of adverse or harmful events. Many statistical methods can be used for meta-analysis of rates and proportions. PURPOSE: To help provide guidance for meta-analysts, we performed an extensive simulation study to assess the statistical properties of alternative approaches to meta-analysis of proportions and incidence rates. METHODS: We simulated a large number of scenarios for meta-analyses of proportions and incidence rates (n=792 scenarios for each). The distinct scenarios were defined by combinations of various factors, including the distributional form for the true summary proportion or rate and its defining parameters (mean, variance), the number of studies per meta-analysis, and the number of patients per study.  
520 |a Of the approximate methods, the variance stabilizing variants (arcsine transformation for proportions and square root transformation for rates) performed better than the untransformed methods or the methods using a canonical link. Continuity correction factors are necessary to calculate real-valued means or variances for some approximate methods. The bias, mean square error and coverage of these approximate methods are very sensitive to the choice of continuity correction factors. CONCLUSIONS: Discrete likelihood methods are preferable for the meta-analyses of proportions and rates. We discourage the use of approximate methods that require continuity corrections, as the arbitrary choice of the correction factor can greatly impact on the performance of the method. If software for fitting the discrete likelihood methods is unavailable and expected counts are large enough that normal approximations are adequate, we recommend use of a variance stabilizing transformation