Empirical and simulation-Based comparison of univariate and multivariate meta-analysis for binary outcomes

However, univariate and multivariate approaches yield different confidence/credible intervals for the difference between the summary effects of distinct outcomes (e.g., the difference in the log odds ratio for the first outcome minus the log odds ratio for the second outcome). Depending on the estim...

Full description

Bibliographic Details
Main Authors: Trikalinos, Thomas A., Hoaglin, David C. (Author), Schmid, Christopher H. (Author)
Corporate Authors: United States Agency for Healthcare Research and Quality, Tufts Evidence-based Practice Center
Format: eBook
Language:English
Published: Rockville, MD Agency for Healthcare Research and Quality [2013], 2013
Series:Methods research reports
Subjects:
Online Access:
Collection: National Center for Biotechnology Information - Collection details see MPG.ReNa
LEADER 04944nam a2200397 u 4500
001 EB000943615
003 EBX01000000000000000737205
005 00000000000000.0
007 tu|||||||||||||||||||||
008 150223 r ||| eng
100 1 |a Trikalinos, Thomas A. 
245 0 0 |a Empirical and simulation-Based comparison of univariate and multivariate meta-analysis for binary outcomes  |h Elektronische Ressource  |c prepared for Agency for Healthcare Research and Quality, U.S. Department of Health and Human Services ; prepared by Tufts Evidence-based Practice Center ; investigators, Thomas A. Trikalinos, David C. Hoaglin, Christopher H. Schmid 
260 |a Rockville, MD  |b Agency for Healthcare Research and Quality  |c [2013], 2013 
300 |a 1 PDF file (vii, 55, 18)  |b illustrations 
505 0 |a Includes bibliographical references 
653 |a Analysis of Variance 
653 |a United States 
653 |a Empirical Research 
653 |a Evidence-Based Medicine 
653 |a Meta-Analysis as Topic 
653 |a Treatment Outcome 
653 |a Data Interpretation, Statistical 
700 1 |a Hoaglin, David C.  |e [author] 
700 1 |a Schmid, Christopher H.  |e [author] 
710 2 |a United States  |b Agency for Healthcare Research and Quality 
710 2 |a Tufts Evidence-based Practice Center 
041 0 7 |a eng  |2 ISO 639-2 
989 |b NCBI  |a National Center for Biotechnology Information 
490 0 |a Methods research reports 
500 |a Title from PDF title page. - "March 2013." 
856 4 0 |u https://www.ncbi.nlm.nih.gov/books/NBK132562  |3 Volltext  |n NLM Bookshelf Books  |3 Volltext 
082 0 |a 610 
520 |a However, univariate and multivariate approaches yield different confidence/credible intervals for the difference between the summary effects of distinct outcomes (e.g., the difference in the log odds ratio for the first outcome minus the log odds ratio for the second outcome). Depending on the estimated covariance between the compared effects, the multivariate methods can yield tighter or wider confidence intervals than univariate methods. Most likely, systematic review conclusions from the meta-analyses in the empirical sample would remain qualitatively the same with either method of analysis. The simulation analyses were congruent with the aforementioned observations from the empirical analyses. CONCLUSIONS: In the empirical sample and the simulation study, the numerical difference in the summary effects and their confidence intervals between univariate and multivariate meta-analysis was almost always small.  
520 |a We analyzed these data with univariate and multivariate meta-analysis. In an accompanying simulation study, we compared summary estimates and their standard errors with univariate and multivariate meta-analysis. RESULTS: We identified 45 pairs or triplets of binary meta-analyses corresponding to 1473 RCTs and 258,675 randomized patients. In 38 (of 45) topics the first outcome was a subset of the second outcome; in 5 topics pairs of outcomes were mutually exclusive, and in 2 topics triplets of outcomes had an is-subset-of relationship. The 45 topics pertained to various medical areas (e.g., cardiology, surgery, mental health). Overall, the summary effects for each outcome and the accompanying confidence/credible intervals were very similar with univariate and multivariate meta-analysis (both using the approximate and the discrete likelihood).  
520 |a BACKGROUND: Many questions in evidence-based medicine involve multiple outcomes. They can be approached with separate, independent meta-analyses, or they can be analyzed jointly, in a single model. We aimed to compare separate (univariate) with joint (multivariate) meta-analysis in real examples and in an illustrative simulation study. METHODS: We screened the whole Cochrane Library of Systematic Reviews (2012, first quarter) to identify sets of univariate meta-analyses of categorical outcomes that can also be analyzed jointly. Eligible were pairs or triplets of meta-analyses comparing the same interventions; having at least seven randomized controlled trials (RCTs) reporting all outcomes; and in which the numbers in the cross-classification of outcomes were exactly recoverable. Examples of outcomes with completely recoverable cross-classification include mutually exclusive outcomes, or sets of outcomes where the one is a subset of the other.  
520 |a In practice, in many (if not most) cases, conclusions based on the main effects of each outcome are likely to remain similar with either method. In principle, multivariate meta-analysis utilizes more information through the correlations; therefore, when possible, it is commendable to use both univariate and multivariate approaches in a sensitivity analysis. Multivariate meta-analysis should be preferred over univariate meta-analysis for estimating differences between outcome-specific summary treatment effects