Improving the utility of evidence synthesis for decision makers in the face of insufficient evidence

We identified five strategies for supplementing systematic review findings when evidence on benefit or harms is expected to be or found to be insufficient, including: reconsidering eligible study designs, summarizing indirect evidence, summarizing contextual and implementation evidence, modelling, a...

Full description

Bibliographic Details
Main Author: Murad, M. Hassan
Corporate Authors: Scientific Resource Center (Portland, Or.), United States Agency for Healthcare Research and Quality
Format: eBook
Language:English
Published: Rockville, MD Agency for Healthcare Research and Quality 2021, April 2021
Series:Methods white paper
Online Access:
Collection: National Center for Biotechnology Information - Collection details see MPG.ReNa
LEADER 03814nam a2200277 u 4500
001 EB002191782
003 EBX01000000000000001329247
005 00000000000000.0
007 tu|||||||||||||||||||||
008 240105 r ||| eng
100 1 |a Murad, M. Hassan 
245 0 0 |a Improving the utility of evidence synthesis for decision makers in the face of insufficient evidence  |h Elektronische Ressource  |c prepared by: Scientific Resource Center ; investigators: M. Hassan Murad, Stephanie M. Chang, Celia Fiordalisi, Jennifer S. Lin, Timothy J. Wilt, Amy Tsou, Brian Leas, Shazia Siddique, Andrew R. Zullo, Ethan Balk, Carolyn M. Rutter, Karen Robinson, Craig Coleman, Olivia Costa, Elizabeth Stoeger, Mark Helfand, Meera Viswanathan 
260 |a Rockville, MD  |b Agency for Healthcare Research and Quality  |c 2021, April 2021 
300 |a 1 PDF file (various pagings) 
505 0 |a Includes bibliographical references 
710 2 |a Scientific Resource Center (Portland, Or.) 
710 2 |a United States  |b Agency for Healthcare Research and Quality 
041 0 7 |a eng  |2 ISO 639-2 
989 |b NCBI  |a National Center for Biotechnology Information 
490 0 |a Methods white paper 
500 |a "Contract no. 290-2017-00003-C." 
856 4 0 |u https://www.ncbi.nlm.nih.gov/books/NBK569735  |3 Volltext 
082 0 |a 800 
520 |a We identified five strategies for supplementing systematic review findings when evidence on benefit or harms is expected to be or found to be insufficient, including: reconsidering eligible study designs, summarizing indirect evidence, summarizing contextual and implementation evidence, modelling, and incorporating unpublished health system data. CONCLUSION: Throughout early scoping, protocol development, review conduct, and review presentation, authors should consider five possible strategies to supplement potential insufficient findings of benefit or harms. When there is no evidence available for a specific outcome, reviewers should use a statement such as "no studies" instead of "insufficient." The main reasons for insufficient evidence rating should be explicitly described 
520 |a BACKGROUND: Healthcare decision makers strive to operate on the best available evidence. The Agency for Healthcare Research and Quality Evidence-based Practice Center (EPC) Program aims to support healthcare decision makers by producing evidence reviews that rate the strength of evidence. However, the evidence base is often sparse or heterogeneous, or otherwise results in a high degree of uncertainty and insufficient evidence ratings. OBJECTIVE: To identify and suggest strategies to make insufficient ratings in systematic reviews more actionable. METHODS: A workgroup comprising EPC Program members convened throughout 2020. We conducted interative discussions considering information from three data sources: a literature review for relevant publications and frameworks, a review of a convenience sample of past systematic reviews conducted by the EPCs, and an audit of methods used in past EPC technical briefs.  
520 |a RESULTS: Several themes emerged across the literature review, review of systematic reviews, and review of technical brief methods. In the purposive sample of 43 systematic reviews, the use of the term "insufficient" covered both instances of no evidence and instances of evidence being present but insufficient to estimate an effect. The results of the literature review and review of the EPC Program systematic reviews illustrated the importance of clearly stating the reasons for insufficient evidence. Results of both the literature review and review of systematic reviews highlighted the factors decision makers consider when making decisions when evidence of benefits or harms is insufficient, such as costs, values, preferences, and equity.