Developing consistent and useful quality improvement study data extraction for health systems

BACKGROUND: Quality improvement studies can provide important insight to learning health systems. The Agency for Healthcare Research and Quality (AHRQ) could devote resources to collate and assess these quality improvement studies to support learning health systems (LHS) but there is no reliable dat...

Full description

Bibliographic Details
Main Authors: Hernandez, Adrian V., Roman, Yuani M. (Author), White, C. Michael (Author)
Corporate Authors: University of Connecticut Evidence-based Practice Center, United States Agency for Healthcare Research and Quality
Format: eBook
Language:English
Published: Rockville, MD Agency for Healthcare Research and Quality, U.S. Department of Health and Human Services 2020, September 2020
Series:Methods research report
Online Access:
Collection: National Center for Biotechnology Information - Collection details see MPG.ReNa
LEADER 03379nam a2200289 u 4500
001 EB002001290
003 EBX01000000000000001164191
005 00000000000000.0
007 tu|||||||||||||||||||||
008 210907 r ||| eng
100 1 |a Hernandez, Adrian V. 
245 0 0 |a Developing consistent and useful quality improvement study data extraction for health systems  |h Elektronische Ressource  |c prepared for Agency for Healthcare Research and Quality, U.S. Department of Health and Human Services ; prepared by University of Connecticut Evidence-based Practice Center ; investigators, Adrian V. Hernandez, Yuani M. Roman, C. Michael White 
260 |a Rockville, MD  |b Agency for Healthcare Research and Quality, U.S. Department of Health and Human Services  |c 2020, September 2020 
300 |a 1 PDF file (1 volume (various pagings))  |b illustrations 
505 0 |a Includes bibliographical references 
700 1 |a Roman, Yuani M.  |e [author] 
700 1 |a White, C. Michael  |e [author] 
710 2 |a University of Connecticut Evidence-based Practice Center 
710 2 |a United States  |b Agency for Healthcare Research and Quality 
041 0 7 |a eng  |2 ISO 639-2 
989 |b NCBI  |a National Center for Biotechnology Information 
490 0 |a Methods research report 
856 4 0 |u https://www.ncbi.nlm.nih.gov/books/NBK562132  |3 Volltext 
082 0 |a 800 
082 0 |a 000 
082 0 |a 610 
520 |a BACKGROUND: Quality improvement studies can provide important insight to learning health systems. The Agency for Healthcare Research and Quality (AHRQ) could devote resources to collate and assess these quality improvement studies to support learning health systems (LHS) but there is no reliable data on the consistency of data extraction for important criteria. METHODS: We identified quality improvement studies in asthma and evaluated the consistency of data extraction from two experienced independent reviewers at three time points: baseline where only a rudimentary description of the criteria was available, first revision where explicit instructions for each criterion were created, and final revision where the instructions were revised. Six investigators looked at the data extracted by one of the systematic reviewers and then the other for the same criteria and determined the extent of similarity on a scale of 0 to 10 (where 0 represented no similarity and 10 perfect similarity). There were 42 assessments for baseline, 42 assessments for the first revision, and 42 assessments for the final revision. We then asked two LHS participants to assess the relative value of our criteria in a pilot phase. RESULTS: We went through two refinements of the data extraction instructions for each criterion and were able to improve the consistency of extraction from 1.17(+/-)1.85 at baseline to 6.07(+/-)2.76 after revision one (P<0.001) and to 6.81(+/-)1.94 out of 10 for the final revision (P<0.001). However, the final revision was not significantly improved over revision one (p=0.14). In the pilot phase, our two LHS participants felt that some of our 33 criteria were more valuable than others were. DISCUSSION/CONCLUSION: Creating explicit instructions for extracting data for quality improvement study helps enhance the consistency of data extraction. Future studies with a larger cadre of LHS participants should help determine the most important criteria