Automated Review of Electronic Health Records to Assess Quality of Care for Outpatients with Heart Failure

20 February 2007 | Volume 146 Issue 4 | Pages 270-277

Background: Electronic health records (EHRs) may be used to assess quality of care.

Objective: To evaluate the accuracy of automated review of EHR data to measure quality of care for outpatients with heart failure.

Design: Observational study of quality of care for heart failure comparing automated review of EHR data with automated review followed by manual review of electronic notes for patients with apparent quality deficits (hybrid review).

Setting: An academic general internal medicine clinic with several years' experience using a commercial EHR.

Patients: 517 adults with a qualifying International Classification of Diseases, Ninth Revision, diagnosis of heart failure in their EHR data and 2 or more clinic visits over the past 18 months.

Measurements: Left ventricular ejection fraction (LVEF), prescription of a ß-blocker and an angiotensin-converting enzyme (ACE) inhibitor or angiotensin-receptor blocker (ARB) for patients with left ventricular systolic dysfunction (LVEF <0.40) and prescription of warfarin for patients with comorbid atrial fibrillation.

Results: Performance based on automated review of EHR data was similar to that based on hybrid review for assessing LVEF measurement (94.6% vs. 97.3%), prescription of ß-blockers (90.9% vs. 92.8%), and prescription of ACE inhibitors or ARBs (93.9% vs. 98.7%). However, performance based on automated review was lower than that based on hybrid review for prescription of warfarin for atrial fibrillation (70.4% vs. 93.6%), primarily because automated review did not detect documentation of accepted reasons for not prescribing warfarin.

Limitations: The findings may not be applicable to other practices and other EHRs. The authors used EHR data to identify eligible patients, so the study may have excluded some patients with heart failure. Patient charts were manually reviewed only if a provider appeared to fail a quality measure on automated review and did not determine the sensitivity and specificity of automated review according to standard definitions.

Conclusions: Automated review of EHR data to measure the quality of care of outpatients with heart failure missed many exclusion criteria for medications documented only in providers' notes. As a result, it sometimes underestimated performance on medication-based quality measures.

Editors' Notes Context Searching electronic health records (EHRs) may offer a convenient way to measure quality of care. Contribution The authors compared automated review of EHR fields with automated review followed by manual review of the EHR to assess the quality of care of outpatients with heart failure. They found that automated review sometimes underestimated how often warfarin was prescribed to patients with atrial fibrillation because it missed documentation of legitimate reasons for not prescribing warfarin. Cautions The researchers did not measure how many quality measures identified by automated queries were false positives. Implications Automated review of the EHR missed many exclusion criteria for warfarin documented only in providers' notes. As a result, it underestimated provider performance. —The Editors

 

Author and Article Information

From Northwestern University, Chicago, Illinois.

Acknowledgment: The authors thank Heidi Bossley for technical assistance.

Grant Support: This project was supported in part by grant number 5 U18 HS013690 from the Agency for Healthcare Research and Quality.

Potential Financial Conflicts of Interest: None disclosed.

Requests for Single Reprints: David Baker, MD, MPH, 676 North St. Clair Street, Suite 200, Chicago, IL 60611-2927; e-mail, dwbaker{at}northwestern.edu.

Current Author Addresses: Drs. Baker, Persell, Soman and Mr. Thompson and Mr. Liss: Feinberg School of Medicine, Northwestern University, 676 North St. Clair Street, Suite 200, Chicago, IL 60611.

Dr. Burgner: Northwestern Memorial Hospital, 210 East Huron Road, Chicago, IL 60611.

Dr. Kmetik: American Medical Association, 515 State Street, Chicago, IL 60610.

Read all Rapid Responses

Untitled

Linda Fried

Annals Online, 11 Apr 2007 [Full text]

The authors reply:

David W. Baker, et al.

Annals Online, 4 May 2007 [Full text]