|
|
|
| ||||||||||||||||||||||||||||||||||||||||||||
15 January 2008 | Volume 148 Issue 2 | Pages 111-123
Background: Previous reviews have shown inconsistent effects of publicly reported performance data on quality of care, but many new studies have become available in the 7 years since the last systematic review.
Purpose: To synthesize the evidence for using publicly reported performance data to improve quality.
Data Sources: Web of Science, MEDLINE, EconLit, and Wilson Business Periodicals (1999–2006) and independent review of articles (1986–1999) identified in a previous systematic review. Only sources published in English were included.
Study Selection: Peer-reviewed articles assessing the effects of public release of performance data on selection of providers, quality improvement activity, clinical outcomes (effectiveness, patient safety, and patient-centeredness), and unintended consequences.
Data Extraction: Data on study participants, reporting system or level, study design, selection of providers, quality improvement activity, outcomes, and unintended consequences were extracted.
Data Synthesis: Forty-five articles published since 1986 (27 of which were published since 1999) evaluated the impact of public reporting on quality. Many focus on a select few reporting systems. Synthesis of data from 8 health plan–level studies suggests modest association between public reporting and plan selection. Synthesis of 11 studies, all hospital-level, suggests stimulation of quality improvement activity. Review of 9 hospital-level and 7 individual provider–level studies shows inconsistent association between public reporting and selection of hospitals and individual providers. Synthesis of 11 studies, primarily hospital-level, indicates inconsistent association between public reporting and improved effectiveness. Evidence on the impact of public reporting on patient safety and patient-centeredness is scant.
Limitations: Heterogeneity made comparisons across studies challenging. Only peer-reviewed, English-language articles were included.
Conclusion: Evidence is scant, particularly about individual providers and practices. Rigorous evaluation of many major public reporting systems is lacking. Evidence suggests that publicly releasing performance data stimulates quality improvement activity at the hospital level. The effect of public reporting on effectiveness, safety, and patient-centeredness remains uncertain.
Author and Article Information
From RAND, Santa Monica, and Veterans Affairs Greater Los Angeles Healthcare System, Los Angeles, California.
Acknowledgment: The authors thank Roberta Shanman for assistance with the literature search and Susan Chen and Carlo Tringale, Southern California Evidence-based Practice Center, for assistance with retrieving the articles and preparing the manuscript.
Financial Support: This manuscript was supported by RAND Health's Comprehensive Assessment of Reform Options (COMPARE) Initiative, which receives funding from a consortium of sources, including RAND's corporate endowment, contributions from individual donors, corporations, foundations, and other organizations. After completing this project, Dr. Fung began employment with Zynx Health.
Potential Financial Conflicts of Interest: Employment: C.H. Fung (Zynx Health, Veterans Affairs [past], RAND [past]). Consultancies: C.H. Fung (Society of General Internal Medicine, Health Benchmarks). Grants received: C.H. Fung (California HealthCare Foundation).
Requests for Single Reprints: Constance H. Fung, MD, MSHS, 10880 Wilshire Boulevard, No. 300, Los Angeles, CA 90024.
Current Author Addresses: Dr. Fung: 10880 Wilshire Boulevard, No. 300, Los Angeles, CA 90024.
Drs. Lim, Damberg, and Shekelle: RAND, 1776 Main Street, PO Box 2138, Santa Monica, CA 90407-2138.
Dr. Mattke: RAND, 1200 South Hayes Street, Arlington, VA 22202-5050. IMPROVING PATIENT CARE
Systematic Review: The Evidence That Publishing Patient Care Performance Data Improves Quality of Care
![]()
Related articles in Annals:
This article has been cited by other articles:
![]() |
K. Y. Bilimoria, D. J. Bentrem, K. D. Lillemoe, M. S. Talamonti, C. Y. Ko, and on behalf of the American College of Surgeons' Pan Assessment of Pancreatic Cancer Care in the United States Based on Formally Developed Quality Indicators J Natl Cancer Inst, June 16, 2009; 101(12): 848 - 859. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. Ford, J. Hutchings, T. Bywater, A. Goodman, and R. Goodman Strengths and Difficulties Questionnaire Added Value Scores: evaluating effectiveness in child mental health interventions The British Journal of Psychiatry, June 1, 2009; 194(6): 552 - 558. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. M. Werner and R. McNutt A New Strategy to Improve Quality: Rewarding Actions Rather Than Measures JAMA, April 1, 2009; 301(13): 1375 - 1377. [Full Text] [PDF] |
||||
![]() |
J. P. Jacobs, R. J. Cerfolio, and R. M. Sade The Ethics of Transparency: Publication of Cardiothoracic Surgical Outcomes in the Lay Press. Ann. Thorac. Surg., March 1, 2009; 87(3): 679 - 686. [Full Text] [PDF] |
||||
![]() |
K. M. Mazor, K. S. Dodd, and L. Kunches Communicating Hospital Infection Data to the Public: A Study of Consumer Responses and Preferences American Journal of Medical Quality, March 1, 2009; 24(2): 108 - 115. [Abstract] [PDF] |
||||
![]() |
R. A. Berenson and C. K. Cassel Consumer-Driven Health Care May Not Be What Patients Need--Caveat Emptor JAMA, January 21, 2009; 301(3): 321 - 323. [Full Text] [PDF] |
||||
![]() |
R. Hamblin Regulation, measurements and incentives. The experience in the US and UK: does context matter? Perspectives in Public Health, November 1, 2008; 128(6): 291 - 298. [Abstract] [PDF] |
||||
![]() |
M. B. Rothberg, E. Morsi, E. M. Benjamin, P. S. Pekow, and P. K. Lindenauer Choosing The Best Hospital: The Limitations Of Public Quality Reporting Health Aff., November 1, 2008; 27(6): 1680 - 1687. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. K. Jha, E. J. Orav, J. Zheng, and A. M. Epstein Patients' Perception of Hospital Care in the United States N. Engl. J. Med., October 30, 2008; 359(18): 1921 - 1931. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. B. Kritchevsky, B. I. Braun, A. J. Bush, M. R. Bozikis, L. Kusek, J. P. Burke, E. S. Wong, J. Jernigan, C. C. Davis, B. Simmons, et al. The Effect of a Quality Improvement Collaborative to Improve Antimicrobial Prophylaxis in Surgical Patients: A Randomized Trial Ann Intern Med, October 7, 2008; 149(7): 472 - 480. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. S. Halpin, S. D. Barnett, L. L. Henry, E. Choi, and N. Ad Public Health Reporting: The United States Perspective Seminars in Cardiothoracic and Vascular Anesthesia, September 1, 2008; 12(3): 191 - 202. [Abstract] [PDF] |
||||
![]() |
G. Bevan Is choice working for patients in the English NHS? BMJ, August 8, 2008; 337(aug08_1): a935 - a935. [Full Text] |
||||
![]() |
K. G. Shojania MD and A. J. Forster MD MSc Hospital mortality: when failure is not a good measure of success Can. Med. Assoc. J., July 15, 2008; 179(2): 153 - 157. [Full Text] [PDF] |
||||
![]() |
T. Gorrindo and J. E. Groves Web Searching for Information About Physicians JAMA, July 9, 2008; 300(2): 213 - 215. [Full Text] [PDF] |
||||
![]() |
J. D. Graham Is Reporting of Quality Scores Worth Refining? Ann Intern Med, June 3, 2008; 148(11): 883 - 883. [Full Text] [PDF] |
||||
![]() |
Does Public Reporting of Performance Data Improve Quality of Care? Journal Watch (General), February 5, 2008; 2008(205): 4 - 4. [Full Text] |
||||
![]() |
All you need to read in the other general journals BMJ, January 26, 2008; 336(7637): 182 - 183. [Full Text] [PDF] |
||||
![]() |
J. H. Hibbard What Can We Say about the Impact of Public Reporting? Inconsistent Execution Yields Variable Results Ann Intern Med, January 15, 2008; 148(2): 160 - 161. [Full Text] [PDF] |
||||