Annals
Established in 1927 by the American College of Physicians
:
Advanced search
box Article
 arrow  Table of Contents                
space
 arrow  Related articles in Annals
space
 arrow  Articles citing this article
space
box Services
 arrow  Send comment/rapid response letter
space
 arrow  Notify a friend about this article
space
 arrow  Alert me when this article is cited
space
 arrow  Add to Personal Archive
space
 arrow  Download to Citation Manager
space
 arrow  ACP Search                        
space
 arrow  Get Permissions
space
box Google Scholar
 arrow  Search for Related Content
space
box PubMed
Articles in PubMed by Author:
  arrow  Brook, R. H.
space
 arrow  Related Articles in PubMed
space
 arrow  PubMed Citation
space
 arrow  PubMed
space

EDITORIAL

Health Care Reform Is on the Way: Do We Want To Compete on Quality?

right arrow Robert H. Brook, MD, ScD

1 January 1994 | Volume 120 Issue 1 | Pages 84-86


Conversations about health care reform, even those involving physicians, usually focus on cost and access: Should there be a single-payer system? How will managed competition save money? Should patients pay a large deductible or have co-insurance? Will dental and mental care be part of the basic benefit plan? It is strange that these conversations ignore how clinical practice should be altered.

In this issue of Annals [1], Topol and Califf endorse a fundamental clinical change involving the release of physician-specific information about performance. In particular, do the patients of physician A do better, after controlling for sickness, than those of physician B? Although proposals for public release of information at a physician-specific level are not new [2-6], this article is important because it comes from physicians in cardiology departments of two prestigious institutions and because it is about releasing information on the outcome of cardiovascular procedures. Until now, calls for public release of information about physician performance have usually emanated from business, government, or physicians who would like to see physicians in other specialties release their data. Does this article represent a paradigm shift? Does it represent the realization that the future U.S. health care system will involve competition about quality at a physician-specific level? If so, what are the likely consequences?

Let us consider two different worlds. World 1 represents the present system in which physician-specific performance data are not released, and world 2 represents the release of such data. In world 1, as cost containment occurs, the growth in the use of cardiovascular procedures will slow down. Because only information about price is available, physicians who charge less receive more business. Physicians who do procedures with higher quality of care or who achieve better outcomes will not be better off than those who do not. By better off, I mean having a greater likelihood of staying in business, increasing their market share, or providing more cardiovascular care than their less competent colleagues. Quality may go down as all physicians cut corners to increase their market share. Maintenance of our present system is likely to have two negative results and one positive result: First, variations in outcome by physicians are likely to remain large. For coronary artery bypass surgery, this might mean 5 additional deaths per 100 patients who received surgery [7]. Second, the professional survival of an individual physician is unlikely to depend on achieving higher quality. Third, because quality will not be an area in which competition occurs, cooperation among physicians to advance clinical knowledge will probably not decrease.

In world 2, physician-specific performance data would be used by the public, hospital administrators, directors of health plans, insurance company executives, and the government. Patients would probably select those physicians who obtain better than expected outcomes for their patients. Patients may not pay much attention to whether differences among physicians are statistically significant at the conventional level of P < 0.05. In fact, a P value of 0.1, 0.2, 0.3, or even higher, still implies that, on average, the patient would be better off going to the higher doctor on the quality list than the next lower one on the list. What is important to the patient is whether these differences are clinically significant. In this regard, we need to develop understandable and scientifically valid ways to make sure that the data we present to patients are not misleading. For example, case-mix adjusted analyses that show that last year Dr. A had 5 fewer deaths per 100 patients than did Dr. B do not mean that the difference will be the same in the future. On average, it most likely would be smaller [8].

Release of data on quality to the public would put enormous pressure on physicians. Physicians who can do a procedure competently might lose their ability to practice in a region because they are average. For instance, if a town happened to have five cardiovascular surgeons, all of whom were above average, then the last physician on the quality list might be out of work. Such a physician might have to move.

If the measures of quality used in world 2 had some validity, then their release would improve and reduce variation in outcomes by physicians. For these events to occur, the quality measures need not be perfect. We do not need to know, for example, how to measure severity of illness perfectly. However, from a physician's viewpoint, the likelihood that he or she will be unjustifiably discriminated against is related to the validity of the quality measurement system. Physicians whose patients were sicker on average but whose levels of sickness were not incorporated into the severity measure might be unjustifiably forced out of business. In addition, poor outcomes are not the sole responsibility of the physician. Physicians who are unlucky because they selected an organization that provides little support might be similarly tarnished and find it difficult to practice.

Thus, although the public is likely to benefit from world 2, some physicians might undergo considerable (and sometimes unjust) hardship. Clinical medicine is facing a major choice about how medicine will be practiced in the next century. Public release of information about quality at the physician level will dramatically change the way we practice. It may have a greater effect on the profession than economic reforms from Washington. If we are going to use this method to decrease variations in quality and to improve mean levels of quality of care, then we must examine carefully each step we make.

In addition, virtually all outcome comparisons of physicians use mortality as their outcome measure. Almost all valid clinical models that analyze what physicians do to patients (process) have used mortality as the outcome variable. Even though death is an important outcome, so is quality of life; outcome comparisons among physicians must eventually include comparisons on quality-of-life effects as well. This is especially important in the ambulatory area where death is an infrequent outcome. Finally, in this cost-conscious world, competing on broad measures of quality of life may result in the need to expend more rather than less on medical care. Physicians are being asked to spend less time, not more, with patients; however, improving a patient's sexual, social, physical, and mental well-being is certainly not consistent with such a policy.

The major technical question about the release of outcome data is: How much clinical data needs to be collected to increase the validity of the outcome comparisons to a level that the amount of misinformation is acceptable to physicians? A related question is: How much money should be invested to improve the validity of the publicly released information in order to make sure that mistakes in ranking physicians are decreased to an acceptable level? Hannan and colleagues [9, 10] in New York State have shown that adding clinical data changes the mortality rankings of some hospitals for coronary artery bypass surgery. However, the increase in validity may not be sufficient to warrant the expense of collecting the clinical data. We need an analysis describing the cost of producing data for the public about physicians and hospitals at an acceptable level of validity and describing how the cost varies by different levels of validity. This information might lead to a compromise between the public and physicians about the public's willingness to spend money on a valid data system and the physician's acceptance of the data as accurate enough to identify which physicians were producing higher quality of care. Can we have the best of both worlds?


Author and Article Information
space
up arrowTop
dotAuthor & Article Info
down arrowReferences

RAND Corporation, Santa Monica, CA 90407-2138.
Requests for Reprints: Robert H. Brook, MD, ScD, RAND, 1700 Main Street, P.O. Box 2138, Santa Monica, CA 90407-2138.


References
space
up arrowTop
up arrowAuthor & Article Info
dotReferences

1. Topol EJ, Califf RM. Scorecard cardiovascular medicine: its impact and future directions. Ann Intern Med. 1994; 120:65-70.

2. Brook RH, McGlynn EA. Maintaining quality of care. In: Ginzberg E, ed. Health Services Research: Key to Health Policy. Cambridge: Harvard University Press; 1991:284-314.

3. Brook RH. Maintaining hospital quality: the need for international cooperation. JAMA. 1993; 270:985-7.

4. Nightingale F. Mortality of the British army at home and abroad and during the Russian war as compared with the mortality of the civil population in England. Reprinted from: Report of the Commission Appointed to Inquire Into the Regulations Affecting the Sanitary State of the Army. London, England: Harrison and Sons; 1858.

5. Pennsylvania Health Care Cost Containment Council. A Consumer Guide to Coronary Artery Bypass Graft Surgery. Harrisburg: Pennsylvania Health Care Cost Containment Council; November 1992.

6. New York State Department of Health. Coronary Artery Bypass Graft Surgery in New York State: 1989-1991. Albany: New York State Dept of Health; 1992.

7. Williams SV, Nash DB, Goldfarb N. Differences in mortality from coronary artery bypass graft surgery at five teaching hospitals. JAMA. 1991; 266:810-5.

8. Efron B, Morris C. Stein's paradox in statistics. Sci Am. 1977; (May):119-28.

9. Hannan EL, Kilburn H Jr, O'Donnell JF, Lukacik G, Shields EP. Adult open heart surgery in New York State: an analysis of risk factors and hospital mortality rates. JAMA. 1990; 264:2768-74.

10. Hannan EL, Kilburn H Jr, Bernard H, O'Donnell JF, Lukacik G, Shields EP. Coronary artery bypass surgery: the relationship between in-hospital mortality rate and surgical volume after controlling for clinical risk factors. Med Care. 1991; 29:1094-107.

Related articles in Annals:

Medicine and Public Issues
Scorecard Cardiovascular Medicine: Its Impact and Future Directions
Eric J. Topol AND Robert M. Califf
Annals 1994 120: 65-70. [ABSTRACT][Full Text]  



This article has been cited by other articles:


Home page
Int J Qual Health CareHome page
M. Gysels, R. Hughes, F. Aspinal, J. M. Addington-Hall, and I. J. Higginson
What methods do stakeholders prefer for feeding back performance data: a qualitative study in palliative care
Int. J. Qual. Health Care, October 1, 2004; 16(5): 375 - 381.
[Abstract] [Full Text] [PDF]


Home page
BMJHome page
P. Adab, A. M Rouse, M. A Mohammed, and T. Marshall
Performance league tables: the NHS deserves better
BMJ, January 12, 2002; 324(7329): 95 - 98.
[Full Text] [PDF]


Home page
CMAJHome page
J. Hoey, A. M. Todkill, and K. Flegel
What's in a name? Reporting data from public institutions
Can. Med. Assoc. J., January 1, 2002; 166(2): 193 - 194.
[Full Text]


Home page
JAMAHome page
M. N. Marshall, P. G. Shekelle, S. Leatherman, and R. H. Brook
The Public Release of Performance Data: What Do We Expect to Gain? A Review of the Evidence
JAMA, April 12, 2000; 283(14): 1866 - 1874.
[Abstract] [Full Text] [PDF]


Home page
Eval Health ProfHome page
G. E. Rosenthal, M.-M. Chren, R. J. Lasek, and C. S. Landefeld
What Patients Should Ask of Consumers' Guides to Health Care Quality
Eval Health Prof, September 1, 1998; 21(3): 316 - 331.
[Abstract] [PDF]


Home page
NEJMHome page
B. A. Loftman, D. Weinberg, G. M. Stewart, S. A. Friedman, M. S. Greenwald, T. A. Marciniak, W. E. Golden, R. Brasher, R. Baker, M. Lakhani, et al.
Series on the Quality of Health Care
N. Engl. J. Med., March 13, 1997; 336(11): 804 - 807.
[Full Text]


Home page
NEJMHome page
E. C. Schneider and A. M. Epstein
Influence of Cardiac-Surgery Performance Reports on Referral Practices and Access to Care -- A Survey of Cardiovascular Specialists
N. Engl. J. Med., July 25, 1996; 335(4): 251 - 256.
[Abstract] [Full Text] [PDF]


Home page
NEJMHome page
J. Green and N. Wintfeld
Report Cards on Cardiac Surgeons -- Assessing New York State's Approach
N. Engl. J. Med., May 4, 1995; 332(18): 1229 - 1233.
[Full Text]


box Article
 arrow  Table of Contents                
space
 arrow  Related articles in Annals
space
 arrow  Articles citing this article
space
box Services
 arrow  Send comment/rapid response letter
space
 arrow  Notify a friend about this article
space
 arrow  Alert me when this article is cited
space
 arrow  Add to Personal Archive
space
 arrow  Download to Citation Manager
space
 arrow  ACP Search                        
space
 arrow  Get Permissions
space
box Google Scholar
 arrow  Search for Related Content
space
box PubMed
Articles in PubMed by Author:
  arrow  Brook, R. H.
space
 arrow  Related Articles in PubMed
space
 arrow  PubMed Citation
space
 arrow  PubMed
space


 Home | Current Issue | Past Issues | In the Clinic | ACP Journal Club | CME | Collections | Audio/Video | Mobile | Subscribe | Tools | Help | ACP Online