| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
15 September 1996 | Volume 125 Issue 6 | Pages 457-464
Objective: To 1) assess the degree of agreement among physicians on the cause of previously flagged adverse outcomes and 2) relate the findings to systems of quality assurance and performance assessment and proposals for no-fault compensation for medical injuries.
Design: Observational study of 7533 pairs of "structured implicit" reviews (subjective opinions based on guidelines) of medical records done by 127 physicians working independently.
Setting: Random sample of 51 inpatient facilities in New York State.
Patients: Random sample of inpatient medical records from the selected facilities.
Measurements: 1] Number of agreed-upon adverse events compared with the number of cases of extreme disagreement and 2) internally and indirectly standardized rates at which physician reviewers found adverse events (injuries to patients caused at least in part by medical management).
Results: In 12.9% of cases (971 of 7533), the two physicians in a pair had extreme disagreement about the occurrence of an adverse event. These cases outnumbered those in which both reviewers found an adverse event (10%; n = 757). Agreement was highest for wound infections and lowest for adverse events attributed to failure to diagnose or lack of therapy. The amount of experience the physicians had in reviewing records tended to increase the level of agreement. Even after standardization to the results of the entire sample, individual physicians' rates of finding at least slight evidence of an adverse event varied widely (range, 9.9% to 43.7%) (P < 0.001).
Conclusions: Structured implicit reviews produced disagreement on the causes of adverse patient outcomes. If systems of quality assurance, performance audits, or no-fault patient compensation are to succeed, methods for overcoming the common tendency toward disagreement among experts must be developed.
Author and Article Information
From Pennsylvania State University College of Medicine, Hershey, Pennsylvania; Harvard School of Public Health, Boston, Massachusetts; and Rush University and Rush-Presbyterian-St. Luke's Medical Center, Chicago, Illinois.
ARTICLE
Identifying Adverse Events Caused by Medical Care: Degree of Physician Agreement in a Retrospective Chart Review
![]()
Grant Support: In part by grant R01 HS07067-01 from the Agency for Health Care Policy and Research.
Requests for Reprints: A. Russell Localio, JD, MPH, MS, Center for Biostatistics and Epidemiology, Pennsylvania State University College of Medicine, PO Box 850, Hershey, PA 17033-0850.
Current Author Addresses: Mr. Localio and Dr. Landis: Center for Biostatistics and Epidemiology, Pennsylvania State University College of Medicine, PO Box 850, Hershey, PA 17033-0850.
This article has been cited by other articles:
![]() |
T K Nuckols, D S Bell, S M Paddock, and L H Hilborne Contributing factors identified by hospital incident report narratives Qual. Saf. Health Care, October 1, 2008; 17(5): 368 - 372. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Charles, D. Ranson, M. Bohensky, and J. E. Ibrahim Under-reporting of deaths to the coroner by doctors: a retrospective review of deaths in two hospitals in Melbourne, Australia Int. J. Qual. Health Care, August 1, 2007; 19(4): 232 - 236. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. K Nuckols, D. S Bell, H. Liu, S. M Paddock, and L. H Hilborne Rates and types of events reported to established incident reporting systems in two US hospitals Qual. Saf. Health Care, June 1, 2007; 16(3): 164 - 168. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. Crosby Medical malpractice and anesthesiology: literature review and role of the expert witness: [Fautes medicales et anesthesiologie : revue de la litterature et role du temoin expert] Can J Anesth, March 1, 2007; 54(3): 227 - 241. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. Haller, P. S. Myles, J. Stoelwinder, M. Langley, H. Anderson, and J. McNeil Integrating Incident Reporting into an Electronic Patient Record System J. Am. Med. Inform. Assoc., March 1, 2007; 14(2): 175 - 181. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. N. Meurer, H. Yang, C. E. Guse, C. Russo, K. J. Brasel, and P. M. Layde Excess mortality caused by medical injury. Ann. Fam. Med, September 1, 2006; 4(5): 410 - 416. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. Jagsi, B. T. Kitch, D. F. Weinstein, E. G. Campbell, M. Hutter, and J. S. Weissman Residents Report on Adverse Events and Their Causes Arch Intern Med, December 12, 2005; 165(22): 2607 - 2613. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. A. Brennan, A. Gawande, E. Thomas, and D. Studdert Accidental deaths, saved lives, and improved quality. N. Engl. J. Med., September 29, 2005; 353(13): 1405 - 1409. [Full Text] [PDF] |
||||
![]() |
R. R. Bovbjerg and L. R. Tancredi Liability Reform Should Make Patients Safer: "Avoidable Classes of Events" are a Key Improvement J. Law Med. Ethics, September 1, 2005; 33(3): 478 - 500. [PDF] |
||||
![]() |
A. Garland Improving the ICU: Part 1 Chest, June 1, 2005; 127(6): 2151 - 2164. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Garland Improving the ICU: Part 2 Chest, June 1, 2005; 127(6): 2165 - 2179. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. N. Weingart Beyond Babel: prospects for a universal patient safety taxonomy Int. J. Qual. Health Care, April 1, 2005; 17(2): 93 - 94. [Full Text] [PDF] |
||||
![]() |
S. N. Weingart, M. Toth, J. Eneman, M. D. Aronson, D. Z. Sands, A. N. Ship, R. B. Davis, and R. S. Phillips Lessons from a patient partnership intervention to prevent adverse drug events Int. J. Qual. Health Care, December 1, 2004; 16(6): 499 - 507. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. R. Baker, P. G. Norton, V. Flintoft, R. Blais, A. Brown, J. Cox, E. Etchells, W. A. Ghali, P. Hebert, S. R. Majumdar, et al. The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada Can. Med. Assoc. J., May 25, 2004; 170(11): 1678 - 1686. [Abstract] [Full Text] |
||||
![]() |
B. J. Isetts, L. M. Brown, S. W. Schondelmeyer, and L. A. Lenarz Quality Assessment of a Collaborative Approach for Decreasing Drug-Related Morbidity and Achieving Therapeutic Goals Arch Intern Med, August 11, 2003; 163(15): 1813 - 1820. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. J. Murff, A. J. Forster, J. F. Peterson, J. M. Fiskio, H. L. Heiman, and D. W. Bates Electronically Screening Discharge Summaries for Adverse Medical Events J. Am. Med. Inform. Assoc., July 1, 2003; 10(4): 339 - 350. [Abstract] [Full Text] [PDF] |
||||
![]() |
G Neale and M Woloshynowych Retrospective case record review: a blunt instrument that needs sharpening Qual. Saf. Health Care, February 1, 2003; 12(1): 2 - 3. [Full Text] [PDF] |
||||
![]() |
E. J. Thomas, S. R. Lipsitz, D. M. Studdert, and T. A. Brennan The Reliability of Medical Record Review for Estimating Adverse Event Rates Ann Intern Med, June 4, 2002; 136(11): 812 - 816. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. M. Hughes, P. Honig, J. Phillips, J. Woodcock, R. E. Anderson, C. J. McDonald, M. Weiner, and S. L. Hui How Many Deaths Are Due to Medical Errors? JAMA, November 1, 2000; 284(17): 2187 - 2187. [Full Text] [PDF] |
||||
![]() |
R. E. Anderson Billions for Defense: The Pervasive Nature of Defensive Medicine Arch Intern Med, November 8, 1999; 159(20): 2399 - 2402. [Full Text] [PDF] |
||||
![]() |
B. A. Liang Error in Medicine: Legal Impediments to U.S. Reform Journal of Health Politics Policy and Law, January 1, 1999; 24(1): 27 - 58. [Abstract] [PDF] |
||||
![]() |
T. A. Brennan More on Outcomes of Medical-Malpractice Litigation N. Engl. J. Med., March 5, 1998; 338(10): 690 - 690. [Full Text] |
||||