 |
 |
|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
15 January 1994 | Volume 120 Issue 2 | Pages 135-142
Objective: To review the evidence from controlled trials of the effects of computer-based clinical decision support systems (CDSSs) on clinician performance and patient outcomes.
Data Sources: The literature in the MEDLARS, EMBASE, SCISEARCH, and INSPEC databases was searched from 1974 to the present. Conference proceedings and reference lists of relevant articles were reviewed. Evaluators of CDSSs were asked to identify additional studies.
Study Selection: 793 citations were examined, and 28 controlled trials that met predefined criteria were reviewed in detail.
Data Extraction: Study quality was assessed, and data on setting, clinicians and patients, method of allocation, computer system, and outcomes were abstracted and verified using a structured form. Separate summaries were prepared for physician and patient outcomes. Within each of these categories, studies were classified further according to the primary purpose of the CDSS: drug dose determination, diagnosis, or quality assurance.
Results: Three of 4 studies of computer-assisted dosing, 1 of 5 studies of computer-aided diagnosis, 4 of 6 studies of preventive care reminder systems, and 7 of 9 studies of computer-aided quality assurance for active medical care that assessed clinician performance showed improvements in clinician performance using a CDSS. Three of 10 studies that assessed patient outcomes reported significant improvements.
Conclusions: Strong evidence suggests that some CDSSs can improve physician performance. Additional well-designed studies are needed to assess their effects and cost-effectiveness, especially on patient outcomes.
Author and Article Information
From McMaster University, Hamilton, Ontario, Canada; University of Cincinnati, Cincinnati, Ohio.
DIAGNOSIS AND TREATMENT
Effects of Computer-based Clinical Decision Support Systems on Clinician Performance and Patient Outcome: A Critical Appraisal of Research
Requests for Reprints: R. Brian Haynes, MD, PhD, McMaster University Health Sciences Centre, Room 3H7, 1200 Main Street West, Hamilton, Ontario L8N 3Z5, Canada.
Acknowledgments: The authors thank C. Walker Dilks and T. Fleming for help with literature searching, J. Wyatt for his comments, and authors for responding to our requests for additional information.
Grant Support: Supported by the Brian C. Decker Health Information Research Fund and the Medical Research Council of Canada. Dr. Haynes is supported by a National Health Scientist Award from the National Health Research and Development Programme of Health and Welfare Canada.
This article has been cited by other articles:
|
|
 |
|
  K M M Lemmens, A P Nieboer, C P van Schayck, J D Asin, and R Huijsman A model to evaluate quality and effectiveness of disease management Qual. Saf. Health Care, December 1, 2008; 17(6): 447 - 453. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 C. B. Egger Halbeis, R. H. Epstein, A. Macario, R. G. Pearl, and Z. Grunwald Adoption of Anesthesia Information Management Systems by Academic Departments in the United States Anesth. Analg., October 1, 2008; 107(4): 1323 - 1329. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 E. Ammenwerth, P. Schnell-Inderst, C. Machan, and U. Siebert The Effect of Electronic Prescribing on Medication Errors and Adverse Drug Events: A Systematic Review J. Am. Med. Inform. Assoc., September 1, 2008; 15(5): 585 - 600. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 E. Bottieau, J. Moreira, J. Clerinx, R. Colebunders, A. Van Gompel, and J. Van den Ende Evaluation of the GIDEON Expert Computer Program for the Diagnosis of Imported Febrile Illnesses Med Decis Making, June 1, 2008; 28(3): 435 - 442. [Abstract] [PDF]
|
|
|
|
|
|
N. F. Col, L. Ngo, J. M. Fortin, R. J. Goldberg, and A. M. O'Connor Can Computerized Decision Support Help Patients Make Complex Treatment Decisions? A Randomized Controlled Trial of an Individualized Menopause Decision Aid Med Decis Making, October 1, 2007; 27(5): 585 - 598. [Abstract] [PDF]
|
|
|
|
 |
|
 J. A. Linder, J. Ma, D. W. Bates, B. Middleton, and R. S. Stafford Electronic Health Record Use and the Quality of Ambulatory Care in the United States Arch Intern Med, July 9, 2007; 167(13): 1400 - 1405. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. Wright, H. Goldberg, T. Hongsermeier, and B. Middleton A Description and Functional Taxonomy of Rule-based Decision Support Content at a Large Integrated Delivery Network J. Am. Med. Inform. Assoc., July 1, 2007; 14(4): 489 - 496. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 C. Feifer, L. Nemeth, P. J. Nietert, A. M. Wessell, R. G. Jenkins, L. Roylance, and S. M. Ornstein Different Paths to High-Quality Care: Three Archetypes of Top-Performing Practice Sites Ann. Fam. Med, May 1, 2007; 5(3): 233 - 241. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. Y. Peng, K. C. Wu, J. J. Wang, J. H. Chuang, S. K. Peng, and Y. H. Lai Predicting postoperative nausea and vomiting with the application of an artificial neural network Br. J. Anaesth., January 1, 2007; 98(1): 60 - 65. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 R. Shegog, L. K. Bartholomew, M. M. Sockrider, D. I. Czyzewski, S. Pilney, P. D. Mullen, and S. L. Abramson Computer-based decision support for pediatric asthma management: description and feasibility of the Stop Asthma Clinical System. Health Informatics Journal, December 1, 2006; 12(4): 259 - 273. [Abstract] [PDF]
|
|
|
|
|
|
D. L. Sanders and D. Aronsky Biomedical Informatics Applications for Asthma Care: A Systematic Review J. Am. Med. Inform. Assoc., July 1, 2006; 13(4): 418 - 427. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. C. McGregor, E. Weekes, G. N. Forrest, H. C. Standiford, E. N. Perencevich, J. P. Furuno, and A. D. Harris Impact of a Computerized Clinical Decision Support System on Reducing Inappropriate Antimicrobial Use: A Randomized Controlled Trial J. Am. Med. Inform. Assoc., July 1, 2006; 13(4): 378 - 384. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 K. A. Thursky, K. L. Buising, N. Bak, L. Macgregor, A. C. Street, C. R. Macintyre, J. J. Presneill, J. F. Cade, and G. V. Brown Reduction of broad-spectrum antibiotic use with computerized decision support in an intensive care unit Int. J. Qual. Health Care, June 1, 2006; 18(3): 224 - 231. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
H. Berkenstadt, Y. Yusim, A. Ziv, T. Ezri, and A. Perel An Assessment of a Point-of-Care Information System for the Anesthesia Provider in Simulated Malignant Hyperthermia Crisis Anesth. Analg., February 1, 2006; 102(2): 530 - 532. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. Apkon, J. A. Mattera, Z. Lin, J. Herrin, E. H. Bradley, M. Carbone, E. S. Holmboe, C. P. Gross, J. G. Selter, A. S. Rich, et al. A Randomized Outpatient Trial of a Decision-Support Information Technology Tool Arch Intern Med, November 14, 2005; 165(20): 2388 - 2394. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. M. Knight, S. J. Kravet, G. M. Harper, and B. Leff The Effect of Computerized Provider Order Entry on Medical Student Clerkship Experiences J. Am. Med. Inform. Assoc., September 1, 2005; 12(5): 554 - 560. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. T. Rosenbloom, K.-W. Chiu, D. W. Byrne, D. A. Talbert, E. G. Neilson, and R. A. Miller Interventions to Regulate Ordering of Serum Magnesium Levels: Report of an Unintended Consequence of Decision Support J. Am. Med. Inform. Assoc., September 1, 2005; 12(5): 546 - 553. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
L. Poissant, J. Pereira, R. Tamblyn, and Y. Kawasumi The Impact of Electronic Health Records on Time Efficiency of Physicians and Nurses: A Systematic Review J. Am. Med. Inform. Assoc., September 1, 2005; 12(5): 505 - 516. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. T. Rosenbloom, A. J. Geissbuhler, W. D. Dupont, D. A. Giuse, D. A. Talbert, W. M. Tierney, W. D. Plummer, W. W. Stead, and R. A. Miller Effect of CPOE User Interface Design on User-Initiated Access to Educational and Patient Information during Clinical Care J. Am. Med. Inform. Assoc., July 1, 2005; 12(4): 458 - 473. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. Garland Improving the ICU: Part 2 Chest, June 1, 2005; 127(6): 2165 - 2179. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J Kwok and B Jones Unnecessary repeat requesting of tests: an audit in a government hospital immunology laboratory J. Clin. Pathol., May 1, 2005; 58(5): 457 - 462. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 G. P Purcell What makes a good clinical decision support system BMJ, April 2, 2005; 330(7494): 740 - 741. [Full Text] [PDF]
|
|
|
|
 |
|
 A. X. Garg, N. K. J. Adhikari, H. McDonald, M. P. Rosas-Arellano, P. J. Devereaux, J. Beyene, J. Sam, and R. B. Haynes Effects of Computerized Clinical Decision Support Systems on Practitioner Performance and Patient Outcomes: A Systematic Review JAMA, March 9, 2005; 293(10): 1223 - 1238. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C. Delpierre, L. Cuzin, J. Fillaux, M. Alvarez, P. Massip, and T. Lang A systematic review of computer-based patient record systems and quality of care: more randomized clinical trials or a broader approach? Int. J. Qual. Health Care, October 1, 2004; 16(5): 407 - 416. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J Fransen, R F J M Laan, M A F J van der Laar, T W J Huizinga, and P L C M van Riel Influence of guideline adherence on outcome in a randomised controlled trial on the efficacy of methotrexate with folate supplementation in rheumatoid arthritis Ann Rheum Dis, October 1, 2004; 63(10): 1222 - 1226. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. H. Trivedi, J. K. Kern, B. D. Grannemann, K. Z. Altshuler, and P. Sunderajan A Computerized Clinical Decision Support System as a Means of Implementing Depression Guidelines Psychiatr Serv, August 1, 2004; 55(8): 879 - 885. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 C. L. Roumie, E. L. Grogan, W. Falbe, J. Awad, T. Speroff, R. S. Dittus, and T. A. Elasy A Three-Part Intervention To Change the Use of Hormone Replacement Therapy in Response to New Evidence Ann Intern Med, July 20, 2004; 141(2): 118 - 125. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. M. Bravata, K. M. McDonald, H. Szeto, W. M. Smith, C. Rydzak, and D. K. Owens A Conceptual Framework for Evaluating Information Technologies and Decision Support Systems for Bioterrorism Preparedness and Response Med Decis Making, March 1, 2004; 24(2): 192 - 206. [Abstract] [PDF]
|
|
|
|
|
|
D. S. Bell, S. Cretin, R. S. Marken, and A. B. Landman A Conceptual Framework for Evaluating Outpatient Electronic Prescribing Systems Based on Their Functional Capabilities J. Am. Med. Inform. Assoc., January 1, 2004; 11(1): 60 - 70. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 D. M. D'Alessandro, C. D. Kreiter, and M. W. Peterson An Evaluation of Information-Seeking Behaviors of General Pediatricians Pediatrics, January 1, 2004; 113(1): 64 - 69. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. W. Bates, G. J. Kuperman, S. Wang, T. Gandhi, A. Kittler, L. Volk, C. Spurr, R. Khorasani, M. Tanasijevic, and B. Middleton Ten Commandments for Effective Clinical Decision Support: Making the Practice of Evidence-based Medicine a Reality J. Am. Med. Inform. Assoc., November 1, 2003; 10(6): 523 - 530. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S.-T. Liaw, N. Sulaiman, C. Pearce, J. Sims, K. Hill, H. Grain, J. Tse, and C.-K. Ng Falls Prevention within the Australian General Practice Data Model: Methodology, Information Model, and Terminology Issues J. Am. Med. Inform. Assoc., September 1, 2003; 10(5): 425 - 432. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. M. Kuilboer, M. A. M. van Wijk, M. Mosseveld, and J. van der Lei AsthmaCritic: Issues in Designing a Noninquisitive Critiquing System for Daily Practice J. Am. Med. Inform. Assoc., September 1, 2003; 10(5): 419 - 424. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
L. SALOMON, G. DERAY, M. C. JAUDON, C. CHEBASSIER, P. BOSSI, V. LAUNAY-VACHER, B. DIQUET, J. M. CEZA, S. LEVU, G. BRUCKER, et al. Medication misuse in hospitalized patients with renal impairment Int. J. Qual. Health Care, August 1, 2003; 15(4): 331 - 335. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J Fransen, G Stucki, J Twisk, A-M Chamot, J-C Gerster, T Langenegger, M Seitz, B A Michel, and the members of the Swiss Clinical Quality Manageme Effectiveness of a measurement feedback system on outcome in rheumatoid arthritis: a controlled clinical trial Ann Rheum Dis, July 1, 2003; 62(7): 624 - 629. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 D. W. Bates and A. A. Gawande Improving Safety with Information Technology N. Engl. J. Med., June 19, 2003; 348(25): 2526 - 2534. [Full Text] [PDF]
|
|
|
|
|
|
G. D. Schiff, D. Klass, J. Peterson, G. Shah, and D. W. Bates Linking Laboratory and Pharmacy: Opportunities for Reducing Errors and Improving Care Arch Intern Med, April 28, 2003; 163(8): 893 - 900. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. M. Maviglia, R. D. Zielstorff, M. Paterno, J. M. Teich, D. W. Bates, and G. J. Kuperman Automating Complex Guidelines for Chronic Disease: Lessons Learned J. Am. Med. Inform. Assoc., March 1, 2003; 10(2): 154 - 165. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
T. A. Oniki, T. P. Clemmer, and T. A. Pryor The Effect of Computer-generated Reminders on Charting Deficiencies in the ICU J. Am. Med. Inform. Assoc., March 1, 2003; 10(2): 177 - 187. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. P. Treweek, C. Glenton, A. D. Oxman, and A. Penrose Computer-generated Patient Education Materials: Do They Affect Professional Practice? : A Systematic Review J. Am. Med. Inform. Assoc., July 1, 2002; 9(4): 346 - 358. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. Fransen, G. Stucki, and P. van Riel The merits of monitoring: should we follow all our rheumatoid arthritis patients in daily practice? Rheumatology, June 1, 2002; 41(6): 601 - 604. [Full Text] [PDF]
|
|
|
|
 |
|
 A. Lewis Health informatics: information and communication Advan. Psychiatr. Treat., May 1, 2002; 8(3): 165 - 171. [Full Text] [PDF]
|
|
|
|
|
|
A H Morris Decision support and safety of clinical environments Qual. Saf. Health Care, March 1, 2002; 11(1): 69 - 75. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. H. Farrell, J. M. Foody, and H. M. Krumholz {beta}-Blockers in Heart Failure: Clinical Applications JAMA, February 20, 2002; 287(7): 890 - 897. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R. Patterson and P. Harasym Educational Instruction on a Hospital Information System for Medical Students During Their Surgical Rotations J. Am. Med. Inform. Assoc., March 1, 2001; 8(2): 111 - 116. [Abstract] [Full Text]
|
|
|
|
|
|
B. H.S.C. Rocha, J. C. Christenson, R. S. Evans, and R. M. Gardner Clinicians' Response to Computerized Detection of Infections J. Am. Med. Inform. Assoc., March 1, 2001; 8(2): 117 - 125. [Abstract] [Full Text]
|
|
|
|
|
|
E. Mitchell and F. Sullivan A descriptive feast but an evaluative famine: systematic review of published articles on primary care computing during 1980-97 BMJ, February 3, 2001; 322(7281): 279 - 282. [Abstract] [Full Text]
|
|
|
|
|
|
W. H. Geerts, J. A. Heit, G. P. Clagett, G. F. Pineo, C. W. Colwell, F. A. Anderson Jr., and H. B. Wheeler Prevention of Venous Thromboembolism Chest, January 1, 2001; 119(1_suppl): 132S - 175S. [Full Text] [PDF]
|
|
|
|
|
|
J. M. Teich, P. R. Merchia, J. L. Schmiz, G. J. Kuperman, C. D. Spurr, and D. W. Bates Effects of Computerized Physician Order Entry on Prescribing Practices Arch Intern Med, October 9, 2000; 160(18): 2741 - 2747. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. Weingarten Translating Practice Guidelines Into Patient Care : Guidelines at the Bedside Chest, August 1, 2000; 118(2_suppl): 4S - 7S. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
W. R. Smith Evidence for the Effectiveness of Techniques To Change Physician Behavior Chest, August 1, 2000; 118(2_suppl): 8S - 17S. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
T. H. Payne Computer Decision Support Systems Chest, August 1, 2000; 118(2_suppl): 47S - 52S. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. Eccles, J. Grimshaw, N. Steen, D. Parkin, I. Purves, E. McColl, and N. Rousseau The design and analysis of a randomized controlled trial to evaluate computerized decision support in primary care: the COGENT study Fam. Pract., April 1, 2000; 17(2): 180 - 186. [Full Text] [PDF]
|
|
|
|
|
|
J. S. Shaw, R. C. Samuels, E. M. Larusso, and H. H. Bernstein Impact of an Encounter-Based Prompting System on Resident Vaccine Administration Performance and Immunization Knowledge Pediatrics, April 1, 2000; 105(4): 978 - 983. [Abstract] [Full Text]
|
|
|
|
|
|
P G Nightingale, D Adu, N T Richards, and M Peters Implementation of rules based computerised bedside prescribing and administration: intervention study BMJ, March 18, 2000; 320(7237): 750 - 753. [Abstract] [Full Text]
|
|
|
|
|
|
A. H. Morris Developing and Implementing Computerized Protocols for Standardization of Clinical Decisions Ann Intern Med, March 7, 2000; 132(5): 373 - 383. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. Hornberger and M. Kane Goldstein Clinical Decision-support Systems:: Evaluating the Evaluation Med Decis Making, January 1, 2000; 20(1): 130 - 131. [PDF]
|
|
|
|
|
|
C. P. Friedman, A. S. Elstein, F. M. Wolf, G. C. Murphy, T. M. Franz, P. S. Heckerling, P. L. Fine, T. M. Miller, and V. Abraham Enhancement of Clinicians' Diagnostic Reasoning by Computer-Based Consultation: A Multisite Study of 2 Systems JAMA, November 17, 1999; 282(19): 1851 - 1856. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 E. A. Iliadis, L. W. Klein, B. J. Vandenberg, D. Spokas, T. Hursey, J. E. Parrillo, and J. E. Calvin Clinical practice guidelines in unstable angina improve clinical outcomes by assuring early intensive medical treatment J. Am. Coll. Cardiol., November 15, 1999; 34(6): 1689 - 1695. [Abstract] [Full Text] [PDF]
|
|
Article
