Assessing Clinical Skills of Residents with Standardized Patients

  1. PAULA L. STILLMAN, M.D.;
  2. DAVID B. SWANSON, Ph.D.;
  3. SYDNEY SMEE;
  4. ALFRED E. STILLMAN, M.D.;
  5. THOMAS H. EBERT, M.D.;
  6. VIVIEN S. EMMEL, Ph.D.;
  7. JOEL CASLOWITZ, M.D.;
  8. HARRY L. GREENE, M.D.;
  9. MILTON HAMOLSKY, M.D.;
  10. CHARLES HATEM, M.D.;
  11. DAVID J. LEVENSON, M.D.;
  12. ROBERT LEVIN, M.D.;
  13. GILBERT LEVINSON, M.D.;
  14. BRYSON LEY, M.D.;
  15. G. JAMES MORGAN, M.D.;
  16. THOMAS PARRINO, M.D.;
  17. STEPHEN ROBINSON, M.D.; and
  18. JANICE WILLMS, M.D.
  1. Worcester, Massachusetts; and Philadelphia, Pennsylvania

    Abstract

    Current techniques do not provide a reproducible, reliable, or valid basis for assessing clinical skills. The need for large-scale direct observation and standardized assessment procedures has precluded development of better techniques. A project using standardized patients presenting with common clinical problems evaluated the skills of 336 internal medicine residents at 14 New England residency programs in 1289 standardized patient and resident encounters. Results indicated that reproducible assessment of the clinical skills could be achieved in approximately 1 day of testing time using standardized patients. Resident performance improved with years of training, and senior residents and those from programs with stronger reputations performed better and were more homogeneous in ability. Low correlations between standardized-patient-based measures of clinical skills and other evaluation techniques suggested that standardized patients provided unique information. Reactions of residents and faculty to standardized-patient-based evaluations were favorable.

    Article and Author Information

    • ▸From the Office of the Curriculum Dean, University of Massachusetts Medical Center and the New England Consortium of Internal Medicine Residency Training Programs, Worcester, Massachusetts; and the American Board of Internal Medicine, Philadelphia, Pennsylvania.

    • The research reported in this article was supported by the American Board of Internal Medicine and the Fund for the Improvement of Post-Secondary Education but does not necessarily reflect their policies or opinions.

    • ▸Requests for reprints should be addressed to Paula L. Stillman, M.D.; Curriculum Dean, University of Massachusetts Medical Center, 55 Lake Avenue North; Worcester, MA 01605. A copy of the final report for this project is available from David B. Swanson, Ph.D.; American Board of Internal Medicine, 3624 Market Street; Philadelphia, PA 19104.

    « Previous | Next Article »Table of Contents