 |
 |
|
Home |
Current Issue |
Past Issues |
In the Clinic |
ACP Journal Club |
CME |
Collections |
Audio/Video |
Mobile |
Subscribe |
Tools |
Help |
ACP Online
|
Rapid Responses to:
|
|
Electronic letters published:
![[Read Rapid Response]](/icons/misc/sectionDOWN.gif){kind=icon}
Experience for diagnosis, not guidelines
Untitled
Untitled
Disappointment with the College
Quantification Sometimes Undermines Quality
Don't Denigrate Experience
Young Doctor and Old Lawyer
A Double Standard
Are Older Doctors Really Dumber?
PHYSICIAN COMPETANCY IN ACADEMIC PRACTICE
When is older wiser?
The relationship between clinical experience and some easily-measured aspects of care quality
Too Bad To Be True?
When I was younger, I knew more, but couldn't tell when to use it.
Do I Want a Fresh Graduate to take care of me ?
Untitled
|
|
|||
|
Andre CKB Amaral, MD Heart Institute (InCor/DF) - Zerbini Foundation - Brazil
Send rapid response to journal:
andre.amaral{at}incordf.zerbini.org.br Andre CKB Amaral
|
I read with great interest the article by Choudry et al (1), and was impressed by the (expected) number of critiques that followed. I would invite those who criticized the conclusions to make a self- relfection: indeed, experienced doctors are definitely more prone to recognize special subsets of diseases, and bring into light alternative diagnosis, even without the aid of laboratory examinations. However is medicine that hard? An old, very wise physician back in school always told me that medicine is 95-99% easy, and a very good doctor is only needed in the rest of the cases. Therefore, adherence to guidelines by younger doctors may lead their results into better general care, because most patients don't need someone to make a difficult diagnosis, but only to treat them following evidence-based medicine! On the other hand, those difficult to diagnose patients will probably benefit from an older, wiser and more experienced physician. But, as we see everyday in practice, and Choudry demonstrated, more experienced physicians tend to deviate from guidelines and evidence-based medicine and will probably not treat the majority of patients following these. Anyway, there will always be exceptions, as the older physician (specially those in academic positions) who keep their minds open to the advancements in medicine (and this will be the best doctor!!!), and the younger one who is careless about studying (who will be the worst!). So please, let's not make this a battlefield, as probably most experienced physicians who responded to this article belong to the very first class (those who keep up with articles and education), being the ones that we should seek for. But if you're not experienced AND still studying, I would go for the younger doctor. 1. Choudhry NK, RH Fletcher and SB Soumerai, Systematic Review: The Relationship between Clinical Experience and Quality of Health Care. Ann Intern Med 15 Feb 2005.142:260-73. Conflict of Interest:None declared |
|||
|
|
|||
|
Niteesh K. Choudhry, MD Harvard Medical School, Robert H. Fletcher, Stephen B. Soumerai
Send rapid response to journal:
choudhry{at}fas.harvard.edu Niteesh K. Choudhry, et al.
|
Drs. Samuels and Ropper raise concerns that our search strategy was “not in the least systematic” and was “circuitous.” As they describe in their letter, we identified studies from multiple sources and applied explicit inclusion and exclusion criteria. This process and its reporting are precisely what make our review systematic. We used methods recommended by the Cochrane Collaboration [1], which are similar to those frequently presented in the clinical literature. Drs. Samuels and Ropper take issue with the outcomes we evaluated, asserting that, “(p)atients do not seek consultation for a more fastidious application of standards.” We agree that many aspects of health care do not fit into clinical practice guidelines and that expert consultation by appropriately trained physicians likely leads to better care in these situations. However, an important aspect of quality is, in our opinions, application of the best available research evidence to the care of patients. This evidence is tailored to individual patients, to be sure, but applies to most patients most of the time. Drs. Poses and Diaz indicate that our results could have been biased by including data from poorly designed original studies. However, we did exclude the smallest studies and those that simply reported practice variation; we also identified which studies adjusted for patient and physician covariates (see Tables 2-4). We reported that restricting our analysis to higher quality studies did not change our results. Unfortunately, accepted methods for incorporating quality scores into systematic reviews of heterogeneous observational studies are not yet available. Even in reviews of clinical trials different scales generate widely discrepant results[2]. Dr. Szabo notes that the studies in our review were published over a large time span and that restricting the analysis to those studies published within the past 5 years demonstrates that “fifty percent (8/15) actually showed a neutral or positive effect….” Unfortunately, this statement deserves clarification. Of the 18 studies that were published in 2000 or later, 6 showed a consistently negative association between length of time in practice and performance, 4 showed partially negative results and 8 showed no association. Dr. Szabo’s suggestion that older physicians are busier and have less time to read clinical practice guidelines may be a partial explanation for our findings and merits study. Drs. Norman and Ewa provide clarification of Norcini et al’s results about the impact of years in practice on acute myocardial infarction mortality by pointing out that the results are relative, not absolute, risks. We agree that in absolute terms the adjusted effect sizes from this study are modest, although the magnitude of this effect is similar to the impact of volume on outcomes. Finally, Dr. Loder suggests that one of us failed to disclose his role as an editor of UpToDate. However, as Dr. Loder points out, we did not mention this particular textbook or any other in our article. In any case, editors and authors of textbooks, unlike authors with ties to companies selling drugs and devices, have so far not been asked to declare this as a conflict. Our comments on the limitations of traditional continuing medical education are based on available research evidence, summarized in reference 79. Delivering high quality care is the primary goal of all health care providers. We believe that care should be guided by the best available evidence. The thought-provoking letters illustrate the importance of re- energizing our efforts to establish effective quality-improvement mechanisms for physicians of all ages and specialties. Conflict of Interest:None declared |
|||
|
|
|||
|
William C Waters, III, MD
Send rapid response to journal:
drwaters{at}mindspring.com William C Waters, III
|
TO THE EDITOR: The meta-analysis by Choudry, et al., (Feb 15) appears to have limitations beyond those listed. For example, what is the clinical experience of the authors of the 62 articles? Are the studies vicarious? If younger doctors do better following preventive protocols, one must ask, Which protocols? (The five major studies conflict). And in assessing “adherence to guidelines,” one becomes confused looking at the more than 1000 sets now listed by the National Clearinghouse (www.guideline.gov). Don’t the more experienced doctors order fewer tests because they don’t need them (they still do histories and physicals)? Haven’t they learned to jettison impractical or unproven studies? And older doctors should have poorer outcomes; they are treating more complex, older patients with many problems, while their younger confreres attract the young families whose main challenges are URIs. Anyway, shouldn’t I have been better tutored than my father, and my son better than I – since we trained in the half-century which has seen 90 percent of medical innovations? Rather than accept the authors’ solemn forecast of partly cloudy for the progress of medicine, I would judge it at least partly sunny. Isn’t this progress? And, by the way, the bottom line was already enunciated by Dr. Osler: Get a quinquennial brain-dusting! William C. Waters III, MD, MACP Conflict of Interest:None declared |
|||
|
|
|||
|
Charles P Craig, MD N/A
Send rapid response to journal:
Bshepard{at}acponline.org Charles P Craig
|
To the Editor: Shame on you! I am distressed that the College, certainly well aware of the American penchant for generalization, would permit an article relating to age to quality of medical practice to be published without challenge (1). Will you next publish a meta analysis of the quality of care provided by a blue vs brown eyed physicians, or between those east of the Mississippi vs those west, or women vs men, or Caucasians compared with African Americans? Clearly there are confounding issues relevant to any such Article. The cited publication not only fails to detail confounding variables, but also overlooks obvious exceptions. These could include the dramatic announcement of K.F. Meyer at age (gasp) 72 that he had completed the development and testing of a vaccine against Japanese Encephalitis, or the creations, with reference to any text of medicine, by former President of the College Jack D. Myers of the computer program for Internist I after he had retired as chairman of medicine at the University of Pittsburgh at age 65. Age may be a measure of distance from formal education, but it is not a priori a measure of skill in delivery of health care. Yet your publication may be used by every young aspiring ladder climber to attempt to dislodge older persons on higher rungs of medical achievement. It certainly provides solace for those who discriminate against those of us over 65 based on nothing then our biologic age. It is told, in a dramatic story of civilizations that fail to honor their seniors, of one such society that took elderly persons, placed them in boxes and pushed them off a cliff. One such senior person simply suggested his younger executioner keep the box and push his intended victim off this cliff without it. When asked why, the elder is said to have replied, “So it will be available for you in a future year when you are old.” Perhaps you should save the boxes. I am dismayed that the College that I have so respected all these years should be so shallow as to have published such transparent data. The possible effects of the publication on the professional contributions of senior physicians and on their lives are to me incalculable. Charles P. Craig, MD 1. Choudhry NK, RH Fletcher and SB Soumerai, Systematic Review: The Relationship between Clinical Experience and Quality of Health Care. Ann Intern Med 15 Feb 2005.142:260-73. Conflict of Interest:None declared |
|||
|
|
|||
|
Martin A. Samuels, M.D. Brigham and Women's Hospital, Allan H. Ropper
Send rapid response to journal:
masamuels{at}bics.bwh.harvard.edu Martin A. Samuels, et al.
|
Choudry and colleague's paper is technically flawed, and potentially destructive (1). It has something to say and no doubt the authors were not seeking to be inflammatory but their conclusions, taken in isolation, have obtained consideraable lay attention and therefore require a broader discussion and context. We are as disappointed by the opportunity lost in the accompanying editorial to clarify the value of experience in medicine. Behind the mask of "evidence-based medicine," the authors review 59 articles, selected by their own peculia process from hundreds of potential papers relevant to the subject. They then analyze this sample according to four parameters: knowledge, adherence to standards of practice for diagnosis, screening and prevention; adherence to standards of appropriate therapy and outcomes. They conclude that "physicians who have been in practice longer may be at risk for providing lower-quality care. Therefore, this subgroup of physicians may need quality improvement interventions." The systematic review is defective in several respects. First, it was not in the least systematic. Of 245 articles retrieved by an internet search engine, 167 were excluded because the authors believed that "reported practice variation was not related to the quality of care or for which the quality of care was not clearly established" (83 papers); or "the study did not report physician practice variation" (49 studies); or because "the study did not assess the relationship of physician practice variation (49 studies); or because "the study did not assess the relationship of physician characteristics tothe outcomes" (18 papers); or because "the study assessed the performance of trainees" (9 papers); or because "the paper was an editorial or did not collect original data" (5 papers). Three papers were excluded for "other reasons," which were not characterized. To the 78 papers that remained, the authors added nine articles from their "personal archives" and 35 more from a "reference list search." Of the 122 papers discovered by this circuitous route, 63 more wre excluded by the authors because "the reported practice variation or outcomes were not clearly related to quality of care" (32 papers), or "the articles did not report the relationship between length of time in practice or physician age and outcomes" (27 papers). Four additional papers were excluded for "other reasons." This extraordinary process yielded the 59 articles that were the subject of the "systematic review." Note that the authors did not exclude articles that did not correct for the patients' age and the acuity or severity of the medical condition. Had they done so, they would have had virtually nothing to review. Older doctors by and large have older and sicker patients. Without taking this into account the interpretation of all such studies is falwed from the beginning. In addition, all four of the parameters whereby the 59 selected papers were analyzed speak to the core weakness of measuring quality through adherence to evidence based criteria. The firt of these is called "knowledge" by the authors, but what was studied was not knowledge, and certainly not its application, but information. If patients desired and sougth onoy information, they could consult the internet. In fact, this is precisely what many people now do, yet with allof this information, patients are, if anything less satisfied with their medical care than they were before all of this medical information was generally available. The next two parameters are also superficial gauges of quality medicine: adherence to standards of practice for diagnosis, screening, prevention and therapy. Anyone can apply standards of practice for diagnosis, screening, prevention and therpay. Anyone can apply standards or algorithms written by committees of medical societies. Patients do not seek consultation for a more fastidious application of standards. They look to us for a wise and compassionate analysis of their problem; typically one in which the illness is not presented in written form as it was on the tests and questionnaires that were surveyed in the paper. To cite a specific example, many patients consult us asking whether they are candidates for the newest cutting edge treatment for multiple sclerosis. A substantial number of these do not even have multiple sclerosis. They have been told that they did, sually by physicians who have come to depend excessively ont eh results of tests (read MRI). Certainly, a patient would be in better hands with a doctor who did not know the newest therapy for MS, but did know how to recognize the disease. Knowledge of practice standards is not wisdom. If our strength were the ability to recite the latest practice standards and drug names, sick patients would be right to avoid us. Finally, the authors conclude, that older doctors produce worse outcomes than younger ones. The authors need to be reminded that even in the era of evidence-based medicine, the mortality rate remains one per person. It just happens that younger doctors have on the average younger patients and are therefore not there as often when a patient dies. As younger doctors age, so will their panel of patients. Do the authors really believe that if we all had younger doctors, the mortality rate would fall? The crux of the issue is the value of experience and the methods by which one obtains it. Certainy, no one argues for the repetition of mistakes masquerading as experience. If evidence-based medicine is the antidote for hubris, it may yet serve us well. At the moment it is largely a method by which to define best practices for large populations of patients in circumstances where outcome can be measured based on single and sometimes simplisitc items. Age brings two things: graciousness and the time to see fads in both treatment and medical reform come and go. It is the weak physician, young or old, who fails to observe carefully his and her own patients and assess the course of disease. The ability to hear and see large amounts of clincial data and choose the singular and salient features is what marks clincial maturity and creastes value. From this can come a degree of clarity that cuts through the true complexity of many medical problems. The lack of confidence in their own judgment and dependence on tests to solve problems has led to a dismal dependence on authoritative solutions. This "systematic review" is potentially harmful to medicine. It glorifies information, algorithms and consensus criteria rather than experience and judgment. The analysis is simplistic, but its publication is perhaps not unexpected as part of an unfortunate course of events in medicine where, masquerading as evidence, quantification inadvertantly undermines quality. 1. Choudhry NK, Fletcher R, Soumerai S. Systematic Review: The Relationship between Clinical Experience and Quality of Health Care. Ann Intern Med. 2005;142:260-73. Conflict of Interest:None declared |
|||
|
|
|||
|
ronald s szabo, md Collins Medical Associates
Send rapid response to journal:
webmaster{at}stfranciscare.org ronald s szabo
|
I sat at my kitchen table eating a cold dinner after a twelve-hour day of seeing thirty patients, doing five preventive medicine physicals, two urgent preops, answering over twenty phone calls, sending two patient's to the ER from the office and read with grat interest Dr. Choudhry and colleagues article about Clinical Experience and Quality in the February 15, 2005 Annals (1). My twenty-year-old son sat next to me, who is as old as I have been in Internal Medicine Practice. I finished the article and said, "there will be an editorial calling for more frequent testing of physicians". Nonetheless, there stood the Editorial by Dr. Weinberger of the ACP and Drs. Duffy and Cassel representing the ABIM calling for "ongoing measurement of performance" (2). Excuse my cynicism, but how many Millions of dollars will be made by mandating additonal testing and recertification, despite the fact that there is, as of yet, no proof that it will improve the quality of care. Dr. Choudhry and colleagues reviewed fifty-nine articles addressing various disease states. It is interesting that over two-thirds of the studies are over five years old. In fact, many are almost thirty years old. However, the explosion of evidence-based data has really been most evident in the last several years. Supporting this is the fact that although seventy percent of all of the studies suggested a negative effect of "experience" on performance, of those studies cited that were published within the past five years, over fifty percent (8/15) actually showed a neutral or positive effect of "experience" on performance. Things appear to be getting better. Of greatest importance is the variable that is probably most correlated with "experience" and that is TIME. Unfortunately, TIME is inversely related to years in practice. It is likely that the older, "busier" physician has less time to deal with practice guidelines because there is just more to do. I do not believe that any of the studies looked at the physcian's time available as a variable. I would imagine that given the same amount of limited time, an older physician is likely to accomplish more and with more humanism than his younger counterpart. The older physician may not do a depression screen because he even knows why the patient is depressed. Overall, I am disappointed that the Annals has chosen to disparage older physicians with flimsy data at a time when malpractice and payment pressures are driving older, highly experienced physicians out of medicine early. I was privileged to train under Dr. J. Willis Hurst and Dr. Bruce Logue at the end of their careers. They could do more feeling a patient's pulse than we do with a trans-esophageal echocardiogram. They were venerated. Why are we now denigrating "experience"? Please be careful. 1. Choudhry NK, Fletcher R, Soumerai S. Systematic Review: The Relationship between Clinical Experience and Quality of Health Care. Ann Intern Med. 2005;142:260-73. 2. Weinberger SE, Duffy FD, Cassel CK. "Practice Makes Perfect"...Or Does It? Ann Intern Med. 2005;142:302-303. Conflict of Interest:None declared |
|||
|
|
|||
|
lee w. roof, m.d. whidbey island internal medicine
Send rapid response to journal:
wghosp{at}whidbeygen.org lee w. roof
|
Many years ago my older lawyer brother told me as I was finishing training that one should have a young doctor and old lawyer. It seems that Choudhry et al. have proved at least half of this contention (1). Lee W. Roof, MD 1. Choudhry NK, Fletcher R, Soumerai S. Systematic Review: The Relationship between Clinical Experience and Quality of Health Care. Ann Intern Med. 2005;142:260-73. |
|||
|
|
|||
|
Elizabeth W Loder, MD, FACP Harvard Medical School
Send rapid response to journal:
eloder{at}partners.org Elizabeth W Loder
|
I was surprised that the authors of this article reported no potential financial conflicts of interest. (1) One of the authors and his wife serve as Co-Editors in Chief of the adult primary care section of UpToDate, described on its web site as "a comprehensive evidence-based clinical information resource available to physicians on the internet, CD- ROM, and Pocket PC... designed to get physicians the concise, practical answers they need when they need them the most - at the point of care." (2, 3) In interviews following the article's publication this author identifies computerized databases as a principal solution to the quality problems identified by the review, although the article itself contains little evidence to support such a contention. While he does not specifically refer to the product UpToDate, phrases such as “up to date,” “at that time of care” and others identical to or highly reminiscent of those used in official descriptions of UpToDate do appear in the interviews, and immediately brought that product to my mind. (4, 5) If UpToDate were a drug rather than an information database, and the author were employed by or associated with its manufacturer, he might be criticized for his failure to report that connection. The author's employer has a clear financial interest in the subject matter of a manuscript that identifies traditional, competing continuing medical education techniques as "largely ineffective" and prompts interviews in which the answer to the "problem" identified in the review conveniently includes products that sound a lot like UpToDate. I am sure the author's intentions are laudable, and that the failure to report a connection with UpToDate was an oversight, but there seems to be a double standard, unrecognized at the highest levels of academia, about what poses a potential financial conflict of interest. Readers of this article and reporters who conducted interviews with the author based on it were denied the chance to consider whether this potential financial conflict influenced the focus of the review or the framing of recommended solutions. References 1.Choudhry NK, Fletcher RH, Soumerai SB. Systematic Review: The Relationship between Clinical Experience and Quality of Health Care. Ann Intern Med 2005;142:260-273. 2.http://www.uptodate.com/physicians/adult_primary_care_meet_editors.asp Accessed March 8, 2005 3.http://www.uptodate.com/service/index.asp Accessed March 8, 2005 4.http://www.abc.net.au/am/content/2005/s1303813.htm Accessed March 8, 2005 5.http://www.ama-assn.org/amednews/2005/03/07/prsb0307.htm Accessed March 8, 2005 Conflict of Interest:Dr. Loder is 46 and re-certified in Internal Medicine in 2000. She has been a paid and unpaid consultant and content developer for commercial and nonprofit continuing medical education projects. |
|||
|
|
|||
|
Roy M Poses, MD Brown University Center for Primary Care and Prevention, Joseph Diaz
Send rapid response to journal:
roy_poses{at}brown.edu Roy M Poses, et al.
|
The review article by Choudry et al about physicians’ clinical experience versus the quality of their care(1) created headlines. Most media coverage suggested that older doctors are dumber than younger ones, e.g., see (2). However, such conclusions appear to go beyond the data provided in the article. This review article did not use standards set a priori to exclude original articles of poor methodologic quality for review, or to rate the methodologic quality of any article it did review. Such standards are available.(3,4) Thus, the review article included original articles whose criteria for physician performance were not evidence-based, such as tests of knowledge not related to the physicians' practices. Furthermore, the review included articles regardless of their study architecture, age, sample size, patient selection criteria, whether and how they controlled for patients' characteristics, and their effect size and its precision. Thus, the review's results could have been biased by including data from poorly designed or performed original studies, and original studies which are unlikely to generalize to modern physicians. For example, consider the 13 original articles that used chart audit to assess adherence to standards of treatment. Only 6 showed a consistently negative effect of increasing age. Of these, one (Becker) was published 34 years ago, and included only 37 physicians. One (Moride) did not account for the severity of the patients' symptoms, and had a very small effect size (OR=1.12, CI 1.01, 1.24). One (Anderson) used a standard of care for inappropriate drug selection that might be debated. One (Dhalla) used that same standard, did not adjust for patients' clinical characteristics, and also had a very small effect size (OR=1.14). One (Payne) was published 21 years ago, and used practice standards defined by consensus, not evidence. One (Sanazaro) was published 20 years ago, included only 66 physicians, and again used practice standards defined by a panel, not evidence. Thus, the results of the review may have been biased by the methodologic weaknesses of the original articles it included. Its key conclusion, that older doctors’ performance is worse than that of younger ones, was not well supported by the evidence it presented. We agree that physicians’ professional values mandate serious, ongoing examination of our own performance. However, the principles of clinical epidemiology apply to such studies just as they apply to studies of patients. We should not rush to negative conclusions about physician performance without examining the strength of the relevant evidence. References 1. Choudry NK, Fletcher RH, Soumerai SB. Systematic review: the relationship between clinical experience and quality of health care. Ann Intern Med 2005; 142: 260-273 2. Allen S. Greater risk seen with older doctors. Boston Globe, February 15, 2005. 3. C. David Naylor, Gordon H. Guyatt, for the Evidence-Based Medicine Working Group. Users' guides to the medical literature: XI - How to use an article about a clinical utilization review. JAMA 1996; 275:1435-1439. 4. C. David Naylor and Gordon H. Guyatt for the Evidence-Based Medicine Working Group. Users' guides to the medical literature: X - How to use an article reporting variations in the outcomes of health services research. JAMA. 1996; 275:554-8. Conflict of Interest:None declared |
|||
|
|
|||
|
Scott C. Dexter, MD Albany Medical College, Louise-Anne McNutt PhD
Send rapid response to journal:
dexters{at}mail.amc.edu Scott C. Dexter, et al.
|
We recently published a study examining factors that influence a clinician’s decision regarding when to deliver a woman who has premature preterm rupture of the membranes.(1) Approximately 40% (n = 717) of U.S. maternal fetal medicine physicians (high risk pregnancy subspecialists) responded. Two expert review articles were published at the time of the questionnaire, which both agree with delivery at 34 weeks gestation, unless fetal pulmonary maturity could be documented.(2,3) In that case, delivery at 32 weeks was recommended. Respondent demographics including years of practice and type of practice were solicited. We found that those in practice for the fewest number of years were most likely to recommend delivery in line with the expert reviews. As the years of practice increased, the portion of responses consistent with the review articles continuously decreased. Furthermore, for each cohort of years of practice, a higher portion of full time faculty respondents managed their patients in line with the recent review articles compared with those in other practice settings (full time faculty range: 36% to 23%; others: 29% to 10%; full time faculty compared with all other practice types combined: p < 0.01). The differences in clinical behavior were greatest for the cohort of physicians with the most years of practice. If one considers that expert written review articles may be a surrogate for an emerging standard of care for some clinical issues, our results are in agreement with the findings of the recent manuscript by Choudhry et al regarding declining physician performance on some variables with increasing years of practice.(4) We make the additional observation that full-time faculty across the country performed more in keeping with published expert opinion across all experience levels. Our observations are limited by factors such as the lack of a clearly established standard of care for this clinical issue and a limited response rate to the questionnaire. However, our findings do raise the question as to whether there are educational advantages to being a full- time faculty member worth exploring as the dialogue over improving ways of maintaining physician competency continues. These may include faculty requirements to teach and do research. Faculty may also be more likely to work in a larger and more diverse institutional medical community, resulting in exposure to expanded and frequent formal educational opportunities as well as increased opportunities for physician collaboration. 1. Healy A, Veille JC, Sciscione A, McNutt LA, Dexter S. The Timing of Elective Delivery in Preterm Premature Rupture of the Membranes: A Survey of Members of the Society of Maternal-Fetal Medicine. Am J Obstet Gynecol 2004;190: 1479-81. 2. Duff P. Evaluation and Management of Preterm Premature Rupture of Membranes. OBG Management 2003;15:57-61. 3. Mercer BM. Preterm Premature Rupture of the Membranes. Obstet Gynecol 2003;101:178-193. 4. Choudhry NK, Fletcher RH, Soumerai SB. Systematic Review: The Relationship between Clinical Experience and Quality of Health Care. Ann Intern Med. 2005; 142:260-273. Conflict of Interest:None declared |
|||
|
|
|||
|
Robert E. Coifman, MD Allergy & Asthma of South Jersey
Send rapid response to journal:
rcoifman{at}aasj.com Robert E. Coifman
|
The disparity between the consistency and the weakness of the correlations found by Choudhry, Fletcher, and Soumerai (1) suggests the presence of unrecognized confounding factors. A likely factor is failure to identify subset differences that cut across their sorting of physicians only by age or duration of practice. While these authors find older physicians less informed about evidence-based guidelines, the physicians chosen by medical scientific societies to review the evidence and formulate these guidelines are usually in their 50's, 60's and 70's. Every physician knows that many of medicine’s best clinical teachers are senior physicians with years of experience backing up current knowledge. For some physicians, medicine is just a job. They’re likely to make the minimum effort needed for licensure and privileges and to make it through each day’s patient schedule. For these physicians, increasing experience may come at the expense of decreased current knowledge. For others, knowing and advancing the science of their specialty or field of practice is a labor of love. Their level of current knowledge is likely to increase with increasing experience. So will their wisdom in its application, from knowing how scientific knowledge evolves, including, for example, how the pendulum of interpretation can swing back and forth much more widely than the evidence on which it’s based. How would the authors differentiate these two groups of physicians for study? Might surrogate markers for medicine as a labor of love include membership in or leadership of national medical organization scientific committees or subcommittees, participation as teaching faculty in national medical organization medical education programs, participation as a CME speaker or program coordinator for local hospital medical staff accredited CME activities, authorship of publications in peer-reviewed medical journals, etc? If a commitment to understanding the scientific basis of ones field of medicine as a labor of love can be confirmed to correlate with the maintenance or enhancement of quality of care for the duration of a career, should efforts be made to identify predictors for the development of such a commitment and ways to encourage its development, and should the presence of such predictors have a role in the recruiting of future physicians and in selecting candidates for medical school admission? References 1: Choudhry NK, Fletcher RH, Soumerai SB. Systematic review: the relationship between clinical experience and quality of health care. Ann Intern Med. 2005 Feb 15;142. Conflict of Interest:None declared |
|||
|
|
|||
|
Tawee Tanvetyanon, M.D. Loyola University Chicago Stritch School of Medicine
Send rapid response to journal:
ttanve{at}lumc.edu Tawee Tanvetyanon
|
I read with concern the article by Choudhry and colleagues regarding the relationship between clinical experience and quality of health care (1). Their conclusion that physicians, who have been in practice longer, provide lower-quality care seems to have substantially discounted the value of senior physicians. First, this finding is probably not generalizable to senior physicians in the university settings. It is this group of physicians who largely form panels of expert and issue many of the practice guidelines used in the studies which their analysis based upon. It is also senior physicians who hand down medical education to us—and to the authors. In clinical practice, when difficult cases are encountered, senior physicians often give advice to younger physicians. In fact, the performance of younger physicians may have been influenced by senior physicians. Second, the analysis relies too heavily on the measurable indicators of quality of care. Other important aspects of care quality that cannot be easily measured are thus under-represented, simply because it is more difficult to conduct a study on them. For example, while many studies explore physicians’ medical knowledge, none explores the physician knowledge of the patient; indeed very few studies explore patient satisfaction with care. Moreover, no study investigates the patient confidence in the physician, which can influence compliance with treatment. No study explores personal attributes, friendship, professionalism, and ease of communication with the physicians. In fact, the highest rate of malpractice lawsuit is observed among physicians age around 40s’, suggesting that the authors’ finding may have, indeed, undervalued the quality of care from the patients’ perspective (2). As a patient, I continue seeing my older physicians who have followed me for a long period because of the continuity of care—and because I trust them; there is no need for any study to show that this strategy can provide me with a better outcome. Finally, not only the analysis provides information narrowly on the published, measurable aspect of care quality; it also fails to address the quantity of care. It is important not to disregard the amount of contribution that senior physicians have provided and continue to provide to our patients. Senior physicians serve as a backbone for most medical cares in rural areas of our country (3). Besides, disregarding some insignificant details—often excessively captured in guideline auditing studies—may allow more patients to be cared for, and more serious matters to be taken care of. In my view, because the practice of medicine is not only a science but also an art, the measurement of its artistic quality would depend largely on the beholders—the patients. I believe one cannot ignore the fact that a patient life is not a mathematic equation, or a computer program would have provided the best medical care. References 1: Choudhry NK, Fletcher RH, Soumerai SB. Systematic review: the relationship between clinical experience and quality of health care. Ann Intern Med. 2005 Feb 15;142(4):260-73. 2: Taragin MI, Wilczek AP, Karns ME, Trout R, Carson JL. Physician demographics and the risk of medical malpractice. Am J Med. 1992 Nov;93(5):537-42. 3: Thompson MJ, Lynge DC, Larson EH, Tachawachira P, Hart LG. Characterizing the general surgery workforce in rural America. Arch Surg. 2005 Jan;140(1):74-9. Conflict of Interest:None declared |
|||
|
|
|||
|
Geoffrey R. Norman, PhD McMaster University, Kevin W. Eva, PhD
Send rapid response to journal:
norman{at}mcmaster.ca Geoffrey R. Norman, et al.
|
To the Editor: The article by Choudhry, Fletcher and Soumerai (1) showing a consistent negative relationship between experience and performance is controversial. While few will be surprised that recent graduates do better on knowledge tests, or are more likely to adhere to practice guidelines, the relationship to patient outcomes, particularly mortality, is much more difficult to dismiss. In particular, the one unequivocal study, by Norcini (3), observed “a 0.5% increase in mortality for every year [since graduation]”. Taken at face value this is a terrifying statistic. If a recent graduate has a 10% in-hospital mortality, then someone 30 years in practice has a mortality of (10 + 30 x 0.5) or 25%, two and a half times as much. In fact, the statistic is too bad to be true. The data from Norcini are actually RELATIVE risks, not absolute risks. In Table 2, (page 1197) the weight for years since graduation is 0.005%. By contrast, certification has a coefficient of - 0.15, and specialty training has a coefficient of - 0.25. On page 1195, Norcini states that certification was associated with a 15% reduction in mortality and specialization with a 25- 26% reduction. Thus, 20 years in practice equates to a relative increase in risk of about (20 x .005) = 0.10 and a absolute increase in mortality of about 1%, In a subsequent study by Norcini (3)using similar data, the effect of experience was smaller still (0.002%) and not statistically significant. These results are consistent with the one other positive study of mortality cited by Choudhry (5) where relative risk of years since training was small and non-linear, resulting in a decrease to about 0.9 after 5-15 years of practice and climbing to 1.1 after 20 years of practice and 1.3 after 30 years. The relation between years in practice and “hard” patient outcomes is weak. Thirty to 50 years of practice has no more impact on outcome than passing the certification exam or two years of subsepecialty training. References 1) Choudhry NK, Fletcher RH, Soumerai SB. Systematic review: the relationship between clinical experience and quality of health care. Ann Intern Med 2005; 142: 260-273. 2) Norcini JJ, Kimball HR, Lipner RS.Certification and specialization: do they matter in the outcome of acute myocardial infarction? Acad Med. 2000; 75:1193-8. 3) Norcini JJ, Lipner RS, Kimball HR. Certifying examination performance and patient outcomes following acute myocardial infarction. Med Educ 2002; 36: 853-9. 4) Hartz AJ, Kuhn EM, Pulido J. Prestige of training programs and experience of bypass surgeons as factors in adjusted patient mortality rates. Med Care. 1999; 37: 93-103. Conflict of Interest:None declared |
|||
|
|
|||
|
David Hubler, MD Private practice
Send rapid response to journal:
Inbox{at}AgoodDoctor.com David Hubler
|
The article on "The Relationship between Clinical Experience and Quality of Health Care" missed some key points. How can younger physicians be trained by dumber older physicians? If the standards of care were chosen by older physicians, how would younger physicians measure up? How many first or second year physicians choose their classmates as their surgeons or physicians over some of their "older" teachers and more experienced colleagues. I certainly thought I knew more when I finished my residency than I think I know now. However, like the teenager who knows everything, I could not always decide when best to use the information. Use of that knowledge comes with experience. Now that I am older I know that I don't know everything and limit my actions to what I have learned works best in my hands. Most of my older colleagues limit their practice to what they do well. They shouldn't be tested on what they are smart enough not to do. If I were to be tested on joystick games, I would fail, however ask my patients how I do and you would find I excel. Logically our performance as physicians should improve at least for awhile before declining. Any report to the contrary doesn't pass the smell test and shouldn't be reported except in the National Enquirer type tabloids. Conflict of Interest:None declared |
|||
|
|
|||
|
Farhan Sheikh, MD Albany Medical Center
Send rapid response to journal:
sheikhf{at}mail.amc.edu Farhan Sheikh
|
In reference to the article by Choudhry et al (1) I would like to know whether they would prefer a recent graduate, say in cardiac surgery or anesthesiology, take care of someone close to them. Brushing off senior surgeons and anesthesiologists because of a lack of consensus on parameters for transfusions - does not, in my mind, make a senior physician "behind the times". I find it interesting that residents and fellows come to us to be trained in the spciality of cardiac surgery and anesthesiology ,but, according to Choudhry, these same residents on graduation, are suddenly better than the physicians who trained them! How does one make such assumptions ? Is there for example, a difference in the knowledge base between physicians from academic vs non academic programs. Does it make a difference if a physician is specialized in a particular field and is involved with the teaching of medical students, residents and fellows ? Does experience count when it comes to a surgical speciality such as cardiac ? The reference to the article by Burns(2) about senior cardiac surgeons having a longer length of stay in their patients following cardiac surgery, was compiled in 1988 and it actually states( abstract) that surgery and graduation from medical school, not age, made a difference. I do agree with the concept of continuing medical education, but to view all physicians with over 20 years of experience to be "over the hill " is a disservice to all physicians. Choudhry may not think so - but please get me a surgeon and an anesthesiologist with 20 plus years of experience over a recent graduate when it comes time to fix my heart ! References 1) N.K. Choudhry et al : The relationship between clinical experience and quality of health care. Annals of Internal Medicine Feb. 05 vol.142Issue 4 . (260-273) 2) Burns LR The effects of Patient, Hospital, and Physician Characteristics on length of stay and Mortality: Medical Care 1991; 29 ( 251 71 ) Conflict of Interest:None declared |
|||
|
|
|||
|
Arnold Goldschlager, MD UCSF
Send rapid response to journal:
agoldschlager{at}aol.com Arnold Goldschlager
|
COMMENTS: I find the conclusions of that article to be personally offensive & journalistically lacking. If 52% of the studies showed one conclusion - one assumes that the other 48% did not. How can the authors (and editors) base a conclusion if the results are "essentially 50-50"? I have been a medical graduate since 1963 & use my own accumulated clinical data base in my practice on a daily basis. In addition I have been teaching at UCSF for 36 years & can attest that the current crop of physicians will never learn the diagnostic skills (e.g. cardiac physical diagnosis) since they run to the echocardiogram immediately. Why listen to the heart? Are they better clinicians or quicker to use technology. Do they measure physician competence by per cent of patients that receive beta blockers, ACE inhibitors, statins according to algorithms? If that is the case, why do we need M.D. graduates at all; surely, we can teach nurse practitioners to follow algorithms more slavishly than M.D.'s who want to think for themselves. Arnold Goldschlager, M.D., FACP, FACC, FAHA Conflict of Interest:None declared |
|||
