15 January 1998 | Volume 128 Issue 2 | Pages 102-110
Background: Physicians can increase the rate of completion of advance directive forms by discussing directives with their patients, but the means by which physicians can be induced to initiate these discussions are unclear. Computer-generated reminders have been shown to increase physician compliance with practice guidelines.
Objective: To determine the effects of computer-generated reminders to physicians on the frequency of advance directive discussions between patients and their primary caregivers and the frequency of consequent establishment of advance directives.
Design: Randomized, controlled trial with a 2 x 2 factorial design.
Setting: An outpatient general medicine practice associated with an urban public hospital.
Participants: Participants were 1) 1009 patients who were at least 75 years of age or were at least 50 years of age with serious underlying disease and 2) 147 primary care physicians (108 housestaff and 39 faculty).
Intervention: Computer-generated reminders that recommended discussion of one or both of two types of advance directives compared with no reminders.
Measurements: Discussions about advance directives, determined by patient interviews after all scheduled patientphysician outpatient encounters, and completed advance directive forms. The study period was approximately 1 year.
Results: Physicians who did not receive reminders (controls) discussed advance directives with 4% of the study patients compared with 24% for physicians who received both types of reminders (adjusted odds ratio, 7.7 [95% CI, 3.4 to 18]; P < 0. 001). Physicians who did not receive reminders completed advance directive forms with only 4% of their study patients compared with 15% for physicians who received both types of reminders (adjusted odds ratio, 7.0 [CI, 2.9 to 17]; P < 0.001). Overall, 45% of patients with whom advance directives were discussed completed at least one type of advance directive.
Conclusions: Simple computer-generated reminders aimed at primary caregivers can increase the rates of discussion of advance directives and completion of advance directive forms among elderly outpatients with serious illnesses.
In 1990, the U.S. Congress passed the Patient Self-Determination Act, which requires hospitals to inform admitted patients about their right to record advance directives [6, 11]. The Act does not dictate who should initiate these discussions (patients, physicians, or an admissions officer, for example) [12, 13]. It is therefore not surprising that the Act has had little effect on the rate of completion of advance directives [11, 13-15]. Because hospitalized patients are often acutely ill and lose their ability to make decisions [3], it may be more appropriate to discuss such issues before hospitalization [12, 16, 17].
Other interventions aimed at increasing the establishment of advance directives have met with mixed success [18]. With one exception [19], patient education has had little or no effect [20-24]. More effective interventions have trained physicians, social workers, or counselors to discuss advance directives [18, 22, 25-27]; this has led to the conclusion that counseling by a clinician is the best catalyst for the completion of advance directives [28]. However, little is known about how to educate and motivate clinicians to solicit advance directives [28].
We [29-31] and others [32] have previously shown that computer reminders increase physician compliance with practice guidelines. In this study, we tested the hypothesis that reminding primary care physicians to discuss advance directives would stimulate such discussions and lead to the establishment of more advance directives.
This study was approved by the institutional review board of Indiana University as expedited research with waiver of informed consent from both patients and physicians. It was conducted in the General Medicine Practice [31], an academic primary care practice affiliated with an urban public teaching hospital. This practice is staffed by general internal medicine faculty, fellows, and residents. Each resident and fellow attends the General Medicine Practice one half-day per week; faculty attend one to four half-days per week. Residents always practice with the same attending faculty physicians. All physicians, except for study investigators, were eligible to participate.
At the time of this study, the General Medicine Practice comprised four separate practices with separate waiting areas, clerks, and nurses. Each practice held eight half-day sessions per week. Each session was attended by two faculty members and two or three residents, each of whom provided primary care to assigned panels of patients. Residents were required to briefly discuss each patient with the attending faculty. Fellows served as faculty and were treated as such. Since 1981, a computerized program has randomly assigned new physicians to the practice sessions [31]. New patients have been sequentially assigned to open appointment slots; this resulted in no important differences in patients or clinical practice among the sessions [29, 33].
We included patients who were at risk for acute deterioration (and therefore might benefit from advance directives) because of advanced age (
Eligible patients who kept appointments at the General Medicine Practice were approached by research assistants in the waiting room. The research assistants, who were blinded at all times to the patients' study groups, explained the study to the patients, invited them to participate, and interviewed those who agreed to participate; patients from nursing homes and prisons and patients who were deaf or did not speak English were excluded. The assistants then administered the Pfeiffer Mental Status Questionnaire [35]; patients whose scores indicated cognitive dysfunction were excluded. The remaining patients provided sociodemographic information and stated whether they had previously discussed or completed advance directives; patients who had completed advance directives were excluded. Patients also stated their preferences with regard to six treatments in the event of a terminal illness [36].
Advance Directives
Before the study, we created two separate forms for instruction directives and proxy directives; these forms became the official advance directive documents of the hospital and its outpatient services. The instruction directive allowed patients to indicate whether, in the event of terminal illness and mental incapacity, they wanted or did not want eight types of care: cardiopulmonary resuscitation, mechanical ventilation, surgery, invasive procedures, nutrition and hydration, transfusion of blood or blood products, antibiotics, or noninvasive diagnostic tests. The primary care physician had to sign each completed instruction directive form to indicate that he or she was aware of its contents. The proxy directive designated both primary and secondary health care representatives.
We placed both advance directive forms in a drawer of the desk of each physician in the General Medicine Practice. We also placed the forms in a bin near the door of the staff room along with other forms and requisitions and business reply envelopes for patients who wanted to complete the forms at home. Research assistants entered the data from completed forms into the Regenstrief Medical Record System, where the forms were available for viewing through computer terminals and workstations in all inpatient and outpatient venues [34].
Before the study, the three physician-investigators presented the basic concepts of advance directives at grand rounds. They also had face-to-face meetings with each physician in the General Medicine Practice and explained how to complete and process the forms. We encouraged physicians to discuss advance directives with their elderly and debilitated patients and posted flyers in each practice staffing room suggesting that physicians discuss advance directives with patients who had the target study conditions.
Study Methods
The intent of the randomization scheme was to expose physicians to the same type of reminder or reminders, or no reminders, during all of their scheduled primary care visits with enrolled patients. At the time of this study, 32 weekly half-day sessions took place on the four General Medicine Practice practices. Two sessions attended by study investigators were excluded. We randomly assigned all of the physicians who worked in a particular half-day session to the same reminder category. At the time of randomization, 16 physicians (all of whom were faculty members) practiced in more than 1 session per week (14 practiced in 2 sessions and 2 practiced in 3 sessions). Therefore, we randomly assigned the sessions in a stepped manner by first allocating the 16 physicians and all of their associated sessions to four categories: control (no reminders), computer-generated reminders for instruction directives, computer-generated reminders for proxy directives, and computer-generated reminders for both types of directives. We then randomly assigned the remaining 8 sessions and their physicians to the four categories (Table 1). Each practice contained sessions in all four categories, which were equally distributed between mornings and afternoons. ARTICLE
Effectiveness of Computer-Generated Reminders for Increasing Discussions about Advance Directives and Completion of Advance Directive Forms
A Randomized, Controlled Trial
Advance directives name a surrogate decision maker or provide written instructions with the intent of extending patient autonomy with respect to end-of-life decisions [1-3]. Supported on various grounds by the public [1], physicians [4], ethicists [5], and legislators [6], advance directives have also been promoted as a way to control the high costs of health care at the end of life [7, 8]. Most patients are interested in establishing advance directives, but few actually complete them [1, 9, 10].
Methods
![]()
Top
Methods
Results
Discussion
Author & Article Info
References
Setting and Patients
75 years, the typical threshold for the "oldest old") or because they were 50 years of age or older and had one of the following chronic conditions: cardiac ischemia, heart failure, chronic lung disease, cancer other than nonmelanomatous skin cancer, cerebrovascular disease, renal insufficiency, or cirrhosis. We chose 50 years of age as a cut-off to yield sufficient numbers of patients. A computer program identified eligible patients among those with scheduled appointments at the General Medicine Practice by using problem lists and test results stored in the Regenstrief Medical Record System [34].
|
All physicians routinely received computer-generated reminders for patients with scheduled visits. They were reminded to give preventive care, note abnormal test results, and avoid drug interactions [29, 34]. These reminders appeared at the bottom of computer-generated printed encounter forms [34] (Figure 1). Physicians routinely reviewed the encounter forms and the practice chart immediately before visiting the patient. As recommended by Litzelman and coworkers [37], the advance directive reminders were followed by a choice list (discussed today, next visit, not applicable, patient too ill, patient refuses to discuss, I disagree with advance directives). Instruction directives were called "advance directives," and proxies were called "health care representatives" (Figure 1).
|
After patients were enrolled, research assistants attempted to interview them in the waiting room after each scheduled appointment to assess whether they had discussed advance directives with their physicians that day. Patients who answered "yes" were defined as having had an advance directive discussion. During the first scheduled General Medicine Practice visit in the 5-month period between 11 and 16 months after enrollment, a close-out interview was attempted. If no scheduled visit had occurred by 15 months after enrollment, the close-out interview was attempted by telephone.
Form completion was defined as having occurred if either completed form was received between study enrollment and 30 days after the final interview (this made it possible to receive by mail forms that were completed after the close-out visit). The same advance directive forms were used for all of our inpatient and outpatient services. We included all completed forms regardless of where they were obtained.
Statistical Analysis
We performed all analyses by intention to treat. A two-tailed P value less than 0.05 was considered significant. We used chi-square tests to assess categorical variables and used one-way analysis of variance to assess continuous variables. To account for the expected correlations among an individual physician's patients, we applied generalized estimating equations [38] to logistic regression models that related the outcome variables to the different reminder categories and a preselected list of covariates. These covariates included sociodemographic variables, clinical eligibility conditions, age greater than 75 years, and an interaction term that included age greater than 75 years and eligibility conditions.
We controlled for severity of illness by assigning each patient to 1 of 51 Ambulatory Care Groups (groups of diagnoses) [39]. These groups were generated by using billing codes from the International Classification of Disease, 9th Revision, Clinical Modification [40] recorded during all outpatient visits in the year before study enrollment. Because our study sample consisted of older and sicker adults, patients fell into a limited number of Ambulatory Care Groups. Therefore, two investigators independently collapsed the Ambulatory Care Groups into 6 groups that each contained 8% to 39% of enrolled patients with similar severity of illness; the investigators resolved minor differences between their lists by discussion.
We also controlled for patients' end-of-life treatment preferences, recorded during the enrollment interview, by assigning a score of 1 ("want it"), 1 ("don't want it"), or 0 ("don't know") to the patient's desire for hospitalization, intensive care, resuscitation, surgery, mechanical ventilation, and nutrition and hydration if he or she was terminally ill [36, 41]. Thus, scores could range from 6 to +6 [36]. Because controlling for Ambulatory Care Group and patient sex, ethnicity, and marital status did not affect the results, the analyses presented do not include these variables.
The study period overlapped the start of an academic year, causing primary caregivers to change for some study patients. We constructed models that used all distinct patientphysician pairs as units of analysis. We repeated the analyses using only data associated with the patient's first physician and obtained identical results. Therefore, we report data from all distinct patientphysician pairs.
Results
|
|---|
|
|
|---|
Ten physicians who changed sessions with the arrival of a new academic year also changed study reminder categories. One physician with multiple sessions was in three reminder categories. For our analysis, we excluded the 33 study patients cared for by these 10 physicians after they changed practice sessions. Results were similar and our conclusions did not change when these 33 patients were included. The remaining 1009 study patients represented 1160 unique patientphysician pairs: During the study, 145 patients had 2 different primary care physicians and 3 patients had 3 different primary care physicians (Table 1). Of the 1009 patients in the final analysis sample, 15 changed during the study to practice sessions with study status that differed from their original sessions. Because these patients had not yet completed an advance directive form, we included their new patientphysician pairs as separate observations in our intention-to-treat analysis. We also included 101 patientphysician pairs (9%) in which the patients kept no scheduled visits after enrollment and 94 patientphysician pairs (8%) in which postvisit questionnaires were not completed because patients refused or were missed by the research assistants. Table 1 shows physicians, patients, and visits in the four reminder categories.
Demographic and clinical characteristics of the enrolled patients are shown in Table 2. The mean age was 65 years, two thirds were women, and slightly more than half were African American. Only 3% had discussed advance directives with their physicians before enrollment. Of the various baseline characteristics, being African American, having cardiac ischemia, and having previously thought about advance directives differed significantly among the four study groups. Therefore, these three factors were included in all analyses. Although 17% of the patients were 75 years of age or older, only 5% were eligible solely because of their age.
|
After enrollment, 83% of the study patients were interviewed during at least one scheduled visit to the General Medicine Practice during the study period (mean number of visits ±SD, 2.6 ± 1.7 during 14.4 ± 3.6 months in the study). The number of patients, number of scheduled visits, and length of time in the study did not differ among study groups. Twenty-eight percent of patients were hospitalized during the study.
Although the unit of intervention was the physician, the analysis was performed at the level of the unique patientphysician pairs. We used generalized estimating equations to account for the correlation of patient outcomes within physicians [38]. All patients with no contacts were assumed to have had no advance directive discussions. Patients in all three reminder groups reported more advance directive discussions than did patients in the control group (Table 3). The odds of having advance directive discussions was eight times higher among patients whose physicians received reminders for both types of directives than among patients whose physicians received no reminders. Although we found no significant interaction between the two types of reminders, patients whose physicians received reminders about both types of directives reported significantly more discussions than did patients whose physicians only received reminders for proxy directives. When discussions did occur, they were initiated by the physician in 86% of instances in the group that received reminders for both types of directives, in 77% of instances in the instruction directive reminder group, in 43% of instances in the proxy directive reminder group, and in 38% of instances in the control group.
|
Patients whose physicians received reminders for both types of directives completed substantially more forms than did control patients and patients whose physicians received only proxy directive reminders (Table 3). Patients whose physicians received only reminders for instruction directives also completed more forms than did control patients. Seventy-eight of the 1009 study patients completed at least one of the two types of advance directive forms during the study period: Forty-one patients completed both forms, 34 completed an instruction directive only, and 4 completed a proxy directive only. Four patients whose physicians received both types of reminders returned completed forms within a week after the close-out interview; we included these forms in the analyses.
Multivariable analysis found that receiving both reminders was the strongest predictor of advance directive discussions and receiving only instruction directive reminders was the second strongest. Of all other covariates considered, only age 75 years or greater was significantly correlated with advance directive discussions (odds ratio [OR], 2.3 [95% CI, 1.5 to 3.6]). Similarly, receiving both reminders was the strongest predictor of completing an advance directive form, followed by receiving instruction directive reminders only. The only additional covariates that were significantly associated with form completion were age 75 years or greater (OR, 3.0 [CI, 1.7 to 5.1]), presence of chronic lung disease (OR, 1.7 [CI, 1.1 to 2.7]), and treatment preference scores of 2 or greater at the time of enrollment (OR, 0.4 [CI, 0.3 to 0.8]). Overall, 45% of advance directive discussions were associated with completion of an advance directive form by the patient. When a variable indicating the occurrence of an advance directive discussion was introduced into this analysis, it was highly predictive of subsequent form completion (adjusted OR for discussion, 44 [CI, 25 to 78]).
Discussion
|
|---|
|
|
|---|
The direct effect of our reminders is evidenced by the fact that physicians who received reminders not only had more discussions but initiated them more frequently than did control physicians. Other researchers [1, 44] have shown that although both patients and physicians believe that discussions about advance directives are important, each believes that the other should initiate them. Our reminders broke this impasse and motivated physicians to take the first step; this confirms the suggestion of Miles and colleagues [28] that clinician counseling most effectively catalyzes completion of advance directives.
Our study also produced two secondary findings. First, reminders to discuss proxy directives had small to negligible effects, whereas reminders about instruction directives were routinely effective. Sending both types of reminders was the most effective strategy. Although it is understandable that physicians who receive two sets of reminders would comply more frequently, it is not clear why physicians preferred instruction directives over proxy directives. Perhaps physicians or patients prefer to discuss specific aspects of care or perhaps barriers to completing proxy directives were encountered, such as not knowing the potential proxy's address and telephone number or not having that person's consent to be listed as a proxy. Second, in our sample of elderly and seriously ill outpatients, only advanced age was associated in multivariable analysis with both more discussions about advance directives and completion of forms. This is consistent with other researchers' findings [45-47] that completed advance directives and do-not-resuscitate orders were more prevalent among patients of advanced age. Of note, after we controlled for demographic and clinical data, higher treatment preference score (that is, wanting more care at the end of life) was associated with fewer completed advance directive forms. This finding is consistent with previous work [28] and suggests that advance directives are used predominantly to limit rather than ensure care at the end of life.
One requirement for implementing computer-generated reminders is the presence of a computerized medical record system. The promise of these systems for improving the quality of care while controlling costs [48] is sufficiently great that the Institute of Medicine has considered them an essential technology for health care [49]. Although a computerized medical record system is not necessary for attaching advance directive reminder notices to patient charts, targeting selected patients and avoiding reminders for patients who already have completed forms would be very time intensive and prone to error. This is the type of work computers do best [50]. Perhaps the greatest advantage of electronic medical records for advance directives is that completed forms can be stored so that they are accessible to providers in all inpatient and outpatient venues rather than being buried in outpatient charts or physicians' offices. This fact may have augmented the compliance of our physicians with the advance directive reminders.
The long history of using computer reminders in our practice [29-31] may also have augmented physician compliance. A recently completed negative study of computer-based inpatient preventive care reminders [51] suggests, however, that physicians can and do discriminate between reminders that they do and do not want to follow. This study used a state-of-the-art medical information system with capabilities that are not currently available to most health care providers. However, similar reminder systems are basic components of almost all office clinical information systems currently being marketed [52] and are a major factor supporting the Institute of Medicine's contention that electronic records are essential to medical practice [49]. We believe that systems with reminder capabilities will soon be widely available [50].
We limited our study to outpatients who were at least 75 years of age or were at least 50 years of age and had serious illnesses. The rates of advance directive discussion and form completion would probably be lower among younger, healthier patients. Our study was also conducted in an inner-city practice with many poor and minority patients, which may explain the low rate of advance directive discussions among control patients. Other researchers [43, 53] have found that minority patients have fewer advance directive discussions with their providers than do patients with less education and lower socioeconomic status [28]. Advance directive reminders helped our physicians overcome these barriers. We hope that increasing the number of advance directive discussions between patients and their primary care physicians may reduce the distressing number of end-of-life decisions that are made without patient involvement [54].
Although establishing advance directives does not overcome all of the difficulties involved in making end-of-life decisions [28, 55], advance care planning can generate important, memorable, and therapeutic discussions among patients, providers, and family members [28]. However, many questions remain. Did physician and patient communicate effectively about end-of-life care? Will either the discussion about advance care planning or the completion of an advance directive actually affect patient care? What types of written directives are most useful? Future research needs to show that enhanced communication about advance care planning not only extends the autonomy of the individual patient but also improves patient care at the end of life.
From Indiana University School of Medicine, The Regenstrief Institute for Health Care, and Richard L. Roudebush Veterans Affairs Medical Center, Indianapolis, Indiana; and the School of Public Health, St. Louis University, St. Louis, Missouri.
Dr. Wolinsky: 3663 Lindell Boulevard, St. Louis, MO 63108-3342.
Dr. Gramelspacher: Program in Medical Ethics, Wishard Memorial Hospital (M200), 1001 West 10th Street, Indianapolis, IN 46262.
Mr. Eckert: Division of Biostatistics, RR 135, 699 West Drive, Indianapolis, IN 46202-5119.
Author and Article Information
|
|---|
|
|
|---|
References
|
|---|
|
|
|---|
1. Emanuel LL, Barry MJ, Stoeckle JD, Ettelson LM, Emanuel EJ. Advance directives for medical care-a case for greater use. N Engl J Med. 1991; 324:889-95.
2. President's Commission for the Study of Ethical Problems in Medicine and Biomedical and Behavioral Research. Deciding to Forego Life-Sustaining Treatment: A Report on the Ethical, Medical, and Legal Issues in Treatment Decision. Washington, DC: U.S. Gov Pr Office; 1983. Publication no. 0-425-748.
3. Wenger NS, Oye RK, Bellamy PE, Lynn J, Phillips RS, Desbiens NA, et al. Prior capacity of patients lacking decision making ability early in hospitalization: implications for advance directive administration. The SUPPORT Principal Investigators. Study to Understand Prognoses and Preferences for Out-comes and Risks of Treatment. J Gen Intern Med. 1994; 9:539-43.
4. Hughes DL, Singer PA. Family physicians' attitudes toward advance directives. Can Med Assoc J. 1992; 146:1937-44.
5. Mclntyre KM. Implementation of advance directives. For physicians, a legal dilemma becomes an ethical imperative. Arch Intern Med. 1992; 152:925-9.
6. Omnibus Reconciliation Act of 1990: conference report. Washington, DC: US Gov Pr Office; 1990: section 4206, 4751. Publication no. 101-508.
7. Gillick M. The high costs of dying. A way out. Arch Intern Med., 1994; 154:2134-7.
8. Chambers CV, Diamond JJ, Perkel RL, Lasch LA. Relationship of advance directives to hospital charges in a Medicare population. Arch Intern Med. 1994; 154:541-7.
9. Gamble ER, McDonald PJ, Lichstein PR. Knowledge, attitudes, and behavior of elderly persons regarding living wills. Arch Intern Med. 1991; 151:277-80.
10. Broadwell AW, Boisaubin EV, Dunn JK, Engelhardt HT Jr. Advance directives on hospital admission: a survey of patient attitudes. South Med J. 1993; 86:165-8.
11. Silverman HJ, Tuma P, Schaeffer MH, Sing B. Implementation of the Patient Self-Determination Act in a hospital setting. An initial evaluation. Arch Intern Med. 1995; 155:502-10.
12. Johnston SC, Pfeifer MP, McNutt R. The discussion about advance directives. Patient and physician opinions regarding when and how it should be conducted. End of Life Study Group. Arch Intern Med. 1995; 155:1025-30.
13. Emanuel EJ, Weinberg DS, Gonin R, Hummel LR, Emanuel LL. How well is the Patient Self-Determination Act working?: an early assessment. Am J Med. 1993; 95:619-28.
14. Robinson MK, DeHaven MJ, Koch KA. Effects of the Patient Self-Determination Act on patient knowledge and behavior. J Fam Pract. 1993; 37:363-8.
15. Jacobson JA, White BE, Battin MP, Francis LP, Green DJ, Kasworm ES. Patients' understanding and use of advance directives. West J Med. 1994; 160:232-6.
16. Guidelines for the appropriate use of do-not-resuscitate orders. Council on Ethical and Judicial Affairs, American Medical Association. JAMA. 1991; 265:1868-71.
17. Greco PJ, Schulman KA, Lavizzo-Mourey R, Hansen-Flaschen J. The Patient Self-Determination Act and the future of advance directives. Ann Intern Med. 1991; 115:639-43.
18. Meler DE, Gold G, Mertz K, Taylor B, Cammer-Paris BE, Seckler A, et al. Enhancement of proxy appointment for older persons: physician counselling in the ambulatory setting. J Am Geriatr Soc. 1996; 44:37-43.
19. Rubin SM, Strull WM, Fialkow MF, Weiss SJ, Lo B. Increasing the completion of the durable power of attorney for health care. A randomized, controlled trial. JAMA. 1994; 271:209-12.
20. High DM. Advance directives and the elderly: a study of intervention strategies to increase use. Gerontologist. 1993; 33:342-9.
21. Sachs GA, Stocking CB, Miles SH. Empowerment of the older patient? A randomized, controlled trial to increase discussion and use of advance directives. J Am Geriatr Soc. 1992; 40:269-73.
22. Hare J, Nelson C. Will outpatients complete living wills? A comparison of two interventions. J Gen Intern Med. 1991; 6:41-6.
23. Reilly BM, Wagner M, Magnussen CR, Ross J, Papa L, Ash J. Promoting inpatient directives about life-sustaining treatments in a community hospital: results of a 3-year time series intervention trial. Arch Intern Med. 1995; 155:2317-23.
24. Sulmasy DP, Song KY, Marx ES, Mitchell JM. Strategies to promote the use of advance directives in a residency outpatient practice. J Gen Intern Med. 1996; 11:657-63.
25. Schneiderman LJ, Pearlman RA, Kaplan RM, Anderson JP, Rosenberg EM. Relationship of general advance directive instructions to specific life-sustaining treatment preferences in patients with serious illness. Arch Intern Med. 1992; 152:2114-22.
26. Markson LJ, Fanale J, Steel K, Kern D, Annas G. Implementing advance directives in the primary care setting. Arch Intern Med. 1994; 154:2321-7.
27. Meier DE, Fuss BR, O'Rourke D, Baskin SA, Lewis M, Morrison RS. Marked improvement in recognition and completion of health care proxies. A randomized controlled trial of counseling by hospital patient representatives. Arch Intern Med. 1996; 156:1227-32.
28. Miles SH, Koepp R, Weber EP. Advance end-of-life treatment planning. A research review. Arch Intern Med. 1996; 156:1062-8.
29. McDonald CJ, Hui SL, Smith DM, Tierney WM, Cohen SJ, Weinberger M, et al. Reminders to physicians from an introspective computer medical record. A two-year randomized trial. Ann Intern Med. 1984; 100:130-8.
30. Tierney WM, Hui SL, McDonald CJ. Delayed feedback of physician performance vs immediate reminders to perform preventive care. Effects on physician compliance. Med Care. 1986; 24:659-66.
31. Tierney WM, Miller ME, Hui SL, McDonald CJ. Practice randomization and clinical research. The Indiana experience. Med Care. 1991; 29:JS57-64.
32. Shea S, DuMouchel W, Bahamonde L. A meta-analysis of 16 randomized controlled trials to evaluate computer-based clinical reminder systems for preventive care in the ambulatory setting. J Am Med Inform Assoc. 1996; 3:399-409.
33. Tierney WM, Miller ME, McDonald CJ. The effect on test ordering of informing physicians of the charges for outpatient diagnostic tests. N Engl J Med. 1990; 322:1499-504.
34. McDonald CJ, Tierney WM, Overhage JM, Martin DK, Wilson GA. The Regenstrief Medical Record System: 20 years of experience in hospitals, clinics, and neighborhood health centers. MD Comput. 1992; 9:206-17.
35. Pfeiffer E. A short portable mental status questionnaire for the assessment of organic brain deficit in elderly patients. J Am Geriat Soc. 1975; 23:433-41.
36. Danis M, Southerland LI, Garrett JM, Smith JL, Hielema F, Pickard CG, et al. A prospective study of advance directives for life-sustaining care. N Engl J Med. 1991; 324:882-8.
37. Litzelman DK, Dittus RS, Miller ME, Tierney WM. Requiring physicians to respond to computerized reminders improves their compliance with preventive care protocols. J Gen Intern Med. 1993; 8:311-7.
38. Liang KY, Zeger SL. Longitudinal data analysis using generalized estimating equations. Biometrika. 1988; 73:13-22.
39. Weiner JP, Starfield BH, Steinwachs DM, Mumford LM. Development and application of a population-oriented measure of ambulatory care case-mix. Med Care. 1991; 29:452-72.
40. International Classification of Disease, 9th Revision; Clinical Modification. Washington, DC: Dept of Health and Human Services; 1980.
41. Gramelspacher GP, Zhou XH, Hanna MP, Tierney WM. Preferences of physicians and their patients for end-of-life care. J Gen Intern Med. 1997; 12:346-51.
42. Hofmann JC, Wenger NS, Davis RB, Teno J, Connors AF Jr, Desbiens N, et al. Patient preferences for communication with physicians about end-of-life decisions. SUPPORT Investigators. Study to Understand Prognoses and Preferences for Outcomes and Risks of Treatment. Ann Intern Med. 1997; 127:1-12.
43. A controlled trial to improve care for seriously ill hospitalized patients. The study to understand prognoses and preferences for outcomes and risks of treatments (SUPPORT). The SUPPORT Principal Investigators. JAMA. 1995; 274:1591-8.
44. Lurie N, Pheley AM, Miles SH, Bannick-Mohrland S. Attitudes toward discussing life-sustaining treatments in extended care facility patients. J Am Geriatr Soc. 1992; 40:1205-8.
45. Duffield P, Podzamsky JE. The completion of advance directives in primary care. J Fam Pract. 1996; 42:378-84.
46. Boyd K, Teres D, Rapoport J, Lemeshow S. The relationship between age and the use of DNR orders in critical care patients. Evidence for age discrimination. Arch Intern Med. 1996; 156:1821-6.
47. Hakim RB, Teno JM, Harrell FE Jr, Knaus WA, Wenger N, Phillips RS, et al. Factors associated with do-not-resuscitate orders: patients' preferences, prognoses, and physicians' judgments. SUPPORT Investigators. Study to Understand Prognoses and Preferences for Outcomes and Risks of Treatment. Ann Intern Med. 1996; 125:284-93.
48. Metzger JB. The potential contributions of patient care information systems. In: Drazen EL, Metzger JB, Ritter JL, Schneider MK, eds. Patient Care Information Systems: Successful Design and Implementation. New York: Springer-Verlag; 1995:1-30.
49. Dick AS, Steen EB, eds. The Computer-Based Patient Record: An Essential Technology for Health Care. Washington, DC: National Academy Pr; 1991.
50. McDonald CJ, Tierney WM. Computer-stored medical records. Their future role in medical practice. JAMA. 1988; 259:3433-40.
51. Overhage JM, Tierney WM, McDonald CJ. Computer reminders to implement preventive care guidelines for hospitalized patients. Arch Intern Med. 1996; 156:1551-6.
52. Medical hardware and software buyers' guide. MD Comput. 1996; 13:485-576.
53. Haas JS, Weissman JS, Cleary PD, Goldberg J, Gatsonis C, Seage GR 3d, et al. Discussion of preferences for life-sustaining care by persons with AIDS. Predictors of failure in patientphysician communication. Arch Intern Med. 1993; 153:1241-8.
54. Pijnenborg L, van der Maas PJ, Kardaun JW, Glerum JJ, van Delden JJ, Looman CW. Withdrawal or withholding of treatment at the end of life. Results of a nationwide study. Arch Intern Med. 1995; 155:286-92.
55. McIntyre KM. Shepherding the patient's right to self-determination: the physician's dawning role. Arch Intern Med. 1992; 152:259-61.
This article has been cited by other articles:
![]() |
J. L. Schnipper, J. A. Linder, M. B. Palchuk, J. S. Einbinder, Q. Li, A. Postilnik, and B. Middleton "Smart Forms" in an Electronic Medical Record: Documentation-based Clinical Decision Support to Improve Disease Management J. Am. Med. Inform. Assoc., July 1, 2008; 15(4): 513 - 523. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. G. Fiks, R. W. Grundmeier, L. M. Biggs, A. R. Localio, and E. A. Alessandrini Impact of Clinical Alerts Within an Electronic Health Record on Routine Childhood Immunization in an Urban Pediatric Population Pediatrics, October 1, 2007; 120(4): 707 - 714. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. A. Jezewski, M. A. Meeker, L. Sessanna, and D. S. Finnell The Effectiveness of Interventions to Increase Advance Directive Completion Rates J Aging Health, June 1, 2007; 19(3): 519 - 536. [Abstract] [PDF] |
||||
![]() |
T. C. Bailey, L. A. Noirot, A. Blickensderfer, E. Rachmiel, R. Schaiff, A. Kessels, A. Braverman, A. Goldberg, B. Waterman, and W. C. Dunagan An Intervention to Improve Secondary Prevention of Coronary Heart Disease Arch Intern Med, March 26, 2007; 167(6): 586 - 590. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Chaudhry, J. Wang, S. Wu, M. Maglione, W. Mojica, E. Roth, S. C. Morton, and P. G. Shekelle Systematic Review: Impact of Health Information Technology on Quality, Efficiency, and Costs of Medical Care Ann Intern Med, May 16, 2006; 144(10): 742 - 752. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. T. Rosenbloom, K.-W. Chiu, D. W. Byrne, D. A. Talbert, E. G. Neilson, and R. A. Miller Interventions to Regulate Ordering of Serum Magnesium Levels: Report of an Unintended Consequence of Decision Support J. Am. Med. Inform. Assoc., September 1, 2005; 12(5): 546 - 553. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. Casarett, J. Karlawish, K. Morales, R. Crowley, T. Mirsch, and D. A. Asch Improving the Use of Hospice Services in Nursing Homes: A Randomized Controlled Trial JAMA, July 13, 2005; 294(2): 211 - 217. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. T. Rosenbloom, A. J. Geissbuhler, W. D. Dupont, D. A. Giuse, D. A. Talbert, W. M. Tierney, W. D. Plummer, W. W. Stead, and R. A. Miller Effect of CPOE User Interface Design on User-Initiated Access to Educational and Patient Information during Clinical Care J. Am. Med. Inform. Assoc., July 1, 2005; 12(4): 458 - 473. [Abstract] [Full Text] [PDF] |
||||
![]() |
M Weiner, T E Stump, C M Callahan, J N Lewis, and C J McDonald Pursuing integration of performance measures into electronic medical records: beta-adrenergic receptor antagonist medications Qual. Saf. Health Care, April 1, 2005; 14(2): 99 - 106. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. A. Pearlman, H. Starks, K. C. Cain, and W. G. Cole Improvements in Advance Care Planning in the Veterans Affairs System: Results of a Multifaceted Intervention Arch Intern Med, March 28, 2005; 165(6): 667 - 674. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. X. Garg, N. K. J. Adhikari, H. McDonald, M. P. Rosas-Arellano, P. J. Devereaux, J. Beyene, J. Sam, and R. B. Haynes Effects of Computerized Clinical Decision Support Systems on Practitioner Performance and Patient Outcomes: A Systematic Review JAMA, March 9, 2005; 293(10): 1223 - 1238. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. A. Meeker and M. A. Jezewski A Voice for the Dying Clin Nurs Res, November 1, 2004; 13(4): 326 - 342. [Abstract] [PDF] |
||||
![]() |
D. Aronsky, E. Kasworm, J. A. Jacobson, P. J. Haug, and N. C. Dean Electronic Screening of Dictated Reports to Identify Patients with Do-Not-Resuscitate Status J. Am. Med. Inform. Assoc., September 1, 2004; 11(5): 403 - 409. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Wallace and N. A. Desbiens Evaluation of a labeling system to indicate the presence of an advance directive in a hospital medical record Int. J. Qual. Health Care, August 1, 2004; 16(4): 333 - 335. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. Feudtner Perspectives on Quality at the End of Life Arch Pediatr Adolesc Med, May 1, 2004; 158(5): 415 - 418. [Full Text] [PDF] |
||||
![]() |
M. A. Meeker Family Surrogate Decision Making at the End of Life: Seeing them Through with Care and Respect Qual Health Res, February 1, 2004; 14(2): 204 - 225. [Abstract] [PDF] |
||||
![]() |
T. M. Damush, D. M. Smith, A. J. Perkins, P. R. Dexter, and F. Smith Risk Factors for Nonelective Hospitalization in Frail and Older Adult, Inner-City Outpatients Gerontologist, February 1, 2004; 44(1): 68 - 75. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. M. Damush, M. Weinberger, S. M. Perkins, J. K. Rao, W. M. Tierney, R. Qi, and D. O. Clark The Long-term Effects of a Self-management Program for Inner-city Primary Care Patients With Acute Low Back Pain Arch Intern Med, November 24, 2003; 163(21): 2632 - 2638. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Weiner, C. M. Callahan, W. M. Tierney, J M. Overhage, B. Mamlin, P. R. Dexter, and C. J. McDonald Using Information Technology To Improve the Health Care of Older Adults Ann Intern Med, September 2, 2003; 139(5_Part_2): 430 - 436. [Abstract] [Full Text] [PDF] |
||||
![]() |
Y Masuda, M D Fetters, A Hattori, N Mogi, M Naito, A Iguchi, and K Uemura Physicians's reports on the impact of living wills at the end of life in Japan J. Med. Ethics, August 1, 2003; 29(4): 248 - 252. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Ansari, M. G. Shlipak, P. A. Heidenreich, D. Van Ostaeyen, E. C. Pohl, W. S. Browner, and B. M. Massie Improving Guideline Adherence: A Randomized Trial Evaluating Strategies to Increase {beta}-Blocker Use in Heart Failure Circulation, June 10, 2003; 107(22): 2799 - 2804. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. O. Boekeloo, M. P. Bobbin, W. I. Lee, K. D. Worrell, E. K. Hamburger, and E. Russek-Cohen Effect of Patient Priming and Primary Care Provider Prompting on Adolescent-Provider Communication About Alcohol Arch Pediatr Adolesc Med, May 1, 2003; 157(5): 433 - 439. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. E. Hahn Advance Directives and Patient-Physician Communication JAMA, January 1, 2003; 289(1): 96 - 96. [Full Text] [PDF] |
||||