 |
 |
|
Home |
Current Issue |
Past Issues |
In the Clinic |
ACP Journal Club |
CME |
Collections |
Audio/Video |
Mobile |
Subscribe |
Tools |
Help |
ACP Online
|
| ||||||||||||||||||||||||||||||||||||||||||||||
18 July 2006 | Volume 145 Issue 2 | Pages 107-116
Background: Although disease management programs are widely implemented, little is known about their effectiveness.
Objective: To determine whether disease management by physician groups is associated with diabetes care processes, control of intermediate outcomes, or the amount of medication used when intermediate outcomes are above target levels.
Design: Cross-sectional study.
Setting: Patients were randomly sampled from 63 physician groups nested in 7 health plans sponsored by Translating Research into Action for Diabetes (87%) and from 4 health plans with individual physician contracts (13%).
Patients: 8661 adults with diabetes who completed a survey (2000–2001) and had medical record data.
Measurements: Physician group and health plan directors described their organizations' use of physician reminders, performance feedback, and structured care management on a survey; their responses were used to determine measures of intensity of disease management. The current study measured 8 processes of care, including most recent hemoglobin A1c level, systolic blood pressure, serum low-density lipoprotein cholesterol level, and several measures of medication use.
Results: Increased use of any of 3 disease management strategies was significantly associated with higher adjusted rates of retinal screening, nephropathy screening, foot examinations, and measurement of hemoglobin A1c levels. Serum lipid level testing and influenza vaccine administration were associated with greater use of structured care management and performance feedback. Greater use of performance feedback correlated with an increased rate of foot examinations (difference, 5 percentage points [95% CI, 1 to 8 percentage points]), and greater use of physician reminders was associated with an increased rate of nephropathy screening (difference, 15 percentage points [CI, 6 to 23 percentage points]). No strategies were associated with intermediate outcome levels or level of medication management.
Limitations: Physician groups were not randomly sampled from population-based listings, and disease management strategies were not randomly allocated across groups.
Conclusions: Disease management strategies were associated with better processes of diabetes care but not with improved intermediate outcomes or level of medication management. A greater focus on direct measurement, feedback, and reporting of intermediate outcome levels or of level of medication management may enhance the effectiveness of these programs.
*See Appendix 1 for a complete list of the TRIAD Study Group.
Contribution
Implications
—The Editors
Persons with diabetes continue to receive suboptimal care (1–6). To improve quality, many health systems have implemented disease management programs for diabetes and other chronic conditions (7–9). These programs typically incorporate population-based strategies, such as disease registries, clinical guidelines, performance feedback, physician reminders, self-management support for patients, and targeted case management for high-risk patients (10).
Evidence for the effectiveness of disease management comes primarily from small efficacy trials (10–20). Such studies consistently found improved processes of diabetes care; however, improvements in outcomes (such as control of cardiovascular disease risk factors) were less consistent (12, 17, 18, 20–22). Furthermore, most studies evaluated only 1 or 2 strategies (instead of multicomponent programs) in selected clinical settings. It is unclear how well findings from these smaller studies apply to entire patient populations.
Many components of disease management focus on improving processes of care. Early performance measurement projects, such as the Health Plan Employer Data Information System (23) and the Diabetes Quality Improvement Program (5), emphasized the importance of such processes as annual retinal screening or hemoglobin A1c determination. Particularly for health plans, process measures are more readily available than are outcomes data. However, if disease management is to improve patient outcomes, it must also improve intermediate outcomes, such as hemoglobin A1c levels, systolic blood pressure, and serum low-density lipoprotein (LDL) cholesterol levels.
Translating Research into Action for Diabetes (TRIAD) (24) is a multicenter study of diabetes care in managed care. The TRIAD study's central hypothesis is that health care systems features can affect quality of care. Here, we examine how 3 disease management strategies vary in intensity across physician groups and whether physician groups with more intensive disease management have higher quality of diabetes care. We assess quality by processes of care, by levels of intermediate outcomes, and by current clinical management of these outcomes.
The TRIAD study's sampling frame, methods, key hypotheses, and power calculations are detailed elsewhere (24). The study comprised 6 collaborating translational research centers that were partnered with 10 managed care health plans in 7 states. Of the 10 plans, 7 contracted with 1 to 26 physician groups (total, 68 groups), whereas 4 plans directly contracted with individual physicians.
A standard algorithm was applied to automated pharmacy, laboratory utilization, and inpatient and outpatient diagnostic data (25) to identify all community-dwelling patients with diabetes who were 18 years of age and older and who had been continuously enrolled in the TRIAD health plan for at least 18 months. The study cohort was randomly sampled from this population.
Sampled patients were recruited between July 2000 and October 2001 by using computer-assisted telephone interviews or written surveys that were conducted in English or Spanish. Eligibility was confirmed if patients verified that they had had diabetes for at least 12 months and had received most of their diabetes care through the TRIAD health plan. Permission was sought from all respondents to request copies of their outpatient medical records for the previous 18 months.
All health plan and physician group directors received mailed surveys (Appendix Figure) during the same interval. Face-to-face or telephone interviews were used to complete and clarify responses. Each director was offered $100 for completing the survey.
The TRIAD study was reviewed and approved by the institutional review boards of each research center and by the Centers for Disease Control and Prevention (CDC). Informed consent was obtained from all survey respondents.
Data Sources
Patient surveys included questions on health status, diabetes duration, current diabetes treatment, and demographic characteristics. Of 13 086 contacted and eligible persons, 11 927 (91%) completed the survey (56.6% by computer-assisted telephone interview and 43.4% by written survey) (Figure). We were unable to contact many individuals. Using a practice that is endorsed by the Council of American Survey Research Organizations (26), we assumed that persons whom we could not contact or for whom we could not confirm eligibility had the same eligibility rate as those contacted. Under that assumption, the response rate was 69%. IMPROVING PATIENT CARE
Improving Patient Care is a special section within Annals supported in part by the U.S. Department of Health and Human Services (HHS) Agency for Healthcare Research and Quality (AHRQ). The opinions expressed in this article are those of the authors and do not represent the position or endorsement of AHRQ or HHS.
The Association between Quality of Care and the Intensity of Diabetes Disease Management Programs
Editors' Notes
Top
Editors' Notes
Methods
Results
Discussion
Author & Article Info
References
Context
Methods
Top
Editors' Notes
Methods
Results
Discussion
Author & Article Info
References
Overview of the TRIAD Study and Sample
|
Of 11 927 patients who completed a survey, 8661 (73%) consented to medical record review and subsequently had charts available for review. Centrally trained reviewers used standardized data collection software to abstract process measures, most recent levels of hemoglobin A1c, upper limits of normal for hemoglobin A1c measurements that were recorded, serum LDL cholesterol levels, systolic blood pressure, current medications, and comorbid conditions. Interrater reliability (
) for the main quality measures ranged from 0.86 to 0.94.
All 10 health plan directors and 52 of 68 physician group directors completed surveys. Surveys assessed organizational age, size, structure, profit status, insurance products, contracting arrangements, history of involvement with managed care, and detailed information on the organization's use of diabetes disease management strategies. Of the physician groups that did not respond (443 participants), 11 existed solely for the purpose of contracting with plans and had no diabetes disease management. These physician groups were assumed to have no care management strategies and were included in the analyses, as were patient groups (1150 participants) from the 4 health plans that contracted directly with physicians. The remaining 5 groups (159 participants) did not respond and were excluded from analyses (Figure). Consequently, the resulting sample included a total of 8661 survey respondents with charts available for review and data from 63 physician groups and 4 additional health plans (Figure). Mean duration of diabetes, body mass index, and health status did not meaningfully differ between persons whose medical records and physician group variables were available to the study team and those whose records were unavailable.
Predictors, End Points, and Covariates
The primary predictors were 3 measures of the intensity of disease management strategies: physician reminders, performance feedback, and structured care. These were calculated for physician groups and health plans from multiple survey items. A detailed description of the methods used to calculate composite intensity scores is provided in Appendix 2. Selected item-level responses for physician groups in the most intense versus least intense tercile of each strategy are displayed in Table 1.
|
The physician reminders intensity score was derived from 2 questions, which detailed the types and content of the reminders physicians received. Groups whose use of reminders represented the upper tercile of intensity were found to have reminded physicians about 4 care processes on average. Most groups in the upper tercile delivered reminders electronically at the point of care.
Performance feedback intensity was obtained by tallying responses to a checklist of possible diabetes process and outcome feedback items. A total of 86% and 82% of groups in the upper tercile included levels of hemoglobin A1c and serum LDL cholesterol, respectively, in feedback to physicians (Table 1). Physician feedback focused on many of the same elements of care as reminders.
The use of formal case management, diabetes guidelines, patient reminders, and diabetes education correlated highly in physician groups (Pearson correlation coefficients ranged from 0.63 to 0.88); therefore, we could not look at these approaches independently. Consequently, we combined the 4 approaches into a single composite score for "structured diabetes care management." Use of formal case management was assessed by the proportion of patients with diabetes who were enrolled, the number of case managers per 10 000 patients, the extent to which the program targeted high-risk patients, and a checklist of case management activities. The clinical guidelines were scored to reflect the extent of implementation. The highest score was assigned to physician groups that incorporated guidelines into automated physician or patient reminders. Patient reminder intensity incorporated the number, type, and frequency of reminders sent. On average, physician groups in the upper tercile had diabetes education as a covered benefit, whereas those in the lowest tercile generally did not have these programs.
Because of the differing numbers of questions and wide range of possible values within each intensity score, each question was z-transformed to a mean of 0.0 and standard deviation near or equal to 1.0 to facilitate comparison. Scores for each of the care management composites were computed as the mean of its z-transformed responses. A combined measure of disease management intensity was constructed for each plan and group by adding the 3 composite scores together. The distribution of z-transformed composite scores for the 67 groups is shown in Appendix Table 1.
|
Study end points included the following 8 processes of care: levels of hemoglobin A1c, serum lipids, and urine albumin; dilated retinal and foot examinations; recommendations for aspirin therapy and influenza vaccine; and counseling for smokers to encourage them to quit (n = 1264). The prevalence of the first 3 indicators was obtained exclusively from chart review; we used evidence from either the medical record or the patient survey to determine which of the remaining 5 measures had been performed. Each quality measure was the percentage of patients who received the process during the 12 months preceding the patient survey.
The second set of end points included the most recently recorded hemoglobin A1c, serum LDL cholesterol, and systolic blood pressure values in the previous 12 months. These intermediate outcomes were analyzed as continuous and binary variables (hemoglobin A1c level <8.0%, systolic blood pressure <140 mm Hg, and serum LDL cholesterol level <3.35 mmol/L [<130 mg/dL]).
We defined a third set of end points to reflect medical management of the 3 intermediate outcomes (Table 2). For each intermediate outcome, physician groups were assessed by the proportion of their patients with the condition who were at or below target levels or above target levels and currently receiving more medications (reflecting greater effort to manage the outcome) (27). Number of medications was dichotomized as use of 2 or more oral agents or insulin for diabetes; 1 or more lipid-lowering agents for hypercholesterolemia; and 2 or more antihypertensive agents for hypertension.
|
We used the patient survey to obtain the following model covariates: age, sex, ethnicity, education, income, health status from the Short Form-12 mental and physical component scores (28), duration of diabetes, and a 4-level treatment variable (diet-controlled, oral agents alone, oral agents and insulin, or insulin alone). The following 2 additional covariates, which described comorbid conditions and current therapies, were obtained from the medical record: the Charlson index (29, 30) and an additional measure of cardiovascular comorbidity that indicated presence of previous myocardial infarction, stroke, or coronary or carotid artery revascularization. All models were adjusted for intensity of care management and clustering at the health plan level.
Statistical Analysis
Both multiple imputation and modeling were performed with SAS statistical software, version 9.1.3 (SAS Institute Inc., Cary, North Carolina). Initial analyses examined distributions for predictors, outcomes, and covariates across physician groups. Fewer than 1% of patients had missing data for any key process-of-care variables. Hemoglobin A1c, serum LDL cholesterol, and systolic blood pressure values were unavailable for 9%, 24%, and 5% of patients, respectively; these patients were excluded only from analyses of the missing end point. Short Form-12 scores and income were missing for approximately 11% of participants; values for all other covariates were missing in fewer than 5% of participants. Missing values for covariates (but not predictors or end points) were imputed 5 times. Each covariate was predicted as a function of all other covariates by using a Markov chain Monte Carlo multiple imputation algorithm (SAS PROC MI and PROC MIANALYZE functions).
Separate models assessed associations between each of the 3 disease management intensity scores and the combined intensity score with each process indicator, intermediate outcome level, and medication use variable. Because of the clustering of participants within physician groups and plans, hierarchical mixed-effects models were used to account for intraplan and physician group correlation. We used the SAS GLIMMIX procedure with penalized quasi-likelihood estimation for dichotomous outcomes and the SAS PROC MIXED procedure with restricted maximum likelihood estimates for continuous outcomes.
Our results are presented as model-based predicted probabilities of receiving each process of care in physician groups in the highest versus lowest tercile of intensity for each of the 3 disease management strategies. We used terciles of the distribution of disease management intensity to estimate interpretable differences in performance across the intensity distribution. In models predicting intermediate outcome levels and proportion of patients with controlled disease or receiving more medications, we did not adjust for diabetes treatment and health status because these 2 variables could mediate associations of disease management intensity with these outcomes.
We serially removed each of the health plans from the models, and we removed 1150 participants who did not receive care from physician groups to examine whether observed differences in processes of care were unduly affected by data from a single plan or from assigning a value of 0 to management indicators for physician group care, respectively. In separate sensitivity analyses, we examined whether our findings would be altered if we controlled for all 3 care strategies simultaneously or if we used cut-points for intermediate outcome control that were more stringent (hemoglobin A1c level <7.0%; serum LDL cholesterol level <2.60 mmol/L [<100 mg/dL], and systolic blood pressure <130 mm Hg) or less stringent (hemoglobin A1c level, 9.5%; serum LDL cholesterol level, 4.15 mmol/L [160 mg/dL]; and systolic blood pressure, 160 mm Hg). We also adjusted all hemoglobin A1c analyses by the upper limit of normal for the assay used. None of these sensitivity analyses substantially changed the results (data not shown).
Role of the Funding Sources
The study was funded by the CDC and the National Institute of Diabetes and Digestive and Kidney Diseases. The study was designed and governed by a 7-member steering committee; the CDC has 1 representative on this committee. Analysts from the CDC provided us with statistical assistance, reviewed the manuscript, and provided feedback to us.
Results
|
|---|
|
TopEditors' NotesMethodsResultsDiscussionAuthor & Article InfoReferences |
|---|
Sample characteristics across physician groups are presented in Table 3. Nearly every characteristic varied greatly across physician groups, particularly age, sex, ethnicity, and prevalence of cardiovascular disease. Intensity of disease management strategies also varied substantially across physician groups (Table 1).
|
Rates for diabetes process of care were high but varied across physician groups (Table 4). Median levels of the 3 intermediate outcomes indicated that more than 50% of patients were above American Diabetes Association guideline target levels for each intermediate outcome (31).
|
Association of Disease Management Strategies with Processes of Care
As measured by the 8 process indicators, intensity of disease management was strongly associated with quality (Table 5). Of 24 adjusted associations (3 disease management strategies by 8 processes of care), 17 associations significantly favored physician groups with increased disease management intensity. Adjusted differences in predicted probabilities between upper and lower terciles ranged from 5% to 15%. Greater intensity of structured care management was associated with significantly higher levels for 6 of 8 processes, with differences ranging from 7% to 11%. More intense physician performance feedback was also associated with higher rates for 6 of 8 process indicators, with significant differences of 5% to 10%. Increased intensity of physician reminders was associated with higher rates for 5 of 8 process measures, with differences ranging from 8% to 15%. The combined intensity measure was also significantly related to 6 of the 8 processes of care. No strategy was significantly associated with rates of providing advice to stop smoking (among smokers).
|
Association of Disease Management Strategies with Intermediate Outcomes
Greater intensity of structured care management was associated with adjusted systolic blood pressure levels that were 3 mm Hg (95% CI, 1 to 5 mm Hg) higher than those for lower intensity groups. The only other significant association was between greater intensity of physician reminders and slightly lower levels of serum LDL cholesterol (0.05 mmol/L [2 mg/dL]). Otherwise, disease management intensity and levels of the 3 intermediate outcomes were not associated (Table 5). Models predicting dichotomized outcomes (that is, below target levels) confirmed the lack of association of the 3 strategies or the combined measure with intermediate outcome control (data not shown).
Association of Disease Management Strategies with Medication Management of Intermediate Outcomes
For the end points of medication management, only 1 of the 12 associations showed a significant difference in the expected direction. Greater use of physician reminders was associated with a 7% (CI, 1% to 13%) increase in number of patients who had serum LDL cholesterol levels at target or who were using a cholesterol-lowering medication. Paradoxically, the only other significant finding suggested that persons in physician groups with the most intense, structured diabetes care management were 4% less likely to have a well-controlled hemoglobin A1c level or to be receiving 2 or more medications or insulin (Table 5; Appendix Table 2).
|
Discussion
|
|---|
|
TopEditors' NotesMethodsResultsDiscussionAuthor & Article InfoReferences |
|---|
Our findings indicate strong associations between the intensity of the 3 disease management strategies and better care processes. These were noted despite relatively high process scores among all physician groups (32). The magnitude of observed differences was moderate (generally ranging from 5% to 15%) but similar to differences achieved in efficacy trials of individual disease management interventions (12, 16). However, none of these disease management programs seemed to affect intermediate outcomes in a clinically meaningful way, and they were not associated with apparent differences in the amount of medications used to control these outcomes.
Our findings are consistent with previous reports. Keating and colleagues (33) studied diabetic patients in 1 market by using a summary quality score that included 4 processes and 2 measures of intermediate outcome control. Across 135 physician practices, they found that practice accounted for only a small proportion of variation in quality. Nonsignificant trends toward higher quality were found for practices that received diabetes performance report cards and those that routinely enrolled patients in disease management programs. Fleming and colleagues (34) found that practices that used multiple care management approaches were often in the upper quartile of the distribution in a similar quality composite score. In both of these reports, the quality scores were dominated by process measures, and the influence of diabetes care management on processes versus control of intermediate outcomes cannot be separated. The latter report also indicated that the relative influence of distinct care management practices, such as the use of reminders versus performance feedback at the health plan level, cannot be directly compared (34).
In our analysis, we must carefully consider the absence of positive associations between disease management and intermediate outcome levels or responsive adjustments to treatment regimens. Accreditation organizations gave early emphasis to simple process-of-care measures that were easy to assess with administrative data (for example, whether a hemoglobin A1c test was done). Such approaches ignored intermediate outcome levels and their clinical treatments (for example, whether there was management change in response to a high hemoglobin A1c level). Disease management programs developed in response to accreditation undoubtedly focused more heavily on improving processes than outcomes of care. Our findings support the need for refinements in disease management that shift the focus toward direct measurement and feedback of intermediate outcomes and toward measurement of clinical processes of care that are more directly associated with improved outcomes (35, 36).
Improving intermediate outcomes is more challenging than altering simple care processes. Process improvement can be more readily applied to entire populations with diabetes; however, intermediate outcome control requires identification of patients with elevated levels, targeted interventions, and support of self-management. In addition, control of intermediate outcomes requires the active participation of primary care physicians who may yet lack sufficient knowledge, decision support, or time to appropriately support patients in achieving control (37).
Health plans also apply disease management strategies. Because there were only 10 TRIAD health plans, we cannot say whether use of these strategies at the health plan level would be associated with the same pattern of findings reported here at the physician group level.
Several additional limitations of this study deserve mention. Because these cross-sectional analyses were conducted after generally 3 or fewer years of disease management, it may be too early to detect effects on intermediate outcome levels. Our analytical sample included only 63 physician groups that were not randomly selected from a larger, population-based listing. Furthermore, disease management strategies were not randomly allocated across groups. A larger physician group sample could have increased sensitivity to modest associations by increasing the statistical power as well as increasing the variability in disease management intensity. We used "more medication" as a surrogate for more aggressive care, but our cross-sectional analyses could not be used to determine whether providers changed therapy in response to suboptimal control of an intermediate outcome. Because some patients did not provide consent, medical records could not be obtained for approximately 30% of the entire TRIAD sample. However, survey data indicated that patients with missing medical records were quite similar to the other participants in terms of demographic characteristics, duration of diabetes, and self-reported health status.
The TRIAD study suggests that the disease management programs implemented in these physician groups were associated with higher levels of care processes, but they did not seem to influence the intermediate outcomes that affect risk for complications or the medical management of these outcomes. As disease management programs give greater attention to improving intermediate outcomes and as process measures become more clinically relevant, these programs may be more likely to meet their long-term goal of improved health.
Appendix 1: Translating Research into Action for Diabetes (TRIAD) Study Group
|
|---|
Indiana University Translational Research Center: Principal Investigator: David G. Marrero, PhD. Co-Principal Investigator: Ronald T. Ackermann, MD, MPH. Co-Investigators: Matthew J. Bair, MD, MS; Ed Brizendine, MS; Aaron E. Carroll, MD; Gilbert C. Liu, MD, MS; Paris Roach, MD; Changyu Shen, PhD; Morris Weinberger, PhD; Madelyn L. Wheeler, MS, RD, CD, FADA, CDE. Project Coordinator: Susanna R. Williams, MSPH.
Kaiser Foundation Research Institute: Principal Investigator and Study Chairman: Joe V. Selby, MD, MPH. Co-Principal Investigator: Andrew J. Karter, PhD. Co-Investigators: Assiamira Ferrara, MD, PhD; Julie Schmittdiel, PhD. Senior Analyst: Connie Uratsu. Project Director: Bix E. Swain, MS.
University of California, Los Angeles: Principal Investigator: Carol M. Mangione, MD, MSPH. Co-Principal Investigator: Arleen F. Brown, MD, PhD. Co-Investigators: O. Kenrik Duru, MD; Susan Ettner, PhD; Shaista Malik, MD, PhD; Martin F. Shapiro, MD, PhD. Senior Analyst: Neil Steers, PhD. Project Director: Chester Brown Jr., MHA. Senior Administrator: Carole Nagy, BA.
University of Medicine and Dentistry of New Jersey: Principal Investigator: Norman Lasser, MD, PhD. Co-Principal Investigator: Stephen H. Schneider, MD. Co-Investigator and Project Director: Dorothy A. Caputo, MA, APRN, BC-ADM, CDE. Co-Investigators: Jesse C. Crosson, PhD; Stephen Crystal, PhD; David S. Kountz, MD; Shou-En Lu, PhD; Monika M. Safford, MD; Weichung (Joe) Shih, PhD; Leslie-Faith Morritt Taub, DNSc, ANP-C, GNP-BC.
Central Activities Coordinating Center: TRIAD Central Program Specialist: Gabrielle J. Davis, BS, CHES. Central Program Assistant: Lucyna Lis, MA. Program Coordinator: Sonja Ross, BS, MHS.
University of Michigan Health System: Principal Investigator: William H. Herman, MD, MPH. Co-Investigators: Catherine Kim, MD, MPH; Michele Heisler, MD; Susan Johnson, MD; Kingsley Onyemere, MD. Research Associates: Ray Burke, MA; Laura McEwen, PhD, MPH; Bahman Tabaei, MPH. Project Director: Jennifer Goewey, MHA.
Department of Veterans Affairs: Principal Investigator: Eve A. Kerr, MD, MPH. Co-Principal Investigator: Rodney A. Hayward, MD. Co-Investigators: Sarah Krein, PhD; John Piette, PhD. Project Managers: Mary Hogan, PhD, RN; Fatima Makki, MPH, MSW. Data Manager: Jennifer Davis, MPH.
National Institute of Diabetes and Digestive and Kidney Diseases: Co-Investigator: Sanford A. Garfield, PhD.
Centers for Disease Control and Prevention: Lead Consultant: K.M. Venkat Narayan, MD, MSc, MBA, MRCP. Collaborating Investigators: Gloria Beckles, MD, MSc; Patrick Boyle, PhD; Michael Engelgau, MD, MS; Tiffany Gary, PhD; Linda Geiss, MS; Robert Gerzoff, MS; Edward W. Gregg, PhD; Betsy L. (Cadwell) Gunnels; Roberta H. Hilsdon, BBA, AAS; Henry Kahn, MD, FACP; Jinan Saaddine, MD; Mark Stevens, MSPH, MA; Theodore Thompson, MS; Ed Tierney, MPH; Roldofo Valdez, PhD; David F. Williamson, PhD; Ping Zhang, PhD. Management and Program Analyst: Shay Clayton. Preventive Effectiveness Fellow/Health Service Researcher: Rui Li, PhD. Program Administrator: Bernice Moore, MBA. Central Administrative Data Coordinator: Dori Bilik, MBA.
Appendix 2: Clinical Care Strategy Intensity Measures
|
|---|
Quantity of Physician Performance Feedback
To compute the physician performance feedback composite score, we counted the number of items checked on a list of 15 possible diabetes processes and outcomes that could be given back to physicians. After we averaged the counts over PGs and HPs separately, each group and plan count was then z-transformed.
Intensity of Physician Reminders
The physician reminders composite was constructed from 2 multi-item questions. One question described the type of reminder, and the second described its content.
Reminder Type
The PG/HP survey listed 6 types of reminders that organizations could send their clinicians. Each PG/HP was assigned a score between 0 and 5 that corresponded to the most intense reminder checked (no reminders sent, 0; preprinted guidelines only sent, 1; flowsheets sent, 2; flags on medical records sent, 3; mailed list of patients, 4; customized alerts on medical records, 5).
Reminder Content
The PG/HP surveys included 9 possible items that are commonly included in reminders. Each PG/HP reminder content score corresponded to the number of reminder items checked.
The sums for both the type and content scores were z-transformed, as was done for the feedback score. The 2 z-transformed scores were averaged to give the final score for composite reminders.
Structured Diabetes Care Management
The comprehensive disease management composite combined 4 domains: disease management programs, intensity of diabetes guideline use, intensity of patient reminders, and diabetes education.
Disease Management Programs
We considered 3 aspects of disease management: program implementation, intensity of disease management, and formal case management.
Program Implementation
A plan or group's score on this indicator was the number of years that it had had a diabetes disease management program multiplied by the proportion of patients with diabetes enrolled in each PG/HP. Scores were z-transformed.
Intensity of Disease Management
A plan or group's score was the number of 9 possible disease management strategies included in the disease management program. Scores were z-transformed.
Formal Case Management
This indicator had 2 components: the number of diabetes case managers per 10 000 patients and the intensity of case management. To obtain the score for intensity of case management, each PG/HP was assigned a score between 0 and 3 that corresponded to the most intense of the following strategies checked (no patients assigned to case managers, 0; assignments made by primary care physician referral or patient self-referral, 1; most costly patients, recently discharged patients, or patients at high risk for micro- or macrovascular complications assigned, 2; all patients assigned, 3). The intensity score and the number of case managers per 10 000 patients in each PG/HP were z-transformed and the 2 components summed.
The disease management score was the mean of the z-transformed program implementation, disease management intensity, and case management scores.
Intensity of Diabetes Guideline Use
Each PG/HP received a score between 0 and 4 that corresponded to the most intense strategy for implementing guidelines checked (no guidelines used, 0; guidelines given to patients in written form or as educational talks, 1; guidelines sent in written form to physicians, 2; guidelines provided to physicians in computerized form, 3; guidelines incorporated into physician reminders or automated patient reminders, 4). Scores were z-transformed.
Intensity of Patient Reminders
We combined 2 multi-item indicators for this measure. The first was a weighted patient reminders indicator, which summed 6 possible reminders that were weighted by how often the reminders were sent to patients. The second indicator was a score between 0 and 4 that corresponded to the most intense of 4 possible strategies for sending reminders (no reminders sent, 0; generic newsletters or HP newsletters sent, 1; letters sent to specific patients, 2; letters sent from primary care physicians to specific patients, 3; personal telephone calls made to patients, 4). Both reminder scores were z-transformed, and the mean of the z-transformed scores was the intensity of patient reminders composite score.
Diabetes Education
This composite was constructed from the following 3 items: whether or not the PG/HP sponsored group or individual diabetes education classes; the number of full-time equivalent certified diabetes educators that were employed by the PG/HP; and whether the PG/HP had a formal diabetes education program. Each of these 3 indicators was z-transformed; the diabetes education composite score for each PG/HP was the mean of the 3 z-transformed scores.
Combining the Composites into 1 Comprehensive Score
The scores for disease management, guidelines, patient reminders, and education were highly correlated; pairwise Pearson r values ranged from 0.63 to 0.88. To avoid multicollinearity, we combined these scores into an overall structured diabetes care management comprehensive diabetes disease management score. The mean of the z-transformed indicators within each composite (the 3 indicators in the disease management composite; the 1 indicator in the guidelines composite; the 2 indicators in the patient reminders composite; and the 3 indicators in the education composite) was the structured diabetes care management score for each PG/HP.
Author and Article Information
|
|---|
|
TopEditors' NotesMethodsResultsDiscussionAuthor & Article InfoReferences |
|---|
Disclaimer: The contents of this paper are solely the responsibility of the authors and do not necessarily represent the official views of the Centers for Disease Control and Prevention and the National Institute of Diabetes and Digestive and Kidney Diseases.
Acknowledgment: The authors acknowledge the participation of their health plan partners.
Grant Support: This study was jointly funded by Program Announcement no. 04005 from the Centers for Disease Control and Prevention (Division of Diabetes Translation) and the National Institute of Diabetes and Digestive and Kidney Diseases. Dr. Kerr's role was supported by the Department of Veterans Affairs Health Services Research and Development Service.
Potential Financial Conflicts of Interest: None disclosed.
Corresponding Author: Carol M. Mangione, MD, MSPH, Department of Medicine, David Geffen School of Medicine at UCLA, 911 Broxton Plaza, Room 119, Los Angeles, CA 90095-1736; e-mail, cmangione{at}mednet.ucla.edu.
Current Author Addresses: Drs. Mangione, Steers, and Brown: Department of Medicine, David Geffen School of Medicine at UCLA, 911 Broxton Plaza, Room 119, Los Angeles, CA 90095-1736.
Mr. Gerzoff, Dr. Williamson, and Mr. Thompson: Division of Diabetes Translation, Centers for Disease Control and Prevention, 4770 Buford Highway Northeast, MS K-10, Atlanta, GA 30341.
Dr. Kerr: Ann Arbor Veterans Affairs Center for Practice Management and Outcomes Research, 2215 Fuller Road (11H), Ann Arbor, MI 48105.
Dr. Waitzfelder: Pacific Health Research Institute, 846 South Hotel Street, Suite 303, Honolulu, HI 96813.
Dr. Marrero: Diabetes Training and Research Center, Indiana University, 250 University Boulevard, Room 122, Indianapolis, IN 46202.
Dr. Dudley: University of California, San Francisco, 3333 California Street, Suite 265, San Francisco, CA 94118.
Dr. Kim: University of Michigan, 300 NIB, 7C13, Box 0429, Ann Arbor, MI 48109-0429.
Dr. Herman: University of Michigan Medical Center, 1500 East Medical Center Drive, 3920 TC, Ann Arbor, MI 48109-0354.
Dr. Safford: Department of Preventive Medicine, University of Alabama at Birmingham, MT 643, 1717 11th Avenue South, Birmingham, AL 35294-4410.
Dr. Selby: Division of Research, Kaiser Permanente, 2000 Broadway, Oakland, CA 94612.
References
|
|---|
|
TopEditors' NotesMethodsResultsDiscussionAuthor & Article InfoReferences |
|---|
1. Beckles GL, Engelgau MM, Narayan KM, Herman WH, Aubert RE, Williamson DF. Population-based assessment of the level of care among adults with diabetes in the U.S. Diabetes Care. 1998;21:1432-8. [PMID: 9727887].[Abstract]
2. Engelgau MM, Geiss LS, Manninen DL, Orians CE, Wagner EH, Friedman NM, et al. Use of services by diabetes patients in managed care organizations. Development of a diabetes surveillance system. CDC Diabetes in Managed Care Work Group. Diabetes Care. 1998;21:2062-8. [PMID: 9839095].[Abstract]
3. Simon LP, Albright A, Belman MJ, Tom E, Rideout JA. Risk and protective factors associated with screening for complications of diabetes in a health maintenance organization setting. Diabetes Care. 1999;22:208-12. [PMID: 10333935].
4. Ornstein SM, Jenkins RG. Quality of care for chronic illness in primary care: opportunity for improvement in process and outcome measures. Am J Manag Care. 1999;5:621-7. [PMID: 10537868].[Medline]
5. Saaddine JB, Engelgau MM, Beckles GL, Gregg EW, Thompson TJ, Narayan KM. A diabetes report card for the United States: quality of care in the 1990s. Ann Intern Med. 2002;136:565-74. [PMID: 11955024].
6. Saydah SH, Fradkin J, Cowie CC. Poor control of risk factors for vascular disease among adults with previously diagnosed diabetes. JAMA. 2004;291:335-42. [PMID: 14734596].
7. Epstein RS, Sherwood LM. From outcomes research to disease management: a guide for the perplexed. Ann Intern Med. 1996;124:832-7. [PMID: 8610953].
8. Ellrodt G, Cook DJ, Lee J, Cho M, Hunt D, Weingarten S. Evidence-based disease management. JAMA. 1997;278:1687-92. [PMID: 9388089].[Abstract]
9. Wagner EH, Austin BT, Davis C, Hindmarsh M, Schaefer J, Bonomi A. Improving chronic illness care: translating evidence into action. Health Aff (Millwood). 2001;20:64-78. [PMID: 11816692].
10. Casalino L, Gillies RR, Shortell SM, Schmittdiel JA, Bodenheimer T, Robinson JC, et al. External incentives, information technology, and organized processes to improve health care quality for patients with chronic diseases. JAMA. 2003;289:434-41. [PMID: 12533122].
11. Krein SL, Hayward RA, Pogach L, BootsMiller BJ. Department of Veterans Affairs' Quality Enhancement Research Initiative for Diabetes Mellitus. Med Care. 2000;38:I38-48. [PMID: 10843269].[Medline]
12. Renders CM, Valk GD, Griffin SJ, Wagner EH, Eijk Van JT, Assendelft WJ. Interventions to improve the management of diabetes in primary care, outpatient, and community settings: a systematic review. Diabetes Care. 2001;24:1821-33. [PMID: 11574449].
13. Weingarten SR, Henning JM, Badamgarav E, Knight K, Hasselblad V, Gano A Jr, et al. Interventions used in disease management programmes for patients with chronic illness--which ones work? Meta-analysis of published reports. BMJ. 2002;325:925. [PMID: 12399340].
14. Jamtvedt G, Young JM, Kristoffersen DT, Thomson O'Brien MA, Oxman AD. Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2003;(3):CD000259. [PMID: 12917891].[Medline]
15. Ornstein SM, Garr DR, Jenkins RG, Rust PF, Arnon A. Computer-generated physician and patient reminders. Tools to improve population adherence to selected preventive services. J Fam Pract. 1991;32:82-90. [PMID: 1985140].[Medline]
16. Norris SL, Nichols PJ, Caspersen CJ, Glasgow RE, Engelgau MM, Jack L, et al. The effectiveness of disease and case management for people with diabetes. A systematic review. Am J Prev Med. 2002;22:15-38. [PMID: 11985933].[Medline]
17. Montori VM, Dinneen SF, Gorman CA, Zimmerman BR, Rizza RA, Bjornsen SS, et al. The impact of planned care and a diabetes electronic management system on community-based diabetes care: the Mayo Health System Diabetes Translation Project. Diabetes Care. 2002;25:1952-7. [PMID: 12401738].
18. Aubert RE, Herman WH, Waters J, Moore W, Sutton D, Peterson BL, et al. Nurse case management to improve glycemic control in diabetic patients in a health maintenance organization. A randomized, controlled trial. Ann Intern Med. 1998;129:605-12. [PMID: 9786807].
19. Sadur CN, Moline N, Costa M, Michalik D, Mendlowitz D, Roller S, et al. Diabetes management in a health maintenance organization. Efficacy of care management using cluster visits. Diabetes Care. 1999;22:2011-7. [PMID: 10587835].
20. Trento M, Passera P, Tomalino M, Bajardi M, Pomero F, Allione A, et al. Group visits improve metabolic control in type 2 diabetes: a 2-year follow-up. Diabetes Care. 2001;24:995-1000. [PMID: 11375359].
21. Ilag LL, Martin CL, Tabaei BP, Isaman DJ, Burke R, Greene DA, et al. Improving diabetes processes of care in managed care. Diabetes Care. 2003;26:2722-7. [PMID: 14514570].
22. Petitti DB, Contreras R, Ziel FH, Dudl J, Domurat ES, Hyatt JA. Evaluation of the effect of performance monitoring and feedback on care process, utilization, and outcome. Diabetes Care. 2000;23:192-6. [PMID: 10868830].[Abstract]
23. HEDIS. Health Plan Employer Data and Information Set. Washington, DC: National Committee for Quality Assurance; 1999.
24. The TRIAD Study Group. The Translating Research Into Action for Diabetes (TRIAD) study: a multicenter study of diabetes in managed care. Diabetes Care. 2002;25:386-9. [PMID: 11815515].
25. Kerr EA, Gerzoff RB, Krein SL, Selby JV, Piette JD, Curb JD, et al. Diabetes care quality in the Veterans Affairs Health Care System and commercial managed care: the TRIAD study. Ann Intern Med. 2004;141:272-81. [PMID: 15313743].
26. Frankel LR. The report of the CASRO Task Force on response rates. In: Wiseman F, ed. Improving Data Quality in a Sample Survey. Cambridge, MA: Marketing Science Institute; 1983.
27. Kerr EA, Smith DM, Hogan MM, Hofer TP, Krein SL, Bermann M, et al. Building a better quality measure: are some patients with ‘poor quality’ actually getting good care? Med Care. 2003;41:1173-82. [PMID: 14515113].[Medline]
28. Ware J Jr, Kosinski M, Keller SD. A 12-Item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity. Med Care. 1996;34:220-33. [PMID: 8628042].[Medline]
29. Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40:373-83. [PMID: 3558716].[Medline]
30. Katz JN, Chang LC, Sangha O, Fossel AH, Bates DW. Can comorbidity be measured by questionnaire rather than medical record review? Med Care. 1996;34:73-84. [PMID: 8551813].[Medline]
31. American Diabetes Association. Introduction. Accessed at http://care.diabetesjournals.org/cgi/content/full/27/suppl_1/s1 on 11 May 2006.
32. National Committee for Quality Assurance. State of health care quality report: key findings. Accessed at http://www.ncqa.org/sohc2003/SOHC_2003_Key_Findings.htm on 24 June 2004.
33. Keating NL, Landrum MB, Landon BE, Ayanian JZ, Borbas C, Wolf R, et al. The influence of physicians' practice management strategies and financial arrangements on quality of care among patients with diabetes. Med Care. 2004;42:829-39. [PMID: 15319608].[Medline]
34. Fleming B, Silver A, Ocepek-Welikson K, Keller D. The relationship between organizational systems and clinical quality in diabetes care. Am J Manag Care. 2004;10:934-44. [PMID: 15617369].[Medline]
35. Leatherman S, Berwick D, Iles D, Lewin LS, Davidoff F, Nolan T, et al. The business case for quality: case studies and an analysis. Health Aff (Millwood). 2003;22:17-30. [PMID: 12674405].
36. Sperl-Hillen J, O'Connor PJ, Carlson RR, Lawson TB, Halstenson C, Crowson T, et al. Improving diabetes care in a large health care system: an enhanced primary care approach. Jt Comm J Qual Improv. 2000;26:615-22. [PMID: 11098424].[Medline]
37. Kerr EA, Krein SL, Vijan S, Hofer TP, Hayward RA. Avoiding pitfalls in chronic disease quality measurement: a case for the next generation of technical quality measures. Am J Manag Care. 2001;7:1033-43. [PMID: 11725807].[Medline]
Related articles in Annals:
This article has been cited by other articles:
|
|
 |
|
  S. Pakhomov, S. Bjornsen, P. Hanson, and S. Smith Quality Performance Measurement Using the Text of Electronic Medical Records Med Decis Making, July 1, 2008; 28(4): 462 - 470. [Abstract] [PDF]
|
|
|
|
 |
|
 K. A. Hahn, J. M. Ferrante, J. C. Crosson, S. V. Hudson, and B. F. Crabtree Diabetes Flow Sheet Use Associated With Guideline Adherence Ann. Fam. Med, May 1, 2008; 6(3): 235 - 238. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. V.S. Pakhomov, P. L. Hanson, S. S. Bjornsen, and S. A. Smith Automatic Classification of Foot Examination Findings Using Clinical Notes and Machine Learning J. Am. Med. Inform. Assoc., March 1, 2008; 15(2): 198 - 202. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. C. Rosal, E. M. Benjamin, P. S. Pekow, S. C. Lemon, and D. von Goeler Opportunities and Challenges for Diabetes Prevention at Two Community Health Centers Diabetes Care, February 1, 2008; 31(2): 247 - 254. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. Ferrara, C. M. Mangione, C. Kim, D. G. Marrero, D. Curb, M. Stevens, J. V. Selby, and for the Translating Research Into Action for Diabe Sex Disparities in Control and Treatment of Modifiable Cardiovascular Disease Risk Factors Among Patients With Diabetes: Translating Research Into Action for Diabetes (TRIAD) Study Diabetes Care, January 1, 2008; 31(1): 69 - 74. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
Club Diabete Sicili@ Five-Year Impact of a Continuous Quality Improvement Effort Implemented by a Network of Diabetes Outpatient Clinics Diabetes Care, January 1, 2008; 31(1): 57 - 62. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. A. Boren, T. L. Gunlock, J. Schaefer, and A. Albright Reducing Risks in Diabetes Self-management: A Systematic Review of the Literature The Diabetes Educator, November 1, 2007; 33(6): 1053 - 1077. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. E. Peek, A. Cargill, and E. S. Huang Diabetes Health Disparities: A Systematic Review of Health Care Interventions Med Care Res Rev, October 1, 2007; 64(5_suppl): 101S - 156S. [Abstract] [PDF]
|
|
|
|
Article
At the time of the survey, patients who met the initial criteria were included only if they verified that they had diabetes and received most of their diabetes care through the participating TRIAD health plan. 
Participants cared for under direct contracting agreements with health plans rather than in physician groups were assigned a value of 0 for each care management strategy at the physician group level.