The Association between Quality of Care and the Intensity of Diabetes Disease Management Programs

  1. Carol M. Mangione, MD, MSPH;
  2. Robert B. Gerzoff, MS;
  3. David F. Williamson, PhD;
  4. W. Neil Steers, PhD;
  5. Eve A. Kerr, MD;
  6. Arleen F. Brown, MD, PhD;
  7. Beth E. Waitzfelder, PhD;
  8. David G. Marrero, PhD;
  9. R. Adams Dudley, MD, MBA;
  10. Catherine Kim, MD, MPH;
  11. William Herman, MD;
  12. Theodore J. Thompson, MS;
  13. Monika M. Safford, MD;
  14. Joe V. Selby, MD, MPH; and
  15. for the TRIAD Study Group*
  1. From David Geffen School of Medicine at UCLA, Los Angeles, California; Centers for Disease Control and Prevention, Atlanta, Georgia; Veterans Affairs Ann Arbor Healthcare System and University of Michigan Medical School, Ann Arbor, Michigan; University of Medicine and Dentistry of New Jersey, Newark, New Jersey; Pacific Health Research Institute, Honolulu, Hawaii; Indiana University School of Medicine, Indianapolis, Indiana; Institute for Health Policy Studies, University of California–San Francisco, San Francisco, California; and Kaiser Permanente, Oakland, California.
     
    Next Section

    Abstract

    Background: Although disease management programs are widely implemented, little is known about their effectiveness.

    Objective: To determine whether disease management by physician groups is associated with diabetes care processes, control of intermediate outcomes, or the amount of medication used when intermediate outcomes are above target levels.

    Design: Cross-sectional study.

    Setting: Patients were randomly sampled from 63 physician groups nested in 7 health plans sponsored by Translating Research into Action for Diabetes (87%) and from 4 health plans with individual physician contracts (13%).

    Patients: 8661 adults with diabetes who completed a survey (2000–2001) and had medical record data.

    Measurements: Physician group and health plan directors described their organizations' use of physician reminders, performance feedback, and structured care management on a survey; their responses were used to determine measures of intensity of disease management. The current study measured 8 processes of care, including most recent hemoglobin A1c level, systolic blood pressure, serum low-density lipoprotein cholesterol level, and several measures of medication use.

    Results: Increased use of any of 3 disease management strategies was significantly associated with higher adjusted rates of retinal screening, nephropathy screening, foot examinations, and measurement of hemoglobin A1c levels. Serum lipid level testing and influenza vaccine administration were associated with greater use of structured care management and performance feedback. Greater use of performance feedback correlated with an increased rate of foot examinations (difference, 5 percentage points [95% CI, 1 to 8 percentage points]), and greater use of physician reminders was associated with an increased rate of nephropathy screening (difference, 15 percentage points [CI, 6 to 23 percentage points]). No strategies were associated with intermediate outcome levels or level of medication management.

    Limitations: Physician groups were not randomly sampled from population-based listings, and disease management strategies were not randomly allocated across groups.

    Conclusions: Disease management strategies were associated with better processes of diabetes care but not with improved intermediate outcomes or level of medication management. A greater focus on direct measurement, feedback, and reporting of intermediate outcome levels or of level of medication management may enhance the effectiveness of these programs.

    *See Appendix 1 for a complete list of the TRIAD Study Group.

    Previous SectionNext Section

    Improving Patient Care is a special section within Annals supported in part by the U.S. Department of Health and Human Services (HHS) Agency for Healthcare Research and Quality (AHRQ). The opinions expressed in this article are those of the authors and do not represent the position or endorsement of AHRQ or HHS.

    Editors' Notes

    Context

    • Little is known about the effects of quality-of-care improvement programs on the process of care and outcomes of diabetes.

    Contribution

    • The study involved 8661 patients with diabetes, 63 provider groups, and 3 disease management strategies (provider feedback, reminders, and structured care). The quality measures included 8 processes of care, 3 intermediate diabetes outcomes, and medication management of these outcomes. More intense disease management strategies predicted higher measures of many processes of care but only 1 intermediate outcome and 1 medication management outcome.

    Implications

    • The disease management strategies improved processes of care but not outcomes. Experts in quality improvement may need to refocus their efforts.

    —The Editors

    Persons with diabetes continue to receive suboptimal care (1–6). To improve quality, many health systems have implemented disease management programs for diabetes and other chronic conditions (7–9). These programs typically incorporate population-based strategies, such as disease registries, clinical guidelines, performance feedback, physician reminders, self-management support for patients, and targeted case management for high-risk patients (10).

    Evidence for the effectiveness of disease management comes primarily from small efficacy trials (10–20). Such studies consistently found improved processes of diabetes care; however, improvements in outcomes (such as control of cardiovascular disease risk factors) were less consistent (12, 17, 18, 20–22). Furthermore, most studies evaluated only 1 or 2 strategies (instead of multicomponent programs) in selected clinical settings. It is unclear how well findings from these smaller studies apply to entire patient populations.

    Many components of disease management focus on improving processes of care. Early performance measurement projects, such as the Health Plan Employer Data Information System (23) and the Diabetes Quality Improvement Program (5), emphasized the importance of such processes as annual retinal screening or hemoglobin A1c determination. Particularly for health plans, process measures are more readily available than are outcomes data. However, if disease management is to improve patient outcomes, it must also improve intermediate outcomes, such as hemoglobin A1c levels, systolic blood pressure, and serum low-density lipoprotein (LDL) cholesterol levels.

    Translating Research into Action for Diabetes (TRIAD) (24) is a multicenter study of diabetes care in managed care. The TRIAD study's central hypothesis is that health care systems features can affect quality of care. Here, we examine how 3 disease management strategies vary in intensity across physician groups and whether physician groups with more intensive disease management have higher quality of diabetes care. We assess quality by processes of care, by levels of intermediate outcomes, and by current clinical management of these outcomes.

    Previous SectionNext Section

    Methods

    Overview of the TRIAD Study and Sample

    The TRIAD study's sampling frame, methods, key hypotheses, and power calculations are detailed elsewhere (24). The study comprised 6 collaborating translational research centers that were partnered with 10 managed care health plans in 7 states. Of the 10 plans, 7 contracted with 1 to 26 physician groups (total, 68 groups), whereas 4 plans directly contracted with individual physicians.

    A standard algorithm was applied to automated pharmacy, laboratory utilization, and inpatient and outpatient diagnostic data (25) to identify all community-dwelling patients with diabetes who were 18 years of age and older and who had been continuously enrolled in the TRIAD health plan for at least 18 months. The study cohort was randomly sampled from this population.

    Sampled patients were recruited between July 2000 and October 2001 by using computer-assisted telephone interviews or written surveys that were conducted in English or Spanish. Eligibility was confirmed if patients verified that they had had diabetes for at least 12 months and had received most of their diabetes care through the TRIAD health plan. Permission was sought from all respondents to request copies of their outpatient medical records for the previous 18 months.

    All health plan and physician group directors received mailed surveys (Appendix Figure) during the same interval. Face-to-face or telephone interviews were used to complete and clarify responses. Each director was offered $100 for completing the survey.

    The TRIAD study was reviewed and approved by the institutional review boards of each research center and by the Centers for Disease Control and Prevention (CDC). Informed consent was obtained from all survey respondents.

    Data Sources

    Patient surveys included questions on health status, diabetes duration, current diabetes treatment, and demographic characteristics. Of 13 086 contacted and eligible persons, 11 927 (91%) completed the survey (56.6% by computer-assisted telephone interview and 43.4% by written survey) (Figure). We were unable to contact many individuals. Using a practice that is endorsed by the Council of American Survey Research Organizations (26), we assumed that persons whom we could not contact or for whom we could not confirm eligibility had the same eligibility rate as those contacted. Under that assumption, the response rate was 69%.

    Figure. *Patients receiving care in one of the Translating Research into Action for Diabetes (TRIAD) study health plans and whose diabetes diagnosis was based on the following criteria: a diagnostic code for diabetes (for example, 2 or more outpatient visits with International Classification of Diseases, Ninth Revision, code 250. ) or 1 or more inpatient stays with an associated diabetes code; results of laboratory studies suggestive of diabetes (for example, 2 or more hemoglobin A tests or diagnostic levels of hemoglobin A or fasting blood glucose); or a prescription for medications for diabetes (for example, insulin or an oral antidiabetic agent). †At the time of the survey, patients who met the initial criteria were included only if they verified that they had diabetes and received most of their diabetes care through the participating TRIAD health plan. ‡Participants cared for under direct contracting agreements with health plans rather than in physician groups were assigned a value of 0 for each care management strategy at the physician group level.
    View larger version:
    Figure. *Patients receiving care in one of the Translating Research into Action for Diabetes (TRIAD) study health plans and whose diabetes diagnosis was based on the following criteria: a diagnostic code for diabetes (for example, 2 or more outpatient visits with International Classification of Diseases, Ninth Revision, code 250. ) or 1 or more inpatient stays with an associated diabetes code; results of laboratory studies suggestive of diabetes (for example, 2 or more hemoglobin A tests or diagnostic levels of hemoglobin A or fasting blood glucose); or a prescription for medications for diabetes (for example, insulin or an oral antidiabetic agent). †At the time of the survey, patients who met the initial criteria were included only if they verified that they had diabetes and received most of their diabetes care through the participating TRIAD health plan. ‡Participants cared for under direct contracting agreements with health plans rather than in physician groups were assigned a value of 0 for each care management strategy at the physician group level. Description of sampling and response rate.xx1c1c

    Of 11 927 patients who completed a survey, 8661 (73%) consented to medical record review and subsequently had charts available for review. Centrally trained reviewers used standardized data collection software to abstract process measures, most recent levels of hemoglobin A1c, upper limits of normal for hemoglobin A1c measurements that were recorded, serum LDL cholesterol levels, systolic blood pressure, current medications, and comorbid conditions. Interrater reliability (κ) for the main quality measures ranged from 0.86 to 0.94.

    All 10 health plan directors and 52 of 68 physician group directors completed surveys. Surveys assessed organizational age, size, structure, profit status, insurance products, contracting arrangements, history of involvement with managed care, and detailed information on the organization's use of diabetes disease management strategies. Of the physician groups that did not respond (443 participants), 11 existed solely for the purpose of contracting with plans and had no diabetes disease management. These physician groups were assumed to have no care management strategies and were included in the analyses, as were patient groups (1150 participants) from the 4 health plans that contracted directly with physicians. The remaining 5 groups (159 participants) did not respond and were excluded from analyses (Figure). Consequently, the resulting sample included a total of 8661 survey respondents with charts available for review and data from 63 physician groups and 4 additional health plans (Figure). Mean duration of diabetes, body mass index, and health status did not meaningfully differ between persons whose medical records and physician group variables were available to the study team and those whose records were unavailable.

    Predictors, End Points, and Covariates

    The primary predictors were 3 measures of the intensity of disease management strategies: physician reminders, performance feedback, and structured care. These were calculated for physician groups and health plans from multiple survey items. A detailed description of the methods used to calculate composite intensity scores is provided in Appendix 2. Selected item-level responses for physician groups in the most intense versus least intense tercile of each strategy are displayed in Table 1.

    View this table:
    Table 1. Selected Item-Level Responses for Provider Groups for Each Disease Management Strategy*

    The physician reminders intensity score was derived from 2 questions, which detailed the types and content of the reminders physicians received. Groups whose use of reminders represented the upper tercile of intensity were found to have reminded physicians about 4 care processes on average. Most groups in the upper tercile delivered reminders electronically at the point of care.

    Performance feedback intensity was obtained by tallying responses to a checklist of possible diabetes process and outcome feedback items. A total of 86% and 82% of groups in the upper tercile included levels of hemoglobin A1c and serum LDL cholesterol, respectively, in feedback to physicians (Table 1). Physician feedback focused on many of the same elements of care as reminders.

    The use of formal case management, diabetes guidelines, patient reminders, and diabetes education correlated highly in physician groups (Pearson correlation coefficients ranged from 0.63 to 0.88); therefore, we could not look at these approaches independently. Consequently, we combined the 4 approaches into a single composite score for “structured diabetes care management.” Use of formal case management was assessed by the proportion of patients with diabetes who were enrolled, the number of case managers per 10 000 patients, the extent to which the program targeted high-risk patients, and a checklist of case management activities. The clinical guidelines were scored to reflect the extent of implementation. The highest score was assigned to physician groups that incorporated guidelines into automated physician or patient reminders. Patient reminder intensity incorporated the number, type, and frequency of reminders sent. On average, physician groups in the upper tercile had diabetes education as a covered benefit, whereas those in the lowest tercile generally did not have these programs.

    Because of the differing numbers of questions and wide range of possible values within each intensity score, each question was z-transformed to a mean of 0.0 and standard deviation near or equal to 1.0 to facilitate comparison. Scores for each of the care management composites were computed as the mean of its z-transformed responses. A combined measure of disease management intensity was constructed for each plan and group by adding the 3 composite scores together. The distribution of z-transformed composite scores for the 67 groups is shown in Appendix Table 1.

    View this table:
    Appendix Table 1. Descriptive Statistics for Each Clinical Care Strategy Composite

    Study end points included the following 8 processes of care: levels of hemoglobin A1c, serum lipids, and urine albumin; dilated retinal and foot examinations; recommendations for aspirin therapy and influenza vaccine; and counseling for smokers to encourage them to quit (n = 1264). The prevalence of the first 3 indicators was obtained exclusively from chart review; we used evidence from either the medical record or the patient survey to determine which of the remaining 5 measures had been performed. Each quality measure was the percentage of patients who received the process during the 12 months preceding the patient survey.

    The second set of end points included the most recently recorded hemoglobin A1c, serum LDL cholesterol, and systolic blood pressure values in the previous 12 months. These intermediate outcomes were analyzed as continuous and binary variables (hemoglobin A1c level <8.0%, systolic blood pressure <140 mm Hg, and serum LDL cholesterol level <3.35 mmol/L [<130 mg/dL]).

    We defined a third set of end points to reflect medical management of the 3 intermediate outcomes (Table 2). For each intermediate outcome, physician groups were assessed by the proportion of their patients with the condition who were at or below target levels or above target levels and currently receiving more medications (reflecting greater effort to manage the outcome) (27). Number of medications was dichotomized as use of 2 or more oral agents or insulin for diabetes; 1 or more lipid-lowering agents for hypercholesterolemia; and 2 or more antihypertensive agents for hypertension.

    View this table:
    Table 2. Clinical Management Measures for Hemoglobin A1c, Systolic Blood Pressure, and Serum Low-Density Lipoprotein Cholesterol*

    We used the patient survey to obtain the following model covariates: age, sex, ethnicity, education, income, health status from the Short Form-12 mental and physical component scores (28), duration of diabetes, and a 4-level treatment variable (diet-controlled, oral agents alone, oral agents and insulin, or insulin alone). The following 2 additional covariates, which described comorbid conditions and current therapies, were obtained from the medical record: the Charlson index (29, 30) and an additional measure of cardiovascular comorbidity that indicated presence of previous myocardial infarction, stroke, or coronary or carotid artery revascularization. All models were adjusted for intensity of care management and clustering at the health plan level.

    Statistical Analysis

    Both multiple imputation and modeling were performed with SAS statistical software, version 9.1.3 (SAS Institute Inc., Cary, North Carolina). Initial analyses examined distributions for predictors, outcomes, and covariates across physician groups. Fewer than 1% of patients had missing data for any key process-of-care variables. Hemoglobin A1c, serum LDL cholesterol, and systolic blood pressure values were unavailable for 9%, 24%, and 5% of patients, respectively; these patients were excluded only from analyses of the missing end point. Short Form-12 scores and income were missing for approximately 11% of participants; values for all other covariates were missing in fewer than 5% of participants. Missing values for covariates (but not predictors or end points) were imputed 5 times. Each covariate was predicted as a function of all other covariates by using a Markov chain Monte Carlo multiple imputation algorithm (SAS PROC MI and PROC MIANALYZE functions).

    Separate models assessed associations between each of the 3 disease management intensity scores and the combined intensity score with each process indicator, intermediate outcome level, and medication use variable. Because of the clustering of participants within physician groups and plans, hierarchical mixed-effects models were used to account for intraplan and physician group correlation. We used the SAS GLIMMIX procedure with penalized quasi-likelihood estimation for dichotomous outcomes and the SAS PROC MIXED procedure with restricted maximum likelihood estimates for continuous outcomes.

    Our results are presented as model-based predicted probabilities of receiving each process of care in physician groups in the highest versus lowest tercile of intensity for each of the 3 disease management strategies. We used terciles of the distribution of disease management intensity to estimate interpretable differences in performance across the intensity distribution. In models predicting intermediate outcome levels and proportion of patients with controlled disease or receiving more medications, we did not adjust for diabetes treatment and health status because these 2 variables could mediate associations of disease management intensity with these outcomes.

    We serially removed each of the health plans from the models, and we removed 1150 participants who did not receive care from physician groups to examine whether observed differences in processes of care were unduly affected by data from a single plan or from assigning a value of 0 to management indicators for physician group care, respectively. In separate sensitivity analyses, we examined whether our findings would be altered if we controlled for all 3 care strategies simultaneously or if we used cut-points for intermediate outcome control that were more stringent (hemoglobin A1c level <7.0%; serum LDL cholesterol level <2.60 mmol/L [<100 mg/dL], and systolic blood pressure <130 mm Hg) or less stringent (hemoglobin A1c level, 9.5%; serum LDL cholesterol level, 4.15 mmol/L [160 mg/dL]; and systolic blood pressure, 160 mm Hg). We also adjusted all hemoglobin A1c analyses by the upper limit of normal for the assay used. None of these sensitivity analyses substantially changed the results (data not shown).

    Role of the Funding Sources

    The study was funded by the CDC and the National Institute of Diabetes and Digestive and Kidney Diseases. The study was designed and governed by a 7-member steering committee; the CDC has 1 representative on this committee. Analysts from the CDC provided us with statistical assistance, reviewed the manuscript, and provided feedback to us.

    Previous SectionNext Section

    Results

    Analytical Sample

    Sample characteristics across physician groups are presented in Table 3. Nearly every characteristic varied greatly across physician groups, particularly age, sex, ethnicity, and prevalence of cardiovascular disease. Intensity of disease management strategies also varied substantially across physician groups (Table 1).

    View this table:
    Table 3. Distributions of Patient Demographic Characteristics and Clinical Predictors across Physician Groups*

    Rates for diabetes process of care were high but varied across physician groups (Table 4). Median levels of the 3 intermediate outcomes indicated that more than 50% of patients were above American Diabetes Association guideline target levels for each intermediate outcome (31).

    View this table:
    Table 4. Distribution of Quality Indicators, Mean Intermediate Outcome Levels, and Clinical Management Variables across Physician Groups*

    Association of Disease Management Strategies with Processes of Care

    As measured by the 8 process indicators, intensity of disease management was strongly associated with quality (Table 5). Of 24 adjusted associations (3 disease management strategies by 8 processes of care), 17 associations significantly favored physician groups with increased disease management intensity. Adjusted differences in predicted probabilities between upper and lower terciles ranged from 5% to 15%. Greater intensity of structured care management was associated with significantly higher levels for 6 of 8 processes, with differences ranging from 7% to 11%. More intense physician performance feedback was also associated with higher rates for 6 of 8 process indicators, with significant differences of 5% to 10%. Increased intensity of physician reminders was associated with higher rates for 5 of 8 process measures, with differences ranging from 8% to 15%. The combined intensity measure was also significantly related to 6 of the 8 processes of care. No strategy was significantly associated with rates of providing advice to stop smoking (among smokers).

    View this table:
    Table 5. Adjusted Association of Physician Group Disease Management with Quality Indicators, Intermediate Outcome Levels, and Medical Management of Intermediate Outcomes*

    Association of Disease Management Strategies with Intermediate Outcomes

    Greater intensity of structured care management was associated with adjusted systolic blood pressure levels that were 3 mm Hg (95% CI, 1 to 5 mm Hg) higher than those for lower intensity groups. The only other significant association was between greater intensity of physician reminders and slightly lower levels of serum LDL cholesterol (0.05 mmol/L [2 mg/dL]). Otherwise, disease management intensity and levels of the 3 intermediate outcomes were not associated (Table 5). Models predicting dichotomized outcomes (that is, below target levels) confirmed the lack of association of the 3 strategies or the combined measure with intermediate outcome control (data not shown).

    Association of Disease Management Strategies with Medication Management of Intermediate Outcomes

    For the end points of medication management, only 1 of the 12 associations showed a significant difference in the expected direction. Greater use of physician reminders was associated with a 7% (CI, 1% to 13%) increase in number of patients who had serum LDL cholesterol levels at target or who were using a cholesterol-lowering medication. Paradoxically, the only other significant finding suggested that persons in physician groups with the most intense, structured diabetes care management were 4% less likely to have a well-controlled hemoglobin A1c level or to be receiving 2 or more medications or insulin (Table 5; Appendix Table 2).

    View this table:
    Appendix Table 2. Adjusted Association of Physician Group Disease Management with Quality Indicators, Intermediate Outcome Levels, and Medical Management of Intermediate Outcomes (Third, Second, and First Tertiles)*
    Previous SectionNext Section

    Discussion

    Although disease management is widely implemented in managed care, its effectiveness has not been carefully examined. A lack of valid comparison groups and competing secular influences make it difficult to evaluate programs within single organizations. The TRIAD study makes it possible to estimate the impact of disease management by collecting detailed, standardized data across multiple physician groups that implement these strategies differently. In addition, the TRIAD health plans' standardized information allows us to control for health plan actions while we examine the influence of care management at the level of physician group.

    Our findings indicate strong associations between the intensity of the 3 disease management strategies and better care processes. These were noted despite relatively high process scores among all physician groups (32). The magnitude of observed differences was moderate (generally ranging from 5% to 15%) but similar to differences achieved in efficacy trials of individual disease management interventions (12, 16). However, none of these disease management programs seemed to affect intermediate outcomes in a clinically meaningful way, and they were not associated with apparent differences in the amount of medications used to control these outcomes.

    Our findings are consistent with previous reports. Keating and colleagues (33) studied diabetic patients in 1 market by using a summary quality score that included 4 processes and 2 measures of intermediate outcome control. Across 135 physician practices, they found that practice accounted for only a small proportion of variation in quality. Nonsignificant trends toward higher quality were found for practices that received diabetes performance report cards and those that routinely enrolled patients in disease management programs. Fleming and colleagues (34) found that practices that used multiple care management approaches were often in the upper quartile of the distribution in a similar quality composite score. In both of these reports, the quality scores were dominated by process measures, and the influence of diabetes care management on processes versus control of intermediate outcomes cannot be separated. The latter report also indicated that the relative influence of distinct care management practices, such as the use of reminders versus performance feedback at the health plan level, cannot be directly compared (34).

    In our analysis, we must carefully consider the absence of positive associations between disease management and intermediate outcome levels or responsive adjustments to treatment regimens. Accreditation organizations gave early emphasis to simple process-of-care measures that were easy to assess with administrative data (for example, whether a hemoglobin A1c test was done). Such approaches ignored intermediate outcome levels and their clinical treatments (for example, whether there was management change in response to a high hemoglobin A1c level). Disease management programs developed in response to accreditation undoubtedly focused more heavily on improving processes than outcomes of care. Our findings support the need for refinements in disease management that shift the focus toward direct measurement and feedback of intermediate outcomes and toward measurement of clinical processes of care that are more directly associated with improved outcomes (35, 36).

    Improving intermediate outcomes is more challenging than altering simple care processes. Process improvement can be more readily applied to entire populations with diabetes; however, intermediate outcome control requires identification of patients with elevated levels, targeted interventions, and support of self-management. In addition, control of intermediate outcomes requires the active participation of primary care physicians who may yet lack sufficient knowledge, decision support, or time to appropriately support patients in achieving control (37).

    Health plans also apply disease management strategies. Because there were only 10 TRIAD health plans, we cannot say whether use of these strategies at the health plan level would be associated with the same pattern of findings reported here at the physician group level.

    Several additional limitations of this study deserve mention. Because these cross-sectional analyses were conducted after generally 3 or fewer years of disease management, it may be too early to detect effects on intermediate outcome levels. Our analytical sample included only 63 physician groups that were not randomly selected from a larger, population-based listing. Furthermore, disease management strategies were not randomly allocated across groups. A larger physician group sample could have increased sensitivity to modest associations by increasing the statistical power as well as increasing the variability in disease management intensity. We used “more medication” as a surrogate for more aggressive care, but our cross-sectional analyses could not be used to determine whether providers changed therapy in response to suboptimal control of an intermediate outcome. Because some patients did not provide consent, medical records could not be obtained for approximately 30% of the entire TRIAD sample. However, survey data indicated that patients with missing medical records were quite similar to the other participants in terms of demographic characteristics, duration of diabetes, and self-reported health status.

    The TRIAD study suggests that the disease management programs implemented in these physician groups were associated with higher levels of care processes, but they did not seem to influence the intermediate outcomes that affect risk for complications or the medical management of these outcomes. As disease management programs give greater attention to improving intermediate outcomes and as process measures become more clinically relevant, these programs may be more likely to meet their long-term goal of improved health.

    Previous SectionNext Section

    Appendix 1: Translating Research into Action for Diabetes (TRIAD) Study GroupGraphic

    Hawaii Translational Research Center and Pacific Health Research Institute: Principal Investigator: J. David Curb, MD, MPH. Co-Principal Investigator: Beth Waitzfelder, PhD. Co-Investigators: Richard Chung, MD; R. Adams Dudley, MD, MBA; Chien-Wen Tseng, MD, MPH; Thomas Vogt, MD, MPH. Analyst: Qimei He, PhD. Project Coordinator: Suzanne Firrell.

    Indiana University Translational Research Center: Principal Investigator: David G. Marrero, PhD. Co-Principal Investigator: Ronald T. Ackermann, MD, MPH. Co-Investigators: Matthew J. Bair, MD, MS; Ed Brizendine, MS; Aaron E. Carroll, MD; Gilbert C. Liu, MD, MS; Paris Roach, MD; Changyu Shen, PhD; Morris Weinberger, PhD; Madelyn L. Wheeler, MS, RD, CD, FADA, CDE. Project Coordinator: Susanna R. Williams, MSPH.

    Kaiser Foundation Research Institute: Principal Investigator and Study Chairman: Joe V. Selby, MD, MPH. Co-Principal Investigator: Andrew J. Karter, PhD. Co-Investigators: Assiamira Ferrara, MD, PhD; Julie Schmittdiel, PhD. Senior Analyst: Connie Uratsu. Project Director: Bix E. Swain, MS.

    University of California, Los Angeles: Principal Investigator: Carol M. Mangione, MD, MSPH. Co-Principal Investigator: Arleen F. Brown, MD, PhD. Co-Investigators: O. Kenrik Duru, MD; Susan Ettner, PhD; Shaista Malik, MD, PhD; Martin F. Shapiro, MD, PhD. Senior Analyst: Neil Steers, PhD. Project Director: Chester Brown Jr., MHA. Senior Administrator: Carole Nagy, BA.

    University of Medicine and Dentistry of New Jersey: Principal Investigator: Norman Lasser, MD, PhD. Co-Principal Investigator: Stephen H. Schneider, MD. Co-Investigator and Project Director: Dorothy A. Caputo, MA, APRN, BC-ADM, CDE. Co-Investigators: Jesse C. Crosson, PhD; Stephen Crystal, PhD; David S. Kountz, MD; Shou-En Lu, PhD; Monika M. Safford, MD; Weichung (Joe) Shih, PhD; Leslie-Faith Morritt Taub, DNSc, ANP-C, GNP-BC.

    Central Activities Coordinating Center: TRIAD Central Program Specialist: Gabrielle J. Davis, BS, CHES. Central Program Assistant: Lucyna Lis, MA. Program Coordinator: Sonja Ross, BS, MHS.

    University of Michigan Health System: Principal Investigator: William H. Herman, MD, MPH. Co-Investigators: Catherine Kim, MD, MPH; Michele Heisler, MD; Susan Johnson, MD; Kingsley Onyemere, MD. Research Associates: Ray Burke, MA; Laura McEwen, PhD, MPH; Bahman Tabaei, MPH. Project Director: Jennifer Goewey, MHA.

    Department of Veterans Affairs: Principal Investigator: Eve A. Kerr, MD, MPH. Co-Principal Investigator: Rodney A. Hayward, MD. Co-Investigators: Sarah Krein, PhD; John Piette, PhD. Project Managers: Mary Hogan, PhD, RN; Fatima Makki, MPH, MSW. Data Manager: Jennifer Davis, MPH.

    National Institute of Diabetes and Digestive and Kidney Diseases: Co-Investigator: Sanford A. Garfield, PhD.

    Centers for Disease Control and Prevention: Lead Consultant: K.M. Venkat Narayan, MD, MSc, MBA, MRCP. Collaborating Investigators: Gloria Beckles, MD, MSc; Patrick Boyle, PhD; Michael Engelgau, MD, MS; Tiffany Gary, PhD; Linda Geiss, MS; Robert Gerzoff, MS; Edward W. Gregg, PhD; Betsy L. (Cadwell) Gunnels; Roberta H. Hilsdon, BBA, AAS; Henry Kahn, MD, FACP; Jinan Saaddine, MD; Mark Stevens, MSPH, MA; Theodore Thompson, MS; Ed Tierney, MPH; Roldofo Valdez, PhD; David F. Williamson, PhD; Ping Zhang, PhD. Management and Program Analyst: Shay Clayton. Preventive Effectiveness Fellow/Health Service Researcher: Rui Li, PhD. Program Administrator: Bernice Moore, MBA. Central Administrative Data Coordinator: Dori Bilik, MBA.

    Previous SectionNext Section

    Appendix 2: Clinical Care Strategy Intensity MeasuresGraphic

    We describe how we constructed the physician performance feedback, intensity of physician reminders, and intensity of diabetes disease management scores. Scores were calculated for each health plan (HP) and physician group (PG).

     
    Next Section

    Quantity of Physician Performance Feedback

    To compute the physician performance feedback composite score, we counted the number of items checked on a list of 15 possible diabetes processes and outcomes that could be given back to physicians. After we averaged the counts over PGs and HPs separately, each group and plan count was then z-transformed.

    Previous SectionNext Section

    Intensity of Physician Reminders

    The physician reminders composite was constructed from 2 multi-item questions. One question described the type of reminder, and the second described its content.

     
    Next Section

    Reminder Type

    The PG/HP survey listed 6 types of reminders that organizations could send their clinicians. Each PG/HP was assigned a score between 0 and 5 that corresponded to the most intense reminder checked (no reminders sent, 0; preprinted guidelines only sent, 1; flowsheets sent, 2; flags on medical records sent, 3; mailed list of patients, 4; customized alerts on medical records, 5).

    Previous Section
     

    Reminder Content

    The PG/HP surveys included 9 possible items that are commonly included in reminders. Each PG/HP reminder content score corresponded to the number of reminder items checked.

    The sums for both the type and content scores were z-transformed, as was done for the feedback score. The 2 z-transformed scores were averaged to give the final score for composite reminders.

    Previous Section
     

    Structured Diabetes Care Management

    The comprehensive disease management composite combined 4 domains: disease management programs, intensity of diabetes guideline use, intensity of patient reminders, and diabetes education.

     
    Next Section

    Disease Management Programs

    We considered 3 aspects of disease management: program implementation, intensity of disease management, and formal case management.

    Previous SectionNext Section

    Program Implementation

    A plan or group's score on this indicator was the number of years that it had had a diabetes disease management program multiplied by the proportion of patients with diabetes enrolled in each PG/HP. Scores were z-transformed.

    Previous SectionNext Section

    Intensity of Disease Management

    A plan or group's score was the number of 9 possible disease management strategies included in the disease management program. Scores were z-transformed.

    Previous SectionNext Section

    Formal Case Management

    This indicator had 2 components: the number of diabetes case managers per 10 000 patients and the intensity of case management. To obtain the score for intensity of case management, each PG/HP was assigned a score between 0 and 3 that corresponded to the most intense of the following strategies checked (no patients assigned to case managers, 0; assignments made by primary care physician referral or patient self-referral, 1; most costly patients, recently discharged patients, or patients at high risk for micro- or macrovascular complications assigned, 2; all patients assigned, 3). The intensity score and the number of case managers per 10 000 patients in each PG/HP were z-transformed and the 2 components summed.

    The disease management score was the mean of the z-transformed program implementation, disease management intensity, and case management scores.

    Previous SectionNext Section

    Intensity of Diabetes Guideline Use

    Each PG/HP received a score between 0 and 4 that corresponded to the most intense strategy for implementing guidelines checked (no guidelines used, 0; guidelines given to patients in written form or as educational talks, 1; guidelines sent in written form to physicians, 2; guidelines provided to physicians in computerized form, 3; guidelines incorporated into physician reminders or automated patient reminders, 4). Scores were z-transformed.

    Previous SectionNext Section

    Intensity of Patient Reminders

    We combined 2 multi-item indicators for this measure. The first was a weighted patient reminders indicator, which summed 6 possible reminders that were weighted by how often the reminders were sent to patients. The second indicator was a score between 0 and 4 that corresponded to the most intense of 4 possible strategies for sending reminders (no reminders sent, 0; generic newsletters or HP newsletters sent, 1; letters sent to specific patients, 2; letters sent from primary care physicians to specific patients, 3; personal telephone calls made to patients, 4). Both reminder scores were z-transformed, and the mean of the z-transformed scores was the intensity of patient reminders composite score.

    Previous SectionNext Section

    Diabetes Education

    This composite was constructed from the following 3 items: whether or not the PG/HP sponsored group or individual diabetes education classes; the number of full-time equivalent certified diabetes educators that were employed by the PG/HP; and whether the PG/HP had a formal diabetes education program. Each of these 3 indicators was z-transformed; the diabetes education composite score for each PG/HP was the mean of the 3 z-transformed scores.

    Previous Section
     

    Combining the Composites into 1 Comprehensive Score

    The scores for disease management, guidelines, patient reminders, and education were highly correlated; pairwise Pearson r values ranged from 0.63 to 0.88. To avoid multicollinearity, we combined these scores into an overall structured diabetes care management comprehensive diabetes disease management score. The mean of the z-transformed indicators within each composite (the 3 indicators in the disease management composite; the 1 indicator in the guidelines composite; the 2 indicators in the patient reminders composite; and the 3 indicators in the education composite) was the structured diabetes care management score for each PG/HP.

    Previous SectionNext Section

    Improving Patient Care is a special section within Annals supported in part by the U.S. Department of Health and Human Services (HHS) Agency for Healthcare Research and Quality (AHRQ). The opinions expressed in this article are those of the authors and do not represent the position or endorsement of AHRQ or HHS.

    Previous SectionNext Section

    Article and Author Information

    • Disclaimer: The contents of this paper are solely the responsibility of the authors and do not necessarily represent the official views of the Centers for Disease Control and Prevention and the National Institute of Diabetes and Digestive and Kidney Diseases.

    • Acknowledgment: The authors acknowledge the participation of their health plan partners.

    • Grant Support: This study was jointly funded by Program Announcement no. 04005 from the Centers for Disease Control and Prevention (Division of Diabetes Translation) and the National Institute of Diabetes and Digestive and Kidney Diseases. Dr. Kerr's role was supported by the Department of Veterans Affairs Health Services Research and Development Service.

    • Potential Financial Conflicts of Interest: None disclosed.

    • Corresponding Author: Carol M. Mangione, MD, MSPH, Department of Medicine, David Geffen School of Medicine at UCLA, 911 Broxton Plaza, Room 119, Los Angeles, CA 90095-1736; e-mail, cmangione{at}mednet.ucla.edu.

    • Current Author Addresses: Drs. Mangione, Steers, and Brown: Department of Medicine, David Geffen School of Medicine at UCLA, 911 Broxton Plaza, Room 119, Los Angeles, CA 90095-1736.

    • Mr. Gerzoff, Dr. Williamson, and Mr. Thompson: Division of Diabetes Translation, Centers for Disease Control and Prevention, 4770 Buford Highway Northeast, MS K-10, Atlanta, GA 30341.

    • Dr. Kerr: Ann Arbor Veterans Affairs Center for Practice Management and Outcomes Research, 2215 Fuller Road (11H), Ann Arbor, MI 48105.

    • Dr. Waitzfelder: Pacific Health Research Institute, 846 South Hotel Street, Suite 303, Honolulu, HI 96813.

    • Dr. Marrero: Diabetes Training and Research Center, Indiana University, 250 University Boulevard, Room 122, Indianapolis, IN 46202.

    • Dr. Dudley: University of California, San Francisco, 3333 California Street, Suite 265, San Francisco, CA 94118.

    • Dr. Kim: University of Michigan, 300 NIB, 7C13, Box 0429, Ann Arbor, MI 48109-0429.

    • Dr. Herman: University of Michigan Medical Center, 1500 East Medical Center Drive, 3920 TC, Ann Arbor, MI 48109-0354.

    • Dr. Safford: Department of Preventive Medicine, University of Alabama at Birmingham, MT 643, 1717 11th Avenue South, Birmingham, AL 35294-4410.

    • Dr. Selby: Division of Research, Kaiser Permanente, 2000 Broadway, Oakland, CA 94612.

    Previous Section
     

    References

    1. 1.↵
      1. BecklesGL,
      2. EngelgauMM,
      3. NarayanKM,
      4. HermanWH,
      5. AubertRE,
      6. WilliamsonDF
      Population-based assessment of the level of care among adults with diabetes in the U.S.Diabetes Care1998211432-8pmid:9727887
      Beckles GL, Engelgau MM, Narayan KM, Herman WH, Aubert RE, Williamson DF. Population-based assessment of the level of care among adults with diabetes in the U.S. Diabetes Care. 1998;21:1432-8. [PMID: 9727887]
      Abstract
    2. 2.↵
      1. EngelgauMM,
      2. GeissLS,
      3. ManninenDL,
      4. OriansCE,
      5. WagnerEH,
      6. FriedmanNM
      et al.Use of services by diabetes patients in managed care organizations. Development of a diabetes surveillance system. CDC Diabetes in Managed Care Work Group.Diabetes Care1998212062-8pmid:9839095
      Engelgau MM, Geiss LS, Manninen DL, Orians CE, Wagner EH, Friedman NM, et al. Use of services by diabetes patients in managed care organizations. Development of a diabetes surveillance system. CDC Diabetes in Managed Care Work Group. Diabetes Care. 1998;21:2062-8. [PMID: 9839095]
      Abstract
    3. 3.↵
      1. SimonLP,
      2. AlbrightA,
      3. BelmanMJ,
      4. TomE,
      5. RideoutJA
      Risk and protective factors associated with screening for complications of diabetes in a health maintenance organization setting.Diabetes Care199922208-12pmid:10333935
      Simon LP, Albright A, Belman MJ, Tom E, Rideout JA. Risk and protective factors associated with screening for complications of diabetes in a health maintenance organization setting. Diabetes Care. 1999;22:208-12. [PMID: 10333935]
      Abstract/FREE Full Text
    4. 4.↵
      1. OrnsteinSM,
      2. JenkinsRG
      Quality of care for chronic illness in primary care: opportunity for improvement in process and outcome measures.Am J Manag Care19995621-7pmid:10537868
      Ornstein SM, Jenkins RG. Quality of care for chronic illness in primary care: opportunity for improvement in process and outcome measures. Am J Manag Care. 1999;5:621-7. [PMID: 10537868]
      MedlineWeb of Science
    5. 5.↵
      1. SaaddineJB,
      2. EngelgauMM,
      3. BecklesGL,
      4. GreggEW,
      5. ThompsonTJ,
      6. NarayanKM
      A diabetes report card for the United States: quality of care in the 1990s.Ann Intern Med2002136565-74pmid:11955024
      Saaddine JB, Engelgau MM, Beckles GL, Gregg EW, Thompson TJ, Narayan KM. A diabetes report card for the United States: quality of care in the 1990s. Ann Intern Med. 2002;136:565-74. [PMID: 11955024]
      Abstract/FREE Full Text
    6. 6.↵
      1. SaydahSH,
      2. FradkinJ,
      3. CowieCC
      Poor control of risk factors for vascular disease among adults with previously diagnosed diabetes.JAMA2004291335-42pmid:14734596
      Saydah SH, Fradkin J, Cowie CC. Poor control of risk factors for vascular disease among adults with previously diagnosed diabetes. JAMA. 2004;291:335-42. [PMID: 14734596]
      Abstract/FREE Full Text
    7. 7.↵
      1. EpsteinRS,
      2. SherwoodLM
      From outcomes research to disease management: a guide for the perplexed.Ann Intern Med1996124832-7pmid:8610953
      Epstein RS, Sherwood LM. From outcomes research to disease management: a guide for the perplexed. Ann Intern Med. 1996;124:832-7. [PMID: 8610953]
      Abstract/FREE Full Text
    8. 8.↵
      1. EllrodtG,
      2. CookDJ,
      3. LeeJ,
      4. ChoM,
      5. HuntD,
      6. WeingartenS
      Evidence-based disease management.JAMA19972781687-92pmid:9388089
      Ellrodt G, Cook DJ, Lee J, Cho M, Hunt D, Weingarten S. Evidence-based disease management. JAMA. 1997;278:1687-92. [PMID: 9388089]
      Abstract/FREE Full Text
    9. 9.↵
      1. WagnerEH,
      2. AustinBT,
      3. DavisC,
      4. HindmarshM,
      5. SchaeferJ,
      6. BonomiA
      Improving chronic illness care: translating evidence into action.Health Aff (Millwood)20012064-78pmid:11816692
      Wagner EH, Austin BT, Davis C, Hindmarsh M, Schaefer J, Bonomi A. Improving chronic illness care: translating evidence into action. Health Aff (Millwood). 2001;20:64-78. [PMID: 11816692]
      Abstract/FREE Full Text
    10. 10.↵
      1. CasalinoL,
      2. GilliesRR,
      3. ShortellSM,
      4. SchmittdielJA,
      5. BodenheimerT,
      6. RobinsonJC
      et al.External incentives, information technology, and organized processes to improve health care quality for patients with chronic diseases.JAMA2003289434-41pmid:12533122
      Casalino L, Gillies RR, Shortell SM, Schmittdiel JA, Bodenheimer T, Robinson JC, et al. External incentives, information technology, and organized processes to improve health care quality for patients with chronic diseases. JAMA. 2003;289:434-41. [PMID: 12533122]
      Abstract/FREE Full Text
    11. 11.↵
      1. KreinSL,
      2. HaywardRA,
      3. PogachL,
      4. BootsMillerBJ
      Department of Veterans Affairs' Quality Enhancement Research Initiative for Diabetes Mellitus.Med Care200038I38-48pmid:10843269
      Krein SL, Hayward RA, Pogach L, BootsMiller BJ. Department of Veterans Affairs' Quality Enhancement Research Initiative for Diabetes Mellitus. Med Care. 2000;38:I38-48. [PMID: 10843269]
      Medline
    12. 12.↵
      1. RendersCM,
      2. ValkGD,
      3. GriffinSJ,
      4. WagnerEH,
      5. Eijk VanJT,
      6. AssendelftWJ
      Interventions to improve the management of diabetes in primary care, outpatient, and community settings: a systematic review.Diabetes Care2001241821-33pmid:11574449
      Renders CM, Valk GD, Griffin SJ, Wagner EH, Eijk Van JT, Assendelft WJ. Interventions to improve the management of diabetes in primary care, outpatient, and community settings: a systematic review. Diabetes Care. 2001;24:1821-33. [PMID: 11574449]
      Abstract/FREE Full Text
    13. 13.↵
      Weingarten SR, Henning JM, Badamgarav E, Knight K, Hasselblad V, Gano A Jr, et al. Interventions used in disease management programmes for patients with chronic illness--which ones work? Meta-analysis of published reports. BMJ. 2002;325:925. [PMID: 12399340]
    14. 14.↵
      Jamtvedt G, Young JM, Kristoffersen DT, Thomson O'Brien MA, Oxman AD. Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2003;(3):CD000259. [PMID: 12917891]
    15. 15.↵
      1. OrnsteinSM,
      2. GarrDR,
      3. JenkinsRG,
      4. RustPF,
      5. ArnonA
      Computer-generated physician and patient reminders. Tools to improve population adherence to selected preventive services.J Fam Pract19913282-90pmid:1985140
      Ornstein SM, Garr DR, Jenkins RG, Rust PF, Arnon A. Computer-generated physician and patient reminders. Tools to improve population adherence to selected preventive services. J Fam Pract. 1991;32:82-90. [PMID: 1985140]
      MedlineWeb of Science
    16. 16.↵
      1. NorrisSL,
      2. NicholsPJ,
      3. CaspersenCJ,
      4. GlasgowRE,
      5. EngelgauMM,
      6. JackL
      et al.The effectiveness of disease and case management for people with diabetes. A systematic review.Am J Prev Med20022215-38pmid:11985933
      Norris SL, Nichols PJ, Caspersen CJ, Glasgow RE, Engelgau MM, Jack L, et al. The effectiveness of disease and case management for people with diabetes. A systematic review. Am J Prev Med. 2002;22:15-38. [PMID: 11985933]
      MedlineWeb of Science
    17. 17.↵
      1. MontoriVM,
      2. DinneenSF,
      3. GormanCA,
      4. ZimmermanBR,
      5. RizzaRA,
      6. BjornsenSS
      et al.The impact of planned care and a diabetes electronic management system on community-based diabetes care: the Mayo Health System Diabetes Translation Project.Diabetes Care2002251952-7pmid:12401738
      Montori VM, Dinneen SF, Gorman CA, Zimmerman BR, Rizza RA, Bjornsen SS, et al. The impact of planned care and a diabetes electronic management system on community-based diabetes care: the Mayo Health System Diabetes Translation Project. Diabetes Care. 2002;25:1952-7. [PMID: 12401738]
      Abstract/FREE Full Text
    18. 18.↵
      1. AubertRE,
      2. HermanWH,
      3. WatersJ,
      4. MooreW,
      5. SuttonD,
      6. PetersonBL
      et al.Nurse case management to improve glycemic control in diabetic patients in a health maintenance organization. A randomized, controlled trial.Ann Intern Med1998129605-12pmid:9786807
      Aubert RE, Herman WH, Waters J, Moore W, Sutton D, Peterson BL, et al. Nurse case management to improve glycemic control in diabetic patients in a health maintenance organization. A randomized, controlled trial. Ann Intern Med. 1998;129:605-12. [PMID: 9786807]
      Abstract/FREE Full Text
    19. 19.↵
      1. SadurCN,
      2. MolineN,
      3. CostaM,
      4. MichalikD,
      5. MendlowitzD,
      6. RollerS
      et al.Diabetes management in a health maintenance organization. Efficacy of care management using cluster visits.Diabetes Care1999222011-7pmid:10587835
      Sadur CN, Moline N, Costa M, Michalik D, Mendlowitz D, Roller S, et al. Diabetes management in a health maintenance organization. Efficacy of care management using cluster visits. Diabetes Care. 1999;22:2011-7. [PMID: 10587835]
      Abstract/FREE Full Text
    20. 20.↵
      1. TrentoM,
      2. PasseraP,
      3. TomalinoM,
      4. BajardiM,
      5. PomeroF,
      6. AllioneA
      et al.Group visits improve metabolic control in type 2 diabetes: a 2-year follow-up.Diabetes Care200124995-1000pmid:11375359
      Trento M, Passera P, Tomalino M, Bajardi M, Pomero F, Allione A, et al. Group visits improve metabolic control in type 2 diabetes: a 2-year follow-up. Diabetes Care. 2001;24:995-1000. [PMID: 11375359]
      Abstract/FREE Full Text
    21. 21.↵
      1. IlagLL,
      2. MartinCL,
      3. TabaeiBP,
      4. IsamanDJ,
      5. BurkeR,
      6. GreeneDA
      et al.Improving diabetes processes of care in managed care.Diabetes Care2003262722-7pmid:14514570
      Ilag LL, Martin CL, Tabaei BP, Isaman DJ, Burke R, Greene DA, et al. Improving diabetes processes of care in managed care. Diabetes Care. 2003;26:2722-7. [PMID: 14514570]
      Abstract/FREE Full Text
    22. 22.↵
      1. PetittiDB,
      2. ContrerasR,
      3. ZielFH,
      4. DudlJ,
      5. DomuratES,
      6. HyattJA
      Evaluation of the effect of performance monitoring and feedback on care process, utilization, and outcome.Diabetes Care200023192-6pmid:10868830
      Petitti DB, Contreras R, Ziel FH, Dudl J, Domurat ES, Hyatt JA. Evaluation of the effect of performance monitoring and feedback on care process, utilization, and outcome. Diabetes Care. 2000;23:192-6. [PMID: 10868830]
      Abstract
    23. 23.↵
      HEDISHealth Plan Employer Data and Information Set.Washington, DCNational Committee for Quality Assurance1999
      HEDIS. Health Plan Employer Data and Information Set. Washington, DC: National Committee for Quality Assurance; 1999.
    24. 24.↵
      The TRIAD Study GroupThe Translating Research Into Action for Diabetes (TRIAD) study: a multicenter study of diabetes in managed care.Diabetes Care200225386-9pmid:11815515
      The TRIAD Study Group. The Translating Research Into Action for Diabetes (TRIAD) study: a multicenter study of diabetes in managed care. Diabetes Care. 2002;25:386-9. [PMID: 11815515]
      FREE Full Text
    25. 25.↵
      1. KerrEA,
      2. GerzoffRB,
      3. KreinSL,
      4. SelbyJV,
      5. PietteJD,
      6. CurbJD
      et al.Diabetes care quality in the Veterans Affairs Health Care System and commercial managed care: the TRIAD study.Ann Intern Med2004141272-81pmid:15313743
      Kerr EA, Gerzoff RB, Krein SL, Selby JV, Piette JD, Curb JD, et al. Diabetes care quality in the Veterans Affairs Health Care System and commercial managed care: the TRIAD study. Ann Intern Med. 2004;141:272-81. [PMID: 15313743]
      Abstract/FREE Full Text
    26. 26.↵
      1. FrankelLR
      The report of the CASRO Task Force on response rates.Wiseman FImproving Data Quality in a Sample Survey.Cambridge, MAMarketing Science Institute1983
      Frankel LR. The report of the CASRO Task Force on response rates. In: Wiseman F, ed. Improving Data Quality in a Sample Survey. Cambridge, MA: Marketing Science Institute; 1983.
    27. 27.↵
      1. KerrEA,
      2. SmithDM,
      3. HoganMM,
      4. HoferTP,
      5. KreinSL,
      6. BermannM
      et al.Building a better quality measure: are some patients with ‘poor quality’ actually getting good care?Med Care2003411173-82pmid:14515113
      Kerr EA, Smith DM, Hogan MM, Hofer TP, Krein SL, Bermann M, et al. Building a better quality measure: are some patients with ‘poor quality’ actually getting good care? Med Care. 2003;41:1173-82. [PMID: 14515113]
      CrossRefMedlineWeb of Science
    28. 28.↵
      1. WareJ, Jr,
      2. KosinskiM,
      3. KellerSD
      A 12-Item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity.Med Care199634220-33pmid:8628042
      Ware J Jr, Kosinski M, Keller SD. A 12-Item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity. Med Care. 1996;34:220-33. [PMID: 8628042]
      CrossRefMedlineWeb of Science
    29. 29.↵
      1. CharlsonME,
      2. PompeiP,
      3. AlesKL,
      4. MacKenzieCR
      A new method of classifying prognostic comorbidity in longitudinal studies: development and validation.J Chronic Dis198740373-83pmid:3558716
      Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40:373-83. [PMID: 3558716]
      CrossRefMedlineWeb of Science
    30. 30.↵
      1. KatzJN,
      2. ChangLC,
      3. SanghaO,
      4. FosselAH,
      5. BatesDW
      Can comorbidity be measured by questionnaire rather than medical record review?Med Care19963473-84pmid:8551813
      Katz JN, Chang LC, Sangha O, Fossel AH, Bates DW. Can comorbidity be measured by questionnaire rather than medical record review? Med Care. 1996;34:73-84. [PMID: 8551813]
      CrossRefMedlineWeb of Science
    31. 31.↵
      American Diabetes Association. Introduction. Accessed at http://care.diabetesjournals.org/cgi/content/full/27/suppl_1/s1 on 11 May 2006.
    32. 32.↵
      National Committee for Quality Assurance. State of health care quality report: key findings. Accessed at http://www.ncqa.org/sohc2003/SOHC_2003_Key_Findings.htm on 24 June 2004.
    33. 33.↵
      1. KeatingNL,
      2. LandrumMB,
      3. LandonBE,
      4. AyanianJZ,
      5. BorbasC,
      6. WolfR
      et al.The influence of physicians' practice management strategies and financial arrangements on quality of care among patients with diabetes.Med Care200442829-39pmid:15319608
      Keating NL, Landrum MB, Landon BE, Ayanian JZ, Borbas C, Wolf R, et al. The influence of physicians' practice management strategies and financial arrangements on quality of care among patients with diabetes. Med Care. 2004;42:829-39. [PMID: 15319608]
      CrossRefMedline
    34. 34.↵
      1. FlemingB,
      2. SilverA,
      3. Ocepek-WeliksonK,
      4. KellerD
      The relationship between organizational systems and clinical quality in diabetes care.Am J Manag Care200410934-44pmid:15617369
      Fleming B, Silver A, Ocepek-Welikson K, Keller D. The relationship between organizational systems and clinical quality in diabetes care. Am J Manag Care. 2004;10:934-44. [PMID: 15617369]
      MedlineWeb of Science
    35. 35.↵
      1. LeathermanS,
      2. BerwickD,
      3. IlesD,
      4. LewinLS,
      5. DavidoffF,
      6. NolanT
      et al.The business case for quality: case studies and an analysis.Health Aff (Millwood)20032217-30pmid:12674405
      Leatherman S, Berwick D, Iles D, Lewin LS, Davidoff F, Nolan T, et al. The business case for quality: case studies and an analysis. Health Aff (Millwood). 2003;22:17-30. [PMID: 12674405]
      Abstract/FREE Full Text
    36. 36.↵
      1. Sperl-HillenJ,
      2. O'ConnorPJ,
      3. CarlsonRR,
      4. LawsonTB,
      5. HalstensonC,
      6. CrowsonT
      et al.Improving diabetes care in a large health care system: an enhanced primary care approach.Jt Comm J Qual Improv200026615-22pmid:11098424
      Sperl-Hillen J, O'Connor PJ, Carlson RR, Lawson TB, Halstenson C, Crowson T, et al. Improving diabetes care in a large health care system: an enhanced primary care approach. Jt Comm J Qual Improv. 2000;26:615-22. [PMID: 11098424]
      Medline
    37. 37.↵
      1. KerrEA,
      2. KreinSL,
      3. VijanS,
      4. HoferTP,
      5. HaywardRA
      Avoiding pitfalls in chronic disease quality measurement: a case for the next generation of technical quality measures.Am J Manag Care200171033-43pmid:11725807
      Kerr EA, Krein SL, Vijan S, Hofer TP, Hayward RA. Avoiding pitfalls in chronic disease quality measurement: a case for the next generation of technical quality measures. Am J Manag Care. 2001;7:1033-43. [PMID: 11725807]
      MedlineWeb of Science

    Summary for Patients

    • Summaries for Patients:Relationship of Intensity of Diabetes Disease Management Programs and Quality of Care Ann Intern Med July 18, 2006 145:I-41
    « Previous | Next Article »Table of Contents

    This Article

    1. Ann Intern Med July 18, 2006 vol. 145 no. 2 107-116
    1. AbstractFREE
    2. Figures
    3. » Full Text
    4. Full Text (PDF)
      1. Summary for Patients
    6. Appendix Figure

    Rapid Responses

    1. Submit a response
    2. No responses published

    Navigate This Article

    Current Issue

    1. November 3, 2009, 151 (9)
    1. Alert me to current issues