Article
|
|
|
Services
|
|
|
Google Scholar
|
|
|
PubMed
|
|
|
|
QUALITY MEASUREMENT AND IMPROVEMENT
Feasibility and Utility of Adding Disease-Specific Outcome Measures to Administrative Databases To Improve Disease Management
Matthew H. Liang, MD, MPH, and
Nancy Shadick, MD, MPH
15 October 1997 | Volume 127 Issue 8 Part 2 | Pages 739-742
To increase the utility of administrative databases, it has been recommended that they include disease-specific, patient-centered outcome measures. This paper reviews practical and theoretical considerations and the critical evidence to support this recommendation. The strengths and weaknesses of the recommended approach are illustrated by examples of disease-specific measures for arthritis and musculoskeletal diseases. Current experience suggests that routine capture of these measures in administrative databases has formidable practical problems and would be unlikely to affect patient care. They could be used as gross indicators of a population's experience but would be insensitive to clinically meaningful improvement on the level of the individual patient. By themselves, these measures are unlikely to identify actionable strategies to improve outcomes, but they could improve efficiency. Overall, implementing this type of disease management improvement strategy would have little value in direct patient care and would be costly.
Administrative databases, used to bill and track enrollees of health insurance plans, are increasingly being used to study, monitor, and improve health resource utilization and, to a lesser degree, health outcomes. To improve the utility of these databases in outcomes research, a call has been issued to include patient-centered measures of physical function and quality of life as part of routine data collection. These measures are not routinely captured now, but the technology to do so (such as optically scannable forms, automated telephone interviews, and computerized data capture by touch screen) exists. It is unclear whether collection of such data as part of routine care is worth the expense and whether it would improve the efficiency or the outcomes of health care. We discuss the merits and the limitations of including measures of physical function and quality of life in administrative databases by using arthritis and musculoskeletal disorders, a group of disorders in which patient-centered outcome measurement has had the longest history, to illustrate the issue.
Arthritis and musculoskeletal diseases comprise more than 100 conditions [1]. The importance of the effect of these disorders on function and quality of life has been recognized since 1949. Since the early 1980s, questionnaires have been developed to measure physical function and health status [2-12]. Both general and arthritis-specific measures have been applied to systemic rheumatic diseases and musculoskeletal disorders.
New disease-specific measures are available for rheumatoid arthritis, osteoarthritis, spondylitis, fibromyalgia, lower back and neck conditions, shoulder conditions, lower-extremity conditions, upper-extremity conditions, the carpal tunnel syndrome, and spinal stenosis. In general, the questionnaires have excellent psychometric properties, measure patient-centered outcomes, are sensitive to changes in clinical status, are more sensitive than generic measures, and serve as proxies for disease severity and activity. They are firmly entrenched in the clinical literature and accurately predict outcomes, mortality, and utilization of health services. Outcome measurement for several conditions have been incorporated in some practices, and progressive professional groups, such as the American Academy of Orthopedic Surgeons, the Pediatric Orthopedic Society of North America, the Hand Society, the Foot and Ankle Society, and the North American Spine Society, have invested substantially in the production, dissemination, and reporting of information on minimal essential outcomes. These measures are sufficiently mature that we can consider how and whether they might be collected as part of routinely obtained administrative data to answer questions in health services research and administrative research.
|
Feasibility of Incorporating Disease-Specific Outcome Measures into Administrative Databases
|
|---|
Administrative databases contain a wealth of demographic, diagnostic, and utilization information but usually lack clinical information. A sparse body of literature suggests that although these databases have tremendous power and potential, the precision of diagnostic coding varies and is related to the underlying diagnosis. Little work has focused on validating the information on utilization. Yet, the biggest problem with most large databases is lack of clinical detail and critical information on patient outcomes. Adding patient-derived information to administrative databases would probably require a fiat as a condition of payment in traditional indemnity systems or a major administrative decision in other systems of care. For practical reasons, it makes sense to obtain information directly from the patient rather than through physicians' offices, which are already overwhelmed with paperwork.
Generic forms could be administered routinely. Although they are less sensitive to change in persons with specific disorders, generic instruments are useful for making comparisons across different disorders. Some are simpler and shorter than disease-specific measures. With disease-specific instruments, the challenge is daunting. How would one decide which disease-specific instrument should be sent to the patient? In a person with many conditions, which condition should be assessed? Diagnostic codes for presenting patients' problems may not bear on the real diagnosis. It is difficult to imagine that patients would tolerate completing a questionnaire for each condition. Functional status in patients with one chronic disorder may be compromised by the existence of other illnesses, and it may be difficult to determine which condition is causing the functional problem and which physician is treating that condition. No single standard of measurement exists: The available instruments for arthritis and musculoskeletal diseases overlap considerably in the domains that they cover, and these in turn overlap with the domains covered by generic instruments. Customizing the number and type of forms or generating nonoverlapping combinations of scales by using an algorithm or an automated system may be a solution, but the comparison of patients by use of different outcome measures presents considerable methodologic difficulties. We think that this quandary is inherent to the current paradigm of outcome measurement, in which standard closed-ended questionnaires are the one size that is assumed to fit all. Finally, regardless of which and how many measures should be collected, it is essential that providers of care receive feedback in a timely manner, no matter how the information might ultimately be used. If health care providers are to be accountable, they must know what is being counted.
|
Should Generic or Disease-Specific Outcomes Data Be Included in the Administrative Databases?
|
|---|
The question of whether outcomes data should be included at all in administrative databases is as important as the practical considerations of implementing and administering extensive data collection. We discuss this with regard to the potential utility of these data in improving patient care by better monitoring, problem identification, and assessing the quality of care.
Four randomized, controlled clinical evaluations [13-16] of the effect of providing functional status information to clinicians and the effect of this information on decision making and patient outcomes showed disappointing results. These trials indicate that much work needs to be done before the technology that has been so useful in clinical research is transferred uncritically to the larger community.
McVey and colleagues [13] did a randomized, controlled trial of multiple health status instruments in conjunction with a geriatric consultation team that performed a comprehensive functional evaluation with specific recommendations. They were unable to show significant differences in functional status between case-patients and controls. Rubenstein and coworkers [14] performed a randomized, controlled trial of the Functional Status Questionnaire (a generic measure) and an educational intervention directed at internists. Although most physicians considered the functional status evaluation useful, the functional status in the case-patients and controls did not change over 1 year. Kazis and associates [15] studied the effects of providing rheumatologists with the Arthritis Impact Measurement Scale (AIMS) and the Health Assessment Questionnaire (HAQ), two widely used health status and physical function questionnaires on rheumatoid arthritis, for use by patients with stable rheumatoid arthritis during routine office visits. Health status information had no effect on either the process or the outcome of care. Most recently, Rubenstein and colleagues [16] evaluated a computer-generated functional status questionnaire, patients' self-reported chief symptom, and problem-specific resources and management suggestions on all new patients, augmented by two brief educational sessions for primary care housestaff. At 6 months of follow-up, physical function was not improved; however, emotional well-being and social activities that were limited because of health improved in the experimental group (309 patients and 40 physicians) but not in the control group. The lack of improvement in physical functional status observed in these studies may have been caused by the stability of disease in the participants, the timing of the provision of information, insensitive or inappropriate outcome measures, the lack of an effective intervention, the ignorance of physicians on how to use the information, or the possibly mistaken premise that the information is useful at all.
Physical function may not be the most appropriate end point. In the musculoskeletal and rheumatic diseases, which share features with other chronic diseases, the model of disablement is a causal chain that begins with impairment at the cellular and organ level. If left untreated and uncontrolled, these derangements lead to diminished function that is perceived in varying degrees by individual persons depending on their needs, aspirations, and expectations. Functional disability instruments may also handicap one's social role. Quality-of-life instruments that measure pain, function, or social role are downstream on the causal chain, and although these issues are of tremendous relevance and importance for patients, their immediate concern is usually joint pain and associated symptoms (such as stiffness and fatigue). In rheumatoid arthritis, for example, the basic pathologic lesion is rheumatoid pannus; this causes local inflammation that leads to structural damage and pain and sets up a cascade of events that ultimately results in crippling and disability. Both the patient and the physician focus on controlling the synovitis and the symptoms; function, although important, is only one aspect of the problem and is not directly treatable. In osteoarthritis, stiffness and gradual destruction of cartilage eventually result in mechanical pain and disability. Studies show that most patients give pain the most weight in their assessment of overall function and quality of life [17], and this is reflected in the primary therapeutic strategies used by physicians. Outcome measures that can be useful to improve management tend to be simple (numeric rating scale of pain); have a physiologic basis (for example, blood pressure); are modifiable over a short period (such as temperature); serve a mnemonic function (for example, the Apgar score); and, most important, measure what the patient perceives as his or her problems [18]. Measuring function and quality of life meets fewer of these criteria than does measuring swollen, painful joints.
If disease-specific measures are to be used and useful, they must measure something relevant, important, and mutable. Functional measures and multidimensional instruments or subscales of instruments used in arthritis and musculoskeletal disease have floor or ceiling effects in their ability to detect change. Their responsiveness is a function of the patient's baseline function, the number of items on the questionnaire, or a gradation of change that addresses one end or the other of the continuum of observed function.
Psychometrically sound instruments assume that function can be measured in all patients by using the same instrument. However, a patient's reported function is determined not only by physiology but also by age, sex, motivation, social support, priorities, goals, and needs. Because function is relative, a small change may make a big difference. A small change in function may be adequate for the person's needs yet not be detectable or meet statistical norms. Measures exist to better capture patient priorities, but whether the greater resources required to administer them result in sufficiently improved validity or responsiveness remains unexplored. Moreover, these measures tend to be impractical for the large-scale data collection that would be required if this type of test were to be used. Finally, is it fair to hold physicians solely accountable for deteriorating function in a patient? Function is determined by multiple factors and is often influenced more by social and psychological factors than by health care. Even with the best care, a patient's functional status can decline.
Functional outcome measures have been proposed as quality indicators of health systems for groups of patients or populations, such as those in the Health Plan Employer Data and Information Set (HEDIS). This is an attractive application but is largely unstudied with respect to disease-specific measures. Generic and disease-specific measures are responsive to differences between groups; this means that both could be used as indicators to highlight potential areas for detailed study and quality improvement initiatives. We suspect that the information derived from the measures would be too crude to identify actionable items alone. However, systematic assessment of function to monitor patients and identify problems is a critical component of patient care, and any of the instruments discussed are useful in this regard. The doubt lies in the utility of including such measures of function in administrative databases.
The rheumatic and musculoskeletal diseases have probably seen more progress than any other disorder in the development of disease-specific, patient-derived, and patient-centered outcome measures. All of the instruments currently used have excellent psychometric properties and have been useful in clinical and health services research. The question of how and whether these measures should be incorporated into administrative databases is answered here from a logistical and conceptual point of view. We think that logistical barriers might be overcome with work, but conceptual issues remain. The evidence from randomized, controlled trials shows that these measures add little or no value to patient care. The questions of whether routine use of such outcome measures in patient care would improve outcome over longer periods, why they do not improve outcome, and how they would become more useful to clinicians are unresolved.
|
Author and Article Information
|
|---|
From Harvard Medical School and Brigham and Women's Hospital, Boston, Massachusetts.
Note: This article is one of a series of articles comprising an Annals of Internal Medicine supplement entitled "Measuring Quality, Outcomes, and Cost of Care Using Large Databases: The Sixth Regenstrief Conference." To see a complete list of the articles included in this supplement, please view its Table of Contents.
Acknowledgments: The authors thank Dr. Frederic Wolinsky for comments on an earlier draft.
Grant Support: By grant P60-36308 from the National Institutes of Health. Dr. Shadick is a recipient of an Arthritis Investigator Award from the Arthritis Foundation.
Requests for Reprints: Matthew H. Liang, MD, MPH, Division of Rheumatology, Immunology, and Allergy, Harvard Medical School, Brigham and Women's Hospital, 75 Francis Street, Boston, MA 02115.
Current Author Addresses: Drs. Liang and Shadick: Division of Rheumatology, Immunology, and Allergy, Harvard Medical School, Brigham and Women's Hospital, 75 Francis Street, Boston, MA 02115.
1. Classification of the rheumatic diseases. In: Schumacher HR, ed. Primer on the Rheumatic Diseases. Atlanta: Arthritis Foundation; 1993:81-3.
2. Karlson EW, Katz JN, Liang MH. Chronic rheumatic disorders in quality of life and pharmacoeconomics in clinical trials. In: Spilker B, ed. Quality of Life and Pharmacoeconomics in Clinical Trials. 2d ed. Philadelphia: Lippincott-Raven; 1996:1029-37.
3. Bergner M, Bobbit RA, Pollard WE, Martin DP, Gilson BS. The sickness impact profile: validation of a health status measure. Med Care. 1976; 14:57-67.
4. Chambers LW, MacDonald LA, Tugwell P, Buchanan WW, Kraag G. The McMaster Health Index Questionnaire as a measure of quality of life for patients with rheumatoid disease. J Rheumatol. 1982; 9:780-4.
5. Meenan RF, Gertman PM, Mason JH. Measuring health status in arthritis. The arthritis impact measurement scales. Arthritis Rheum. 1980; 23:146-52.
6. Fries JF, Spitz P, Kraines RG, Holman HR. Measurement of patient outcome in arthritis. Arthritis Rheum. 1980; 23:137-45.
7. Pincus T, Summey JA, Soraci SA Jr, Wallston KA, Hummon NP. Assessment of patient satisfaction in activities of daily living using a modified Stanford Health Assessment Questionnaire. Arthritis Rheum. 1983; 26:1346-53.
8. Jette AM. Functional Status Index: reliability of a chronic disease evaluation instrument. Arch Phys Med Rehabil. 1980; 61:395-401.
9. Tugwell P, Bombardier C, Buchanan WW, Goldsmith CH, Grace E, Hanna B. The MACTAR Patient Preference Disability Questionnaire-an individualized functional priority approach for assessing improvement in physical disability in clinical trials in rheumatoid arthritis. J Rheumatol. 1987; 14:446-51.
10. Lee P, Jasani MK, Dick WC, Buchanan WW. Evaluation of a functional index in rheumatoid arthritis. Scand J Rheumatol. 1973; 2:71-7.
11. Helewa A, Goldsmith CH, Smyth HA. Independent measurement of functional capacity in rheumatoid arthritis. J Rheumatol. 1982; 9:794-7.
12. Convery FR, Minteer MA, Amiel D, Connett KL. Polyarticular disability: a functional assessment. Arch Phys Med Rehabil. 1977; 58:494-9.
13. McVey LJ, Becker PM, Saltz CC, Feussner JR, Cohen HJ. Effect of a geriatric consultation team on functional status of elderly hospitalized patients. A randomized, controlled clincial trial. Ann Intern Med. 1989; 110:79-84.
14. Rubenstein LV, Calkins DR, Young RT, Cleary PD, Fink A, Kosecoff J, et al. Improving patient function: a randomized trial of functional disability screening. Ann Intern Med. 1989; 111:836-42.
15. Kazis LE, Callahan LF, Meenan RF, Pincus T. Health status reports in the care of patients with rheumatoid arthritis. J Clin Epidemiol. 1990; 43:1243-53.
16. Rubenstein LV, McCoy JM, Cope DW, Barrett PA, Hirsch SH, Messer KS, et al. Improving patient quality of life with feedback to physicians about functional status. J Gen Intern Med. 1995; 10:607-14.
17. Kazis LE, Meenan RF, Anderson JJ. Pain in the rheumatic diseases. Investigation of a key health status component. Arthritis Rheum. 1983; 26:1017-22.
18. Stucki G, Sangha O. Clinical quality measurement: putting the pieces together. Arthritis Care Res. 1996; 9:405-12.
This article has been cited by other articles:

|
 |

|
 |
 
N. E. Mayo, L. Poissant, S. Ahmed, L. Finch, J. Higgins, N. M. Salbach, J. Soicher, and S. Jaglal
Incorporating the International Classification of Functioning, Disability, and Health (ICF) into an Electronic Health Record to Create Indicators of Function: Proof of Concept Using the SF-12
J. Am. Med. Inform. Assoc.,
November 1, 2004;
11(6):
514 - 522.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
L. Huffman, C. Koopman, C. Blasey, L. Botcheva, K. E. Hill, A. S. K. Marks, I. Mcnee, M. Nichols, and J. Dyer-Friedman
A Program Evaluation Strategy in a Community-Based Behavioral Health and Education Services Agency for Children and Families
Journal of Applied Behavioral Science,
June 1, 2002;
38(2):
191 - 215.
[Abstract]
[PDF]
|
 |
|
Article
|
|
|
Services
|
|
|
Google Scholar
|
|
|
PubMed
|
|
|
|