Annals
Established in 1927 by the American College of Physicians
:
Advanced search
 
box Article
 arrow  Table of Contents                
space
box Services
 arrow  Send comment/rapid response letter
space
 arrow  Notify a friend about this article
space
 arrow  Alert me when this article is cited
space
 arrow  Add to Personal Archive
space
 arrow  Download to Citation Manager
space
 arrow  ACP Search                        
space
 arrow  Get Permissions
space
box Google Scholar
 arrow  Search for Related Content
space
box PubMed
Articles in PubMed by Author:
  arrow  Jollis, J. G.
space
 arrow  PubMed                        
space

REPLY

Utility and Limitations of Claims Data

right arrow James G. Jollis, MD

15 June 1994 | Volume 120 Issue 12 | Pages 1049-1051


IN RESPONSE:

We agree with Drs. Baron and Barrett that including procedure codes or linking claims records from multiple encounters may enhance the sensitivity of claims data for clinical conditions. The "much better results" they mention, however, have yet to be shown. Recently, Roos and colleagues [1] compared claims data from a single hospitalization with data collected from all medical encounters during the previous 6 months in Manitoba for 677 patients having prostatectomy. Despite the universal nature of the Canadian claims system, the additional data in the "claims history" did not significantly improve its sensitivity for clinically identified conditions, increasing sensitivity from 0.43 to 0.51 for cardiovascular disease and from 0.32 to 0.37 for respiratory disease. In our study, we chose to examine the accuracy of single-encounter data, the form used in most research in this area. We also agree with Drs. Baron and Barrett that claims data are suitable for certain types of epidemiologic studies.

We agree with Dr. Huff's concern about generalizability of the findings at Duke to other settings, and we specifically noted this limitation in our paper. During our study, we tried to find data that compared medical record coding at Duke with that at other institutions. The current minimal quality control of claims data and the lack of available information about the result of such quality control from different institutions raise further concerns about the use of hospital claims data to specify illness severity. We do not have reason to believe that medical record coding at Duke differs substantially from that at other institutions. The hospital follows standard guidelines and procedures for medical record coding [2]. In our study, we used hospital claims data containing up to 30 diagnosis codes rather than the standard Medicare data set that was truncated at 5 diagnoses. Most of the episodes of "intensified review" at Duke resulted from errors in billing procedures rather than in coding, such as claims for dental extractions, a procedure not reimbursed by the North Carolina Medicare intermediary. We also agree that patients having cardiac catheterization may have fewer comorbid illnesses due to selection bias. If claims data have a low specificity for comorbidity in these patients, however, we are still concerned about their use in patients with potentially more comorbid illnesses. Regarding Dr. Huff's concern about the "claimed riches" from the Duke data, we refer him to the article by Hlatky and colleagues [3], in which the findings from the major randomized trials of coronary bypass surgery were duplicated in the Duke data.

The article by Drs. Green and Wintfeld extends our work, showing that coding errors in California claims may result in misclassification of more than 50% of hospitals identified as "outliers" [4]. If these investigators had access to concurrently collected clinical data rather than only to repeat chart abstraction, we suspect that the magnitude of the hospital mortality estimate bias would have been even greater. Dr. Prochazka's observations also support the need for improved clinical data systems specifically designed for treatment comparisons.

Finally, we feel that the burden of proof concerning the accuracy of claims data rests with those who use such data to test hypotheses and to draw conclusions. Our study simply points out the results of one such examination relative to our database.


Author and Article Information
space
up arrowTop
dotAuthor & Article Info
down arrowReferences

Duke University Medical Center; Durham, NC 27710


References
space
up arrowTop
up arrowAuthor & Article Info
dotReferences

1. Roos LL, Sharp SM, Cohen MM. Comparing clinical information with claims data: some similarities and differences. J Clin Epidemiol. 1991; 44:881-8.

2. Brown F. ICD-9-CM Coding Handbook, with Answers. Chicago: American Hospital Publishing, Inc.; 1989.

3. Hlatky MA, Califf RM, Harrell FE, Lee KL, Mark DB, Pryor DB. Comparison of predictions based on observational data with the results of randomized controlled clinical trials of coronary bypass surgery. J Am Coll Cardiol. 1988; 11:237-45.

4. Green J, Wintfeld N. How accurate are hospital discharge data for evaluating effectiveness of care? Med Care. 1993; 31:719-31.

About Letters
space

The Editors welcome submissions for possible publication in the Letters section. Authors of letters should:

•Include no more than 300 words of text, three authors, and five references

•Type with double-spacing

•Send three copies of the letter, an authors' form signed by all authors, and a cover letter describing any conflicts of interest related to the contents of the letter.

Letters commenting on an Annals article will be considered if they are received within 6 weeks of the time the article was published. Only some of the letters received can be published. Published letters are edited and may be shortened; tables and figures are included only selectively. Authors will be notified that the letter has been received. If the letter is selected for publication, the author will be notified about 3 weeks before the publication date. Unpublished letters cannot be returned.

Annals welcomes electronically submitted letters.





box Article
 arrow  Table of Contents                
space
box Services
 arrow  Send comment/rapid response letter
space
 arrow  Notify a friend about this article
space
 arrow  Alert me when this article is cited
space
 arrow  Add to Personal Archive
space
 arrow  Download to Citation Manager
space
 arrow  ACP Search                        
space
 arrow  Get Permissions
space
box Google Scholar
 arrow  Search for Related Content
space
box PubMed
Articles in PubMed by Author:
  arrow  Jollis, J. G.
space
 arrow  PubMed                        
space


 Home | Current Issue | Past Issues | In the Clinic | ACP Journal Club | CME | Collections | Audio/Video | Mobile | Subscribe | Tools | Help | ACP Online