 |
 |
|
Home |
Current Issue |
Past Issues |
In the Clinic |
ACP Journal Club |
CME |
Collections |
Audio/Video |
Mobile |
Subscribe |
Tools |
Help |
ACP Online
|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
1 October 2002 | Volume 137 Issue 7 | Pages 598-602
Diagnostic tests must be evaluated in a clinically relevant population. However, test performance often varies across population subgroups. Spectrum bias, a term commonly used to describe this heterogeneity, is typically thought to occur when diagnostic test performance varies across patient subgroups and a study of that test's performance does not adequately represent all subgroups. Yet subgroup variation is not a bias if appropriate analyses are conducted. Failure to recognize and address heterogeneity will lead to estimates of test performance that are not generalizable to the relevant clinical populations. Heterogeneity can be addressed with relatively simple stratification procedures, limited primarily by the sample size and the precision of the estimates. This paper proposes the use of the term spectrum effect, rather than spectrum bias, and outlines strategies for using stratified sensitivity and specificity estimates, likelihood ratios, and receiver-operating characteristic curves. Investigators of diagnostic tests should consider the potential for spectrum effect seriously and should address heterogeneity in their analyses. Furthermore, clinicians should consider study samples carefully to determine whether results are generalizable to their specific patient population.
Author and Article Information
From University of North Carolina at Chapel Hill, Chapel Hill, North Carolina.
Acknowledgments: The authors thank David Ransohoff, MD; Michael Pignone, MD, MPH; and Jay Kaufman, PhD, for their thoughtful comments.
Grant Support: By the University of North Carolina STD Clinical Research Center (National Institute of Allergy and Infectious Diseases grant UO131496) and the Clinical Associate Physician Program of the General Clinical Research Center (RR00046), Division of Research Resources, National Institutes of Health.
Requests for Single Reprints: William C. Miller, MD, PhD, MPH, University of North Carolina at Chapel Hill, Department of Epidemiology, CB# 7435, 2105F McGavran-Greenberg, Chapel Hill, NC 27599-7435.
Current Author Addresses: Ms. Mulherin and Dr. Miller: University of North Carolina at Chapel Hill, Department of Epidemiology, CB #7435 McGavran-Greenberg, Chapel Hill, NC 27599-7435. ACADEMIA AND CLINIC
Spectrum Bias or Spectrum Effect? Subgroup Variation in Diagnostic Test Evaluation
Related articles in Annals:
This article has been cited by other articles:
|
|
 |
|
  B. H Willis Spectrum bias--why clinicians need to be cautious when applying diagnostic test studies Fam. Pract., September 1, 2008; (2008) cmn051v1. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C. A. McNulty, M. Thomas, J. Bowen, C. Buckley, A. Charlett, D. Gelb, C. Foy, J. Sloss, and S. Smellie Interactive workshops increase chlamydia testing in primary care--a controlled study Fam. Pract., August 1, 2008; 25(4): 279 - 286. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. Toll, R Oudega, Y Vergouwe, K. Moons, and A. Hoes A new diagnostic rule for deep vein thrombosis: safety and efficiency in clinically relevant subgroups Fam. Pract., February 1, 2008; 25(1): 3 - 8. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. H. Lev CT/NIHSS Mismatch for Detection of Salvageable Brain in Acute Stroke Triage Beyond the 3-Hour Time Window: Overrated or Undervalued? Stroke, July 1, 2007; 38(7): 2028 - 2029. [Full Text] [PDF]
|
|
|
|
 |
|
 L. D. Metz, M. Beattie, R. Hom, R. F. Redberg, D. Grady, and K. E. Fleischmann The Prognostic Value of Normal Exercise Myocardial Perfusion Imaging and Exercise Echocardiography: A Meta-Analysis J. Am. Coll. Cardiol., January 16, 2007; 49(2): 227 - 237. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 F. A. Medeiros, D. Ng, L. M. Zangwill, P. A. Sample, C. Bowd, and R. N. Weinreb The Effects of Study Design and Spectrum Bias on the Evaluation of Diagnostic Accuracy of Confocal Scanning Laser Ophthalmoscopy in Glaucoma Invest. Ophthalmol. Vis. Sci., January 1, 2007; 48(1): 214 - 222. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. Coste, P. Jourdain, and J. Pouchot A Gray Zone Assigned to Inconclusive Results of Quantitative Diagnostic Tests: Application to the Use of Brain Natriuretic Peptide for Diagnosis of Heart Failure in Acute Dyspneic Patients Clin. Chem., December 1, 2006; 52(12): 2229 - 2235. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. Jeyanathan, D. C. Alexander, C. Y. Turenne, C. Girard, and M. A. Behr Evaluation of In Situ Methods Used To Detect Mycobacterium avium subsp. paratuberculosis in Samples from Patients with Crohn's Disease. J. Clin. Microbiol., August 1, 2006; 44(8): 2942 - 2950. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 L Gatta, C Ricci, A Tampieri, J Osborn, F Perna, V Bernabucci, and D Vaira Accuracy of breath tests using low doses of 13C-urea to diagnose Helicobacter pylori infection: a randomised controlled trial Gut, April 1, 2006; 55(4): 457 - 462. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
F. A. Medeiros, L. M. Zangwill, C. Bowd, P. A. Sample, and R. N. Weinreb Influence of disease severity and optic disc size on the diagnostic performance of imaging instruments in glaucoma. Invest. Ophthalmol. Vis. Sci., March 1, 2006; 47(3): 1008 - 1015. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 D. Mozaffarian Electron-Beam Computed Tomography for Coronary Calcium: A Useful Test to Screen for Coronary Heart Disease? JAMA, December 14, 2005; 294(22): 2897 - 2901. [Full Text] [PDF]
|
|
|
|
 |
|
 K G Shojania, E C Burton, K M McDonald, and L Goldman Overestimation of clinical diagnostic performance caused by low necropsy rates Qual. Saf. Health Care, December 1, 2005; 14(6): 408 - 413. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 H. H. Feldman and C. Jacova Mild Cognitive Impairment Am J Geriatr Psychiatry, August 1, 2005; 13(8): 645 - 655. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. Marx, D. Pewsner, M. Egger, R. Nuesch, H. C. Bucher, B. Genton, C. Hatz, and P. Juni Meta-Analysis: Accuracy of Rapid Tests for Malaria in Travelers Returning from Endemic Areas Ann Intern Med, May 17, 2005; 142(10): 836 - 846. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. B. Edmonson and K. R. Farwell Relationship Between the Clinical Likelihood of Group A Streptococcal Pharyngitis and the Sensitivity of a Rapid Antigen-Detection Test in a Pediatric Practice Pediatrics, February 1, 2005; 115(2): 280 - 285. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. Tonelli, D. J. Hirsch, C. T. Chan, J. Marryatt, P. Mossop, C. Wile, and K. Jindal Factors associated with access blood flow in native vessel arteriovenous fistulae Nephrol. Dial. Transplant., October 1, 2004; 19(10): 2559 - 2563. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. Swarr and R. Keren Comparison of Alternative Diagnostic Approaches for Managing Appendicitis in Children: The Effect of Disease Prevalence and Spectrum Pediatrics, August 1, 2004; 114(2): 513 - 514. [Full Text] [PDF]
|
|
|
|
|
|
M. C. Hall, B. Kieke, R. Gonzales, and E. A. Belongia Spectrum Bias of a Rapid Antigen Detection Test for Group A {beta}-Hemolytic Streptococcal Pharyngitis in a Pediatric Population Pediatrics, July 1, 2004; 114(1): 182 - 186. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. W. Heim, J. M. Schectman, M. S. Siadaty, and J. T. Philbrick D-Dimer Testing for Deep Venous Thrombosis: A Metaanalysis Clin. Chem., July 1, 2004; 50(7): 1136 - 1147. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 G. Zou From Diagnostic Accuracy to Accurate Diagnosis: Interpreting a Test Result with Confidence Med Decis Making, June 1, 2004; 24(3): 313 - 318. [Abstract] [PDF]
|
|
|
|
|
|
M. I. Weintraub Magnets for Patients With Heel Pain JAMA, January 7, 2004; 291(1): 43 - 44. [Full Text] [PDF]
|
|
|
|
|
|
R. A. Deyo and J. J. Jarvik New Diagnostic Tests: Breakthrough Approaches or Expensive Add-ons? Ann Intern Med, December 2, 2003; 139(11): 950 - 951. [Full Text] [PDF]
|
|
|
|
 |
|
 M. Tonelli, G. S. Jhangri, D. J. Hirsch, J. Marryatt, P. Mossop, C. Wile, and K. K. Jindal Best Threshold for Diagnosis of Stenosis or Thrombosis within Six Months of Access Flow Measurement in Arteriovenous Fistulae J. Am. Soc. Nephrol., December 1, 2003; 14(12): 3264 - 3269. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R. Rothman, T. Owens, and D. L. Simel Does This Child Have Acute Otitis Media? JAMA, September 24, 2003; 290(12): 1633 - 1640. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. T. Evans Subgroup Variation in Diagnostic Test Evaluation Ann Intern Med, April 15, 2003; 138(8): 686 - 686. [Full Text] [PDF]
|
|
|
|
|
|
R. R. Scobbo Subgroup Variation in Diagnostic Test Evaluation Ann Intern Med, April 15, 2003; 138(8): 686 - 686. [Full Text] [PDF]
|
|
|
|
|
|
R. L. Trowbridge, N. K. Rutkowski, and K. G. Shojania Does This Patient Have Acute Cholecystitis? JAMA, January 1, 2003; 289(1): 80 - 86. [Abstract] [Full Text] [PDF]
|
|
Article
