|
|
|
| ||||||||||||||||||||||||||||||||||||||||||||
18 November 2008 | Volume 149 Issue 10 | Pages 751-760
The recent epidemiologic and clinical literature is filled with studies evaluating statistical models for predicting disease or some other adverse event. Risk stratification tables are a new way to evaluate the benefit of adding a new risk marker to a risk prediction model that includes an established set of markers. This approach involves cross-tabulating risk predictions from models with and without the new marker. In this article, the authors use examples to show how risk stratification tables can be used to compare 3 important measures of model performance between the models with and those without the new marker: the extent to which the risks calculated from the models reflect the actual fraction of persons in the population with events (calibration); the proportions in which the population is stratified into clinically relevant risk categories (stratification capacity); and the extent to which participants with events are assigned to high-risk categories and those without events are assigned to low-risk categories (classification accuracy). They detail common misinterpretations and misuses of the risk stratification method and conclude that the information that can be extracted from risk stratification tables is an enormous improvement over commonly reported measures of risk prediction model performance (for example, c-statistics and Hosmer–Lemeshow tests) because it describes the value of the models for guiding medical decisions.
Author and Article Information
From the Fred Hutchinson Cancer Research Center and the University of Washington, Seattle, Washington.
Acknowledgment: The authors thank Patrick Bossuyt for very helpful discussions of the material.
Potential Financial Conflicts of Interest: None disclosed.
Requests for Single Reprints: Holly Janes, PhD, Fred Hutchinson Cancer Research Center; 1100 Fairview Avenue North M2-C200, Seattle, WA 98109; e-mail, hjanes{at}scharp.org.
Current Author Addresses: Drs. Janes and Pepe: Fred Hutchinson Cancer Research Center, 1100 Fairview Avenue North, Seattle, WA 98109.
Dr. Gu: Department of Biostatistics, University of Washington, Box 357232, Seattle, WA 98195. ACADEMIA AND CLINIC
Assessing the Value of Risk Predictions by Using Risk Stratification Tables
Related articles in Annals:
This article has been cited by other articles:
![]() |
O. Melander, C. Newton-Cheh, P. Almgren, B. Hedblad, G. Berglund, G. Engstrom, M. Persson, J. G. Smith, M. Magnusson, A. Christensson, et al. Novel and Conventional Biomarkers for Prediction of Incident Cardiovascular Events in the Community JAMA, July 1, 2009; 302(1): 49 - 57. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. H. Gail Value of Adding Single-Nucleotide Polymorphism Genotypes to a Breast Cancer Risk Model J Natl Cancer Inst, July 1, 2009; 101(13): 959 - 963. [Abstract] [Full Text] [PDF] |
||||
![]() |
N. R. Cook and P. M Ridker Advances in Measuring the Effect of Individual Predictors of Cardiovascular Risk: The Role of Reclassification Measures Ann Intern Med, June 2, 2009; 150(11): 795 - 802. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. H. Stern and D. E. Smith Are Risk Stratification Tables the Best Way to Evaluate Model Performance? Ann Intern Med, March 17, 2009; 150(6): 427 - 428. [Full Text] [PDF] |
||||
Read all Rapid Responses