Annals
Established in 1927 by the American College of Physicians
:
Advanced search
box Article
 arrow  Table of Contents                
space
 arrow  Full Text of this article
space
 arrow  PDF of this article
(PDFs free after 6 months)
space
 arrow  Figures/Tables List
space
 arrow  Related articles in Annals
space
box Services
 arrow  Send comment/rapid response letter
space
 arrow  Published comments/rapid response letters
space
 arrow  Notify a friend about this article
space
 arrow  Alert me when this article is cited
space
 arrow  Add to Personal Archive
space
 arrow  Download to Citation Manager
space
 arrow  ACP Search
space
 arrow  Get Permissions
space
box Google Scholar
 arrow  Search for Related Content
space
box Social Bookmarking
 Add to CiteULike Add to Complore Add to Connotea Add to Del.icio.us Add to Digg Add to Facebook Add to Reddit Add to Technorati Add to Twitter
What's this?
box PubMed
Articles in PubMed by Author:
 arrow  Janes, H.
space
 arrow  Gu, W.
space
 arrow  Related Articles in PubMed
space
 arrow  PubMed Citation
space
 arrow  PubMed
space

ACADEMIA AND CLINIC

Assessing the Value of Risk Predictions by Using Risk Stratification Tables

right arrow Holly Janes, PhD; Margaret S. Pepe, PhD; and Wen Gu, MS

18 November 2008 | Volume 149 Issue 10 | Pages 751-760

The recent epidemiologic and clinical literature is filled with studies evaluating statistical models for predicting disease or some other adverse event. Risk stratification tables are a new way to evaluate the benefit of adding a new risk marker to a risk prediction model that includes an established set of markers. This approach involves cross-tabulating risk predictions from models with and without the new marker. In this article, the authors use examples to show how risk stratification tables can be used to compare 3 important measures of model performance between the models with and those without the new marker: the extent to which the risks calculated from the models reflect the actual fraction of persons in the population with events (calibration); the proportions in which the population is stratified into clinically relevant risk categories (stratification capacity); and the extent to which participants with events are assigned to high-risk categories and those without events are assigned to low-risk categories (classification accuracy). They detail common misinterpretations and misuses of the risk stratification method and conclude that the information that can be extracted from risk stratification tables is an enormous improvement over commonly reported measures of risk prediction model performance (for example, c-statistics and Hosmer–Lemeshow tests) because it describes the value of the models for guiding medical decisions.

Author and Article Information


From the Fred Hutchinson Cancer Research Center and the University of Washington, Seattle, Washington.

Acknowledgment: The authors thank Patrick Bossuyt for very helpful discussions of the material.

Potential Financial Conflicts of Interest: None disclosed.

Requests for Single Reprints: Holly Janes, PhD, Fred Hutchinson Cancer Research Center; 1100 Fairview Avenue North M2-C200, Seattle, WA 98109; e-mail, hjanes{at}scharp.org.

Current Author Addresses: Drs. Janes and Pepe: Fred Hutchinson Cancer Research Center, 1100 Fairview Avenue North, Seattle, WA 98109.

Dr. Gu: Department of Biostatistics, University of Washington, Box 357232, Seattle, WA 98195.

 

Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Facebook Facebook   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter    What's this?

Related articles in Annals:

Letters
Are Risk Stratification Tables the Best Way to Evaluate Model Performance?
Ralph H. Stern AND Dean E. Smith
Annals 2009 150: 427-428. [Full Text]  

Letters
Are Risk Stratification Tables the Best Way to Evaluate Model Performance?
Holly Janes, Margaret S. Pepe, AND Wen Gu
Annals 2009 150: 428. [Full Text]  



This article has been cited by other articles:


Home page
JAMAHome page
O. Melander, C. Newton-Cheh, P. Almgren, B. Hedblad, G. Berglund, G. Engstrom, M. Persson, J. G. Smith, M. Magnusson, A. Christensson, et al.
Novel and Conventional Biomarkers for Prediction of Incident Cardiovascular Events in the Community
JAMA, July 1, 2009; 302(1): 49 - 57.
[Abstract] [Full Text] [PDF]


Home page
JNCI J Natl Cancer InstHome page
M. H. Gail
Value of Adding Single-Nucleotide Polymorphism Genotypes to a Breast Cancer Risk Model
J Natl Cancer Inst, July 1, 2009; 101(13): 959 - 963.
[Abstract] [Full Text] [PDF]


Home page
ANN INTERN MEDHome page
N. R. Cook and P. M Ridker
Advances in Measuring the Effect of Individual Predictors of Cardiovascular Risk: The Role of Reclassification Measures
Ann Intern Med, June 2, 2009; 150(11): 795 - 802.
[Abstract] [Full Text] [PDF]


Home page
ANN INTERN MEDHome page
R. H. Stern and D. E. Smith
Are Risk Stratification Tables the Best Way to Evaluate Model Performance?
Ann Intern Med, March 17, 2009; 150(6): 427 - 428.
[Full Text] [PDF]

Rapid Responses:

Read all Rapid Responses

Comments on Risk Stratification Table Paper
Ralph H. Stern, et al.
Annals Online, 12 Dec 2008 [Full text]
Response to Dr. Stern: “Assessing the Value of Risk Predictions by Using Risk-Stratification Tables
Holly Janes, et al.
Annals Online, 14 Jan 2009 [Full text]



 Home | Current Issue | Past Issues | In the Clinic | ACP Journal Club | CME | Collections | Audio/Video | Mobile | Subscribe | Tools | Help | ACP Online 

Copyright © 2008 by the American College of Physicians.