Home |
Current Issue |
Past Issues |
In the Clinic |
ACP Journal Club |
CME |
Collections |
Audio/Video |
Mobile |
Subscribe |
Tools |
Help |
ACP Online
|
1 October 1997 | Volume 127 Issue 7 | Pages 538-556
Background: Thrombolytic therapy can be life-saving in patients with acute myocardial infarction. However, if given too late or insufficiently selectively, it may provide little benefit but still cause serious complications and incur substantial costs.
Objective: To develop a thrombolytic predictive instrument for real-time use in emergency medical service settings that could 1) identify patients likely to benefit from thrombolysis and 2) facilitate the earliest possible use of this therapy.
Design: Creation and validation of logistic regression-based predictive instruments based on secondary analysis of clinical data.
Patients: 4911 patients who had acute myocardial infarction and ST-segment elevation on electrocardiogram; 3483 received thrombolytic therapy.
Measurements: Data were obtained from 13 major clinical trials and registries and directly from medical records, including electrocardiograms obtained at presentation. Input variables include presenting clinical and electrocardiographic features; predictive models generate probabilities for acute (30-day) mortality if and if not treated with thrombolysis, 1-year mortality rates if and if not treated with thrombolysis, cardiac arrest if and if not treated with thrombolysis, thrombolysis-related intracranial hemorrhage, and thrombolysis-related major bleeding episode requiring transfusion. Together, these models constitute the thrombolytic predictive instrument.
Results: The predictive models generated the following mean predictions for patients in the Thrombolytic Predictive Instrument Database: 30-day mortality rate, 7.1%; 1-year mortality rate, 10.9%; rate of cardiac arrest, 3.7%; rate of thrombolysis-related intracranial hemorrhage, 0.6%; and rate of other thrombolysis-related major bleeding episodes, 5.0%. They discriminated well between persons having and those not having the predicted outcome; areas under the receiver-operating characteristic (ROC) curve were between 0.77 and 0.84 for the five outcomes. Calibration between each instrument's predicted and observed rates was excellent. Validation of the predictive instruments for 30-day and 1-year mortality, done on a separate test dataset, yielded areas under the ROC curve of 0.76 for each.
Conclusions: After the basic features of a clinical presentation are entered into a computerized electrocardiograph, the predictions of the thrombolytic predictive instrument can be printed on the electrocardiogram report. This decision aid may facilitate earlier and more appropriate use of thrombolytic therapy in patients with acute myocardial infarction.
Predictive instruments for acute cardiac ischemia have been developed to assist emergency department physicians in making admission decisions for the hospital and coronary care unit [1-4]. These logistic regression predictive models use a patient's clinical and electrocardiographic characteristics at presentation to compute the probability of acute ischemia. Incorporated into a computerized electrocardiograph, the probability can be printed automatically on the electrocardiogram [3-5]. Clinical trials have shown that this decision aid speeds [6] and improves the accuracy of [7] emergency department triage of patients presenting with chest pain or other symptoms that suggest cardiac ischemia. Thus, printing the probabilities of predictive instruments on electrocardiograms may be an effective way to provide decision support to physicians.
An electrocardiograph-based instrument that could provide emergency clinicians with real-time predictions of outcomes of thrombolytic therapy for acute infarction might also improve care. Unfortunately, the currently available predictive instrument for death from acute infarction [8] does not take into account the use of thrombolytic therapy, nor does it predict outcomes other than acute mortality.
The major purpose of our study was to create a thrombolytic predictive instrument that would predict, for an individual patient, the effect of thrombolysis on the likelihood of key clinical outcomes: acute mortality, long-term mortality, cardiac arrest, and serious complications of thrombolytic therapy [hemorrhagic stroke and major bleeding]. Incorporating this model into a computerized electrocardiograph so that its predictions are automatically printed on the electrocardiogram could help physicians 1) identify the patients most likely to benefit from thrombolytic therapy and 2) facilitate their earliest possible treatment. A secondary purpose was to produce a "time-insensitive" predictive instrument [4, 8-10] that could provide risk-adjusted outcome predictions for retrospectively judging quality of care.
Phase One: Creation of the Thrombolytic Predictive Instrument Database
The Thrombolytic Predictive Instrument Database and its derivative development and validation data sets included the original data on patients with myocardial infarction from 13 clinical trials and registries [1, 2, 11-22]. Individual studies contributed between 57 and 1387 patients each; together, they included 107 hospitals of all types throughout the United States and 4911 patients treated between 1976 and 1989 (91% were treated after 1980).
Because the individual trials and registries used different inclusion and exclusion criteria, we created uniform criteria for inclusion in the Thrombolytic Predictive Instrument Database. All trials of thrombolytic therapy used similar enrollment criteria, but registries and the acute ischemia predictive instrument trials used broader criteria. The database was restricted to persons who would have been prospectively included in the thrombolytic trials: Persons who were 75 years of age or younger, had onset of chest pain or other ischemic symptoms of acute ischemia within 9 hours of presentation, had systolic blood pressure of 190 mm Hg or less, had ST-segment elevation of 1 mm (0.1 mV) or more in at least two contiguous leads on electrocardiogram, and had no known contraindications to thrombolytic therapy. The steps involved in generating specific data sets for each component predictive instrument are shown in the Appendix Figure. ACADEMIA AND CLINIC
Patient-Specific Predictions of Outcomes in Myocardial Infarction for Real-Time Emergency Use: A Thrombolytic Predictive Instrument
Thrombolytic therapy for acute myocardial infarction has great potential for reducing this most common cause of death in the United States. However, the benefits of this therapy depend on treating appropriate candidates as early as possible. Beyond the early hours and in patients with very small or low-risk infarctions, thrombolytic treatment offers little likelihood of benefit yet still incurs the risk for complications and costs. Many patients who would benefit from thrombolysis are not being treated because they are not recognized as suitable candidates and because of the fear of complications. To broadly maximize the benefit of thrombolytic therapy, a real-time method is needed in the emergency clinical setting that 1) identifies patients most likely to benefit from thrombolytic therapy and 2) facilitates the earliest possible administration of this therapy.
Methods
![]()
Top
Methods
Results
Discussion
Author & Article Info
References
Creation of the thrombolytic predictive instrument required component predictive instruments that would predict the probabilities of five outcomes for a given patient with ST-segment elevation of at least 1 mm [0.1 mV] in two or more leads on the electrocardiogram. These were 1) acute [30-day] mortality from acute infarction if given and if not given thrombolytic therapy; 2) long-term [1-year] mortality if given and if not given thrombolytic therapy; 3) cardiac arrest within 48 hours after the first electrocardiogram if given and if not given thrombolytic therapy; 4) intracranial hemorrhage as a complication, if given thrombolytic therapy; and 5) bleeding that necessitates transfusion, if given thrombolytic therapy. These models were constructed and tested in three phases.
|
For all patients in the database, we obtained electrocardiograms from the time of first presentation and follow-up and uniformly coded them lead-by-lead by using standardized measurement criteria [23]. Important missing data were obtained from original study and hospital records. Missing data on 30-day and 1-year mortality were obtained from the National Death Index. Original hospital records were reviewed for the data needed to confirm the intracranial hemorrhage and cardiac arrest component predictive instruments [11]. For the data needed to create the intracranial hemorrhage, detailed medical record reviews were done for all 59 thrombolysis-treated patients who were designated by their original studies as having had a stroke and for 216 control patients, matched by hospital, who are described elsewhere [24]. For the data needed to construct the cardiac arrest, medical records were reviewed for 428 patients recorded as having had a cardiac arrest and for 428 control patients matched by hospital. Medical records were available for 85% of these patients; data obtained from the medical records included presenting electrolyte concentrations; electrocardiogram details, including corrected QT intervals [25]; details of any invasive procedures; and details of the possible cardiac arrest.
Finally, data from the participating studies were compared for consistency of known major effects on outcomes [11]. One subset, the Duke Coronary Care Unit Database from the prethrombolytic era, had substantially sicker patients who were much more likely to have previously had infarctions; thus, this subset was not included in the final model development or in test sets.
Before the mortality models were constructed, the database was randomly divided into a development data set, which consisted of two thirds of all patients (n = 3263), and a test data set, which consisted of the remaining one third (n = 1648). Patients were randomly assigned to one data set or the other; stratification was done on study of origin to ensure that similar proportions of patients from the contributing studies were assigned to the development and test sets. For the cardiac arrest, intracranial hemorrhage, and major bleeding models, all patients were used for development.
Phase Two: Construction of the Thrombolytic Predictive Instrument
A separate predictive instrument, each designed to be a component of the thrombolytic predictive instrument, was developed for each of the five outcomes by using logistic regression. For each component predictive instrument, we selected a subset of clinically important and statistically significant variables for inclusion in preliminary regression models. We then investigated alternative forms and combinations of these variables, reformulating models to optimize performance while keeping the models as parsimonious as possible.
In this process, we created two special electrocardiogram-based variables to reflect two key determinants of the effect of thrombolytic therapy on outcome: a measure of acute infarction size based on ST segments and an indicator of "earliness" in the course of the acute infarction, based on T-wave changes (Appendices A and B).
The logistic model for the 30-day mortality instrument was constructed on 1568 patients, 1224 of whom received thrombolytic therapy (Appendix Figure, panel A). The 1-year mortality instrument was based on the 1237 patients (894 of whom received thrombolytic therapy) for whom 1-year follow-up information was available (Appendix Figure, panel B). Patients who died during their index hospitalization were classified as dead at 30 days, even if their hospital stay was longer than 30 days.
The model for the cardiac arrest component predictive instrument was based on 296 patients, 61 of whom had confirmed primary cardiac arrests (defined as sudden loss of consciousness associated with ventricular tachycardia or fibrillation requiring cardioversion or cardiopulmonary resuscitation within 48 hours of admission) and 221 of whom received thrombolytic therapy (Appendix Figure, panel C). Patients originally considered to have possibly had a cardiac arrest were excluded if the cardiac arrest was thought to have occurred before admission, after coronary artery bypass surgery, after progressive hemodynamic deterioration of more than 1 hour or presentation while in cardiogenic shock (Killip class IV), or during catheter manipulations associated with cardiac catheterization or if the cardiac arrest was not confirmed upon record review. Control patients were excluded because of missing data or failure to satisfy inclusion criteria.
The thrombolysis-related intracranial hemorrhage component predictive instrument was based on 190 patients (18 with intracranial hemorrhage) [24] (Appendix Figure, panel D). Patients who had a history of stroke, seizure, or recent head trauma or had systolic blood pressure greater than 190 mm Hg were not used for modeling.
The thrombolysis-related major (transfusion-requiring) bleed component predictive instrument was based on 740 patients for whom sufficient detail of predictors and outcomes of bleeding was available (74% of these patients underwent coronary angiography), 55 of whom received a transfusion within 72 hours of arrival at the emergency department (Appendix Figure, panel E). Patients who underwent coronary artery bypass surgery or had intracranial bleeding episodes were excluded.
Phase Three: Validation of Mortality Predictive Instruments on the Test Data Set
After they were developed, the 30-day and the 1-year mortality component predictive instruments were tested on the subset of the database set aside for this purpose before model construction.
Statistical Analysis
Logistic regression models were constructed by using SAS software [26]; nonlinear terms and interactions were investigated by generalized additive spline models in S-PLUS [27, 28]. The significance of individual variables in the final logistic regression model was based on the Wald statistic (two-sided).
The performance of component predictive instruments was evaluated by the area under the receiver-operating characteristic (ROC) curve [29] (a measure of a prediction's diagnostic performance over its entire 0% to 100% range) and calibration (the match of predicted and observed outcomes calculated across groups with different likelihoods of the outcomes, using deciles [mortality and bleed models] or quartiles [intracranial hemorrhage and cardiac arrest] of predicted risk).
Because some persons who received thrombolytic therapy had their cardiac arrest before they received the treatment, standard logistic regression (which does not account for time-related changes in risk during the prediction period) was not appropriate for the cardiac arrest component predictive instrument. We therefore used pooled logistic regression [30] instead, dividing the 48-hour time-at-risk into nine intervals and then computing for each patient the total risk based on the nine interval-specific probabilities for cardiac arrest generated by logistic regression [31]. The effect of thrombolytic therapy was thereby assigned only to intervals during or after treatment was given. Like a Cox proportional-hazards model with a time-dependent covariate, the cumulative probability of cardiac arrest was computed by combining the interval-specific probabilities. For this model, area under the ROC curve and calibration were based on the interval-specific probabilities.
Because the component predictive instruments for cardiac arrest, intracranial hemorrhage, and bleeding complications were created on special subsets of the Thrombolytic Predictive Instrument Database, their regression constants (intercepts) were adjusted so that the average of the corrected predicted probabilities equaled the incidences of these events among all patients in the full database: 0.6% for intracranial hemorrhage, 5.0% for major bleeding complication, and 4.5% for cardiac arrest among control patients. We made the standard assumption that the model was otherwise unchanged by the casecontrol sampling. For calibration of these models, however, we compared the observed incidence rates in the casecontrol sample to the unadjusted predicted probabilities.
Results
|
|---|
|
|
|---|
|
The formulas and variable definitions for each thrombolytic predictive instrument component predictive instrument are shown in Appendices A and B; their clinical variables are described below.
Description and Performance of Component Predictive Instruments
Acute 30-Day Mortality Component Predictive Instrument
The acute [30-day] mortality component predictive instrument was based on 10 presenting variables: 1) age; 2) history of diabetes; 3) systolic blood pressure conditioned on the infarction location; 4) heart rate; 5) location of the acute infarction; 6) size of the acute infarction on electrocardiogram, measured by number of leads and degree of ST-segment elevation (Appendices A and B; 7) the number of contiguous leads with abnormal Q waves (in patients with nonanterior infarction) [32] without significant ST-segment elevation; 8) right bundle-branch block; 9) systolic blood pressure; and 10) the use of thrombolytic therapy conditioned on an electrocardiogram-based infarction Earliness Index (Appendices A and B) combined with time since onset of ischemic symptoms.
The probability of dying calculated by the acute mortality component predictive instrument varied depending on the patient's characteristics. The top panel of Figure 1 shows that anterior infarction, increasing age, and not using thrombolytic therapy were all associated with increased risk for death within 30 days. Among Thrombolytic Predictive Instrument Database patients, predicted probabilities of dying within 30 days ranged from 0.2% to 80.4%. The mean ±SD was 7.1% ± 9.7%. For patients who were given thrombolytic therapy, the mean probability was 6.2% ± 8.6%; for those who were not given thrombolytic therapy, the probability was 10.6% ± 12.1%. The area under the ROC curve was 0.84 on the development set and 0.76 on the test data set. The lower value on the test data set seemed to result from the presence of lower risk among patients with increasing age and lower initial systolic blood pressure. Final model coefficients (Appendices A and B) were derived on the combined development and test data sets (n = 2369). The calibration curve in the bottom panel of Figure 1 shows the match between predicted and actual 30-day mortality rates across the entire range of infarction severity. On the combined dataset, the area under the ROC curve for this model was 0.82 (95% CI, 0.78 to 0.86).
|
One-Year Mortality Component Predictive Instrument
The predictions of the 1-year mortality component predictive instrument are based on combining the predictions of the 30-day mortality model for month 1 of the year with the predictions of a "post-30-day" model that reflects mortality in months 2 through 12. The post-30-day model is based on five presenting clinical variables: age, heart rate, anterior location of the acute infarction, number of electrocardiogram leads with abnormal Q waves, and right bundle-branch block.
The top panel of Figure 2 shows the predicted risk for death within 1 year, related to patient age, infarction location, and use of thrombolytic therapy. Predicted 1-year mortality for the Thrombolytic Predictive Instrument Database patients ranged from 1.2% to 86.9%. The mean predicted 1-year mortality rate was 10.9% ± 12%; for patients who were given thrombolytic therapy, the rate was 9.5% ± 10.5%; and for patients who were not given thrombolytic therapy, the rate was 14.7% ± 14.6%. Calibration is shown in the bottom panel of Figure 2. The area under the ROC curve was 0.82 on the development set, 0.76 on the test data set, and 0.80 (CI, 0.76 to 0.83) on the combined data sets.
|
Cardiac Arrest Component Predictive Instrument
The cardiac arrest component predictive instrument was based on 1) variables representing nine distinct time intervals since the onset of chest pain, 2) age, 3) systolic blood pressure, 4) electrocardiogram-based size of infarction [slightly different from that in the mortality models], 5) sum of ST-segment elevation, 6) corrected QT interval, and 7) use of thrombolytic therapy. The effects of corrected QT interval and ST-segment elevation varied in time from symptom onset.
The top panel of Figure 3 shows the predicted impact of thrombolytic therapy on cardiac arrest during the first 48 hours after presentation. The predicted probabilities for cardiac arrest in Thrombolytic Predictive Instrument Database patients ranged from 0% to 53%. The mean probabilities were 3.7% ± 4.8% overall, 2.9% ± 2.9% for patients receiving thrombolytic therapy, 5.4% ± 7.2% for patients who did not receive thrombolytic therapy (including intended recipients of thrombolytic therapy who had cardiac arrest before it was given), and 4.5% ± 7.1% for patients for whom thrombolytic therapy was never intended. Calibration is shown in the bottom panel of Figure 3. The area under the ROC curve on the development set was 0.77 (CI, 0.69 to 0.85).
|
Thrombolysis-Related Intracranial Hemorrhage Component Predictive Instrument
The thrombolysis-related intracranial hemorrhage component predictive instrument was developed by using age and excess pulse pressure (defined as the amount by which the pulse pressure [systolic pressure minus diastolic pressure] exceeds 40 mm Hg for patients with systolic blood pressures greater than 120 mm Hg) [24]. Because data were sparse for patients with very high blood pressures, excess pulse pressure was truncated at 35 in the model.
Shown in the top panel of Figure 4, this instrument predicts increasing risk for thrombolysis-related intracranial hemorrhage for patients with pulse pressures greater than 40 mm Hg, especially those with advancing age. Predicted risk for thrombolysis-related intracranial hemorrhage among treated Thrombolytic Predictive Instrument Database patients ranged from 0% to 4.4% (mean, 0.6% ± 0.8%). Calibration is shown in the bottom panel of Figure 4; the area under the ROC curve on the development set was 0.82 (CI, 0.68 to 0.96).
|
Thrombolysis-Related Major Bleed Component Predictive Instrument
The thrombolysis-related major (transfusion-requiring) bleed component predictive instrument was developed by using age, sex, history of hypertension, dose of thrombolytic therapy adjusted by weight, systolic blood pressure, an interaction of sex with adjusted dose of thrombolytic therapy, and an interaction of low heart rate with low systolic blood pressure.
Shown in the top panel of Figure 5, this component predictive instrument computed risks for major bleeding that were higher for women than men and (for those who weighed < 70 kg) were higher with a standard dose of the thrombolytic agent than with a weight-adjusted dose. Predicted probabilities for major bleeding among treated Thrombolytic Predictive Instrument Database patients ranged from 0.1% to 87.8% (mean, 5.0% ± 9.4%). Calibration is shown in the bottom panel of Figure 5. The area under the ROC curve on the development set was 0.83 (CI, 0.75 to 0.91).
|
Application of the Thrombolytic Predictive Instrument: Case Examples
The combined presentation of the component predictive instruments, as intended for clinical use on electrocardiograms, is shown in Figure 6.
|
The electrocardiogram in the top panel of Figure 6 shows predictions for a 57-year-old man who presented to the emergency department 2 hours after the onset of chest pain with a blood pressure of 156/88 mm Hg, a history of diabetes and hypertension, and ST-segment elevation. The specific values of these and other thrombolytic predictive instrument variables, and the resulting predictions, are printed on the electrocardiogram header. The model predicts that thrombolysis will reduce the probabilities of acute mortality (from 9.3% to 4.5%, largely because the infarction is anterior and was caught relatively early in its course), 1-year mortality, and cardiac arrest. Despite the higher-than-average probability of thrombolysis-related stroke (1.2%, related to the hypertension and high pulse pressure), the greater projected benefits might encourage the clinician, in the absence of other countervailing factors, to promptly use thrombolytic therapy. In addition, these predictions could be used to help inform the patient of the potential benefits and risks of treatment.
The bottom panel of Figure 6 shows the electrocardiogram of a woman with a smaller infarction who presented later in the course of that infarction. The predicted probabilities of death and cardiac arrest are not greatly improved by thrombolytic therapy compared with the increased probabilities of serious bleeding complications. Thus, in the absence of other compelling factors, the output of the thrombolytic predictive instrument might influence the clinician to not treat the patient with thrombolysis. Again, information given to the patient about treatment options might be enhanced by the availability of these predictions.
Discussion
|
|---|
|
|
|---|
The five component predictive instruments of the thrombolytic predictive instrument each generate results consistent with known clinical influences on acute mortality, long-term mortality, cardiac arrest, thrombolysis-related hemorrhagic stroke, and bleeding that requires transfusion (Figures 1, 2, 3, 4, and 5). However, unlike conventional reports of these effects, the thrombolytic predictive instrument can provide quantitative results specifically based on an individual patient's characteristics (Figure 6). Thus, it can assist in decision making about treatment in light of the three major determinants of outcome from thrombolytic therapy: time from onset of acute infarction until treatment, size and location of the infarction, and likelihood of serious thrombolysis-related bleeding complications.
It is well known that the time elapsed from the onset of chest pain until treatment is a critical determinant of the efficacy of thrombolytic therapy [33-35], but treatment is often delayed. The MITI (Myocardial Infarction Triage and Intervention) Trial, which studied the very early use of thrombolytic therapy, showed that compared with patients treated 70 to 360 minutes after symptom onset (who had a mortality rate of 8.7%), patients treated within 70 minutes of symptom onset had 50% smaller infarctions and a mortality rate of 1.2% [36]. In that trial, prehospital cellular telephone-transmitted 12-lead electrocardiograms not only allowed thrombolytic therapy to be used before arrival at the emergency department but also, for patients treated at the hospital, shortened the time from arrival to treatment from 60 to 20 minutes. The thrombolytic predictive instrument electrocardiogram is intended to build on this approach and to inform caregivers in both the prehospital and hospital settings, thus facilitating the earliest possible treatment.
It is also well known that the accrued benefits from thrombolytic therapy are greatest for patients with larger, high-risk anterior infarctions; moderate for patients with large inferior infarctions; and relatively small for patients with smaller, inferior infarctions [20, 21, 37-39]. However, categories of infarction location and size in the literature often do not fit the particular patient for whom a treatment decision must be made. Similarly, reported results do not adjust in detail for a variety of important clinical factors at presentation, such as age, vital signs, and history of diabetes or hypertension. The thrombolytic predictive instrument, by using multiple independent measures of infarction location and size together with other key clinical factors, can immediately provide outcome predictions tailored to the attributes of a given patient. Moreover, because it integrates information from many independent sources in their most predictive forms (for example, detailed waveform electrocardiogram measurements rather than general electrocardiogram-based categories), the thrombolytic predictive instrument makes maximum use of the information available for each individual patient. Therefore, it is likely to identify candidates for thrombolytic therapy who would not be identified in current practice (that is, it increases sensitivity) and should expand the pool of patients benefiting from thrombolysis.
The thrombolytic predictive instrument should also better identify patients who are likely to have bleeding complications as a result of thrombolytic therapy and are therefore less likely to accrue net benefit but who would have met conventional treatment criteria (that is, it increases specificity). This should reduce adverse effects (and costs) resulting from untoward use. Conversely, fear of bleeding complications, especially intracranial hemorrhage, remains a major barrier to the appropriate use of thrombolytic therapy [40]. By providing patient-specific predicted probabilities of thrombolysis-related intracranial hemorrhage and serious bleeding, simultaneously with the patient's probable benefit in terms of the probabilities of mortality and cardiac arrest, the thrombolytic predictive instrument may assist clinicians in dealing with this difficult clinical trade-off as accurately and expeditiously as possible.
Incorporation of the thrombolytic predictive instrument into a computerized electrocardiograph not only may assist real-time care but will also allow the storing of the predicted outcomes in databases for retrospective assessment of care. By providing accurate risk-adjusted predictions of expected outcomes of acute myocardial infarction and its therapy, the component predictive instruments should be usable for retrospectively comparing outcomes of care by different providers and institutions, inasmuch as they are based on variable types previously shown to be "time-insensitive" [4, 8] and thus valid for both real-time and retrospective use. Of note, because the predictive models are clinically based and use only data available to the clinician in real-time care, their use for evaluating care should facilitate communication among clinicians, administrators, payers, and agencies [10]. Combining primary data from multiple clinical trials and registries to create a single database with which to develop outcome predictive instruments has potential advantages [11]. It allows more patients to be studied than would be possible in a single study, without the enormous costs and substantial time that would otherwise be needed to collect such data (if, indeed, such data could still be obtained). Moreover, the resulting data set may be less biased than the data sets of individual clinical trials (for example, individual trials may have excluded women) [41]. Thus, useful models of clinical outcomes can be developed that otherwise might not be available because of practical or ethical barriers to their creation.
This approach has potential pitfalls [11]. The data come from studies and trials that were done over a wide span of years and had a variety of designs. The need to apply uniform inclusion criteria to all contributing data sets resulted in a reduction in the number of patients available for study. In addition, because the clinical trials had used somewhat restrictive inclusion criteria, we did not have sufficient data with which to make projections beyond their criteria (for example, for patients older than 75 years of age or patients with systolic blood pressures > 190 mm Hg). Thus, the use of this instrument was prevented in some patients. Nonetheless, we believe that these methods deserve further investigation as a way to make optimal use of clinical trial and registry data. This approach could also be used for ongoing updating of databases and their derived predictive instruments.
Although the clinical concepts embedded in the component statistical models of the thrombolytic predictive instrument are similar to those in the literature, the outcome predictions from these models should be studied further. For example, the thrombolytic predictive instrument's estimate of the mortality benefit, especially for patients who are treated early, is larger than that reported by the Fibrinolytic Therapy Trialists (FTT) Collaborative Group [33], which combined basic data from large controlled trials of thrombolytic therapy. This difference could result from the inclusion of multiple thrombolytic regimens and many late-treated patients in the FTT overview, either because late-treated patients receive less benefit or because the FTT's summary linear regression underrepresented the impact of time to treatment on mortality in the first hours, or both [33]. Alternatively, the estimates of mortality in clinical trials included in the thrombolytic predictive instrument could underestimate mortality of thrombolysis-treated patients because of the restrictive inclusion criteria while overestimating the mortality of patients not treated with thrombolysis, as a result of the wide entry criteria of its database. However, the very close comparability of the database's treatment and control groups makes this unlikely. Indeed, although the difference was not statistically significant, treated patients had slightly larger infarctions (electrocardiogram size score, 14.8 compared with 13.1) and slightly lower mean systolic blood pressures (130 compared with 140 mm Hg), which would bias against an exaggerated effect of thrombolysis. A separate concern is that the thrombolysis-related intracranial hemorrhage component predictive instrument is based on a relatively small number of strokes; it might be improved by the use of more data. In addition, this model implicitly assumes that the rate of nonhemorrhagic stroke would be equivalent in treated and untreated patients, even though recent evidence suggests a modest decrease in nonhemorrhagic strokes in treated patients [33].
Finally, the thrombolytic predictive instrument's major systemic bleed component predictive instrument is probably biased by the high rates of invasive procedures in the thrombolytic trials included in the Thrombolytic Predictive Instrument Database. Thus, it may overestimate the likelihood of bleeding.
All of these issues point to the need for continued data collection to improve predictions of patient outcomes. Unfortunately, this may not be possible to do in patients who do not receive thrombolytic therapy, because reperfusion therapy is now the standard of care. Nonetheless, although the thrombolytic predictive instrument offers promise as a real-time clinical decision aid and as a tool for retrospective review of care, it must still be viewed as experimental. Further testing of its performance on other data sets, investigation of the optimal form for presentation to physicians [42], and prospective controlled clinical trials of its impact on clinicians' use of thrombolytic therapy will be required before it is ready for routine, widespread use [43-45].
Appendix A
|
|---|
|
|
|
|
|
Appendix B
|
|---|
|
| (1) |
where exp(e) = ex, ß is the model coefficient, x is the variable value for the patient, and the sum is across all variables in the model. The calculations for each of the component predictive instruments are provided for the patient with the electrocardiogram shown in the top panel of Figure 6. For each variable in a model, the actual clinical data, the derived form needed for the calculations (given as x in column 1), the variable coefficient (given as ß in column 2), and the weighted product (given as ßx in column 3) are provided. Additional details on variable definitions can be found in Appendix A.
|
|
|
|
|
Author and Article Information
|
|---|
|
|
|---|
References
|
|---|
|
|
|---|
1. Pozen MW, D'Agostino RB, Mitchell JB, Rosenfeld DM, Guglielmino JT, Schwartz ML, et al. The usefulness of a predictive instrument to reduce inappropriate admissions to the coronary care unit. Ann Intern Med. 1980; 92(2 pt 1):238-42.
2. Pozen MW, D'Agostino RB, Selker HP, Sytkowski PA, Hood WB Jr. A predictive instrument to improve coronary-care-unit admission practices in acute ischemic heart disease. A prospective multicenter clinical trial. N Engl J Med. 1984; 310:1273-8.
3. Selker HP, D'Agostino RB, Laks MM. A predictive instrument for acute ischemic heart disease to improve coronary care unit admission practices: a potential on-line tool in a computerized electrocardiograph. J Electrocardiol. 1988; 21(Suppl):S11-7.
4. Selker HP, Griffith JL, D'Agostino RB. A tool for judging coronary care unit admission appropriateness, valid for both real-time and retrospective use. A time-insensitive predictive instrument (TIPI) for acute cardiac ischemia: a multicenter study. Med Care. 1991; 29:610-27.
5. Cairns CB, Niemann JT, Selker HP, Laks MM. Computerized version of the time-insensitive predictive instrument. Use of the Q wave, ST-segment, T wave, and patient history in the diagnosis of acute myocardial infarction by the computerized ECG. J Electrocardiol. 1991; 24:46-9.
6. Sarasin FP, Reymond JM, Griffith JL, Beshansky JR, Schifferli JA, Unger PF, et al. Impact of the acute cardiac ischemia time-insensitive predictive instrument (ACI-TIPI) on the speed of triage decision making for emergency department patients presenting with chest pain: a controlled clinical trial. J Gen Intern Med. 1994; 9:187-94.
7. Selker HP, Beshansky JR, Griffith JL, for the TIPI Working Group. A controlled trial of the acute cardiac ischemia time-insensitive predictive instrument (ACI-TIPI) electrocardiograph on emergency department (ED) triage [Abstract]. J Invest Med. 1995; 43:215A.
8. Selker HP, Griffith JL, D'Agostino RB. A time-insensitive predictive instrument for acute myocardial infarction mortality: a multicenter study. Med Care. 1991; 29:1196-211.
9. Selker HP, Griffith JL, D'Agostino RB. A time-insensitive predictive instrument for acute hospital mortality due to congestive heart failure: development, testing, and use for comparing hospitals: a multicenter study. Med Care. 1994; 32:1040-52.
10. Selker HP. Systems for comparing actual and predicted mortality rates: characteristics to promote cooperation in improving hospital care [Editorial]. Ann Intern Med. 1993; 118:820-2.
11. Selker HP, Griffith JL, Beshansky JR, Califf RM, D'Agostino RB, Laks MM, et al. The thrombolytic predictive instrument project: combining clinical study databases to take medical effectiveness research to the streets. Washington, DC: Agency for Health Care Policy Research: 1992:9-31.
12. Rosati RA, McNeer JF, Starmer CF, Mittler BS, Morris JJ Jr, Wallace AG. A new information system for medical practice. Arch Intern Med. 1975; 135:1017-24.
13. Pryor DP, Califf RM, Harrell FE Jr, Hlatky MA, Lee KL, Mark DB, et al. Clinical data bases. Accomplishments and unrealized potential. Med Care. 1985; 23:623-47.
14. Weaver WD, Eisenberg MS, Martin JS, Litwin PE, Shaeffer SM, Ho MT, et al. Myocardial Infarction Triage and Intervention Project-phase I: patient characteristics and feasibility of prehospital initiation of thrombolytic therapy. J Am Coll Cardiol. 1990; 15:925-31.
15. Topol EJ, Califf RM, George BS, Kereiakes DJ, Abbottsmith CW, Candela RJ, et al. A randomized trial of immediate versus delayed elective angioplasty after intravenous tissue plasminogen activator in acute myocardial infarction. N Engl J Med. 1987; 317:581-8.
16. Topol EJ, Califf RM, George BS, Kereiakes DJ, Rothbaum D, Candela RJ, et al. Coronary arterial thrombolysis with combined infusion of recombinant tissue-type plasminogen activator and urokinase in patients with acute myocardial infarction. Circulation. 1988; 77:1100-7.
17. Topol EJ, George BS, Kereiakes DJ, Stump DC, Candela RJ, Abbottsmith CW, et al. A randomized controlled trial of intravenous tissue plasminogen activator and early intravenous heparin in acute myocardial infarction. Circulation. 1989; 79:281-6.
18. Wall TC, Strickland J, Masoud J, Tse A, Pasi D, Zawodniak M, et al. Thrombolytic therapy on the homefront. Intravenous urokinase in community hospitals. N C Med J. 1989; 50:363-6.
19. Califf RM, Topol EJ, Stack RS, Ellis SG, George BS, Kereiakes DJ, et al. Evaluation of combination thrombolytic therapy and timing of cardiac catheterization in acute myocardial infarction. Results of the thrombolysis and angioplasty in myocardial infarction-phase 5 randomized trial. TAMI Study Group. Circulation. 1991; 83:1543-56.
20. Kennedy JW, Ritchie JL, Davis KB, Fritz JK. Western Washington randomized trial of intracoronary streptokinase in acute myocardial infarction. N Engl J Med. 1983; 309:1477-82.
21. Kennedy JW, Martin GV, Davis KB, Maynard C, Stadius M, Sheehan FH, et al. The Western Washington Intravenous Streptokinase in Acute Myocardial Infarction Randomized Trial. Circulation. 1988; 77:345-52.
22. Althouse R, Maynard C, Cerqueira MD, Olsufka M, Ritchie JL, Kennedy JW. The Western Washington Myocardial Infarction Registry and Emergency Department Tissue Plasminogen Activator Treatment Trial. Am J Cardiol. 1990; 66:1298-303.
23. Anderson WD, Wagner NB, Lee KL, White RD, Yuschak J, Behar VS, et al. Evaluation of a QRS scoring system for estimating myocardial infarct size. VI: Identification of screening criteria for non-acute myocardial infarcts. Am J Cardiol. 1988; 61:729-33.
24. Selker HP, Beshansky JR, Schmid CH, Griffith JL, Longstreth WT Jr, O'Connor CM, et al. Presenting pulse pressure predicts thrombolytic therapy-related intracranial hemorrhage. Thrombolytic Predictive Instrument Project results. Circulation. 1994; 90:1657-61.
25. Moss AJ, Schwartz PJ, Crampton RS, Locati E, Carleen T. The long QT syndrome: a prospective international study. Circulation. 1985; 71:17-21.
26. SAS/STAT User's Guide, Version 6. 4th ed. Cary, NC: SAS Institute, Inc.; 1989:1077-8.
27. Hastie TJ, Tibshirani RJ. Generalized Additive Models. London: Chapman & Hall; 1990:95-101.
28. Chambers JM, Hastie TJ. Statistical models in S. Pacific Grove, CA: Wadsworth and Brooks/Cole; 1992:249-377.
29. Centor RM. Signal detectability: the use of ROC curves and their analyses. Med Decis Making. 1991; 11:102-6.
30. D'Agostino RB, Lee ML, Belanger AJ, Cupples LA, Anderson K, Kannel WB. Relation of pooled logistic regression to time dependent cox regression analysis: the Framingham Heart Study. Stat Med. 1990; 9:1501-15.
31. Schmid CH, D'Agostino RB, Griffith JL, Beshansky JR, Selker HP. A logistic regression model when some events precede treatment: the effect of thrombolytic therapy for acute myocardial infarction on the risk of cardiac arrest. J Clin Epidemiol. 1997; [In press].
32. Hindman NB, Schocken DD, Widmann M, Anderson WD, White RD, Leggett S, et al. Evaluation of a QRS scoring system for estimating myocardial infarct size. V. Specificity and method of application of the complete system. Am J Cardiol. 1985; 55:1485-90.
33. Indications for fibrinolytic therapy in suspected acute myocardial infarction: collaborative overview of early mortality and major morbidity results from all randomized trials of more than 1000 patients. Fibrinolytic Therapy Trialists' (FTT) Collaborative Group. Lancet. 1994; 343:311-22.
34. Lau J, Antman EM, Jimenez-Silva J, Kupelnick B, Mosteller F, Chalmers TC. Cumulative meta-analysis of therapeutic trials for myocardial infarction. N Engl J Med. 1992; 327:248-54.
35. LaRosa JH, Horan MJ, Passamani ER, eds. Proceedings of the National Heart, Lung, and Blood Institute Symposium on Rapid Identification and Treatment of Acute Myocardial Infarction: Issues and Answers. Bethesda, MD: National Heart, Lung, and Blood Institute, U.S. Dept. of Health and Human Services, National Institutes of Health; 1992.
36. Weaver WD, Cerqueira M, Hallstrom AP, Litwin PE, Martin JS, Kudenchuk PJ, et al. Prehospital-initiated vs hospital-initiated thrombolytic therapy. The Myocardial Infarction Triage and Intervention Trial. JAMA. 1993; 270:1211-6.
37. Effectiveness of intravenous thrombolytic treatment in acute myocardial infarction. Gruppo Italiano per lo Studio della Streptochinasi nell'Infarto Miocardico (GISSI). Lancet. 1986; 1:397-402.
38. Marder VJ, Sherry S. Thrombolytic therapy: current status (2). N Engl J Med. 1988; 318:1585-95.
39. Midgette AS, Griffith JL, Califf RM, Laks MM, Dietz SB, Beshansky JR, et al. Prediction of the infarct-related artery in acute myocardial infarction by a scoring system using summary ST-segment and T-wave changes. Am J Cardiol. 1996; 78:389-95.
40. Gunnar RM, Bourdillon PD, Dixon DW, Fuster V, Karp RB, Kennedy JW, et al. ACC/AHA Guidelines for the early management of patients with acute myocardial infarction. A report of the American College of Cardiology/American Heart Association Task Force on Assessment of Diagnostic and Therapeutic Cardiovascular Procedures (subcommittee to develop guidelines for the early management of patients with acute myocardial infarction). Circulation. 1990; 82:664-707.
41. Maynard C, Selker HP, Beshansky JR, Griffith JL, Schmid CH, Califf RM, et al. The exclusion of women from clinical trials of thrombolytic therapy: implications for developing the thrombolytic predictive instrument database. Med Decis Making. 1995; 15:38-43.
42. Naylor CD, Chen E, Strauss B. Measured enthusiasm: does the method of reporting trial results alter perceptions of therapeutic effectiveness? Ann Intern Med. 1992; 117:916-21.
43. Selker HP. Coronary care unit triage decision aids: how do we know when they work? [Editorial] Am J Med. 1989; 87:491-3.
44. Selker HP, Zalenski RJ, Antman EM, Aufderheide TP, Bernard SA, Bonow RO, et al. An evaluation of technologies for identifying acute cardiac ischemia in the emergency department: executive summary of a National Heart Attack Alert Program Working Group Report. Ann Emerg Med. 1997; 29:1-12.
45. Selker HP, Zalenski RJ, Antman EM, Aufderheide TP, Bernard SA, Bonow RO, et al. An evaluation of technologies for identifying acute cardiac ischemia in the emergency department a report from a National Heart Attack Alert Program Working Group. Ann Emerg Med. 1997; 29:13-87.
Related articles in Annals:
This article has been cited by other articles:
![]() |
D. M. Kent and R. A. Hayward Limitations of Applying Summary Results of Clinical Trials to Individual Patients: The Need for Risk Stratification JAMA, September 12, 2007; 298(10): 1209 - 1212. [Full Text] [PDF] |
||||
![]() |
D. M. Kent, H. P. Selker, R. Ruthazer, E. Bluhmki, and W. Hacke The Stroke-Thrombolytic Predictive Instrument: A Predictive Instrument for Intravenous Thrombolysis in Acute Ischemic Stroke Stroke, December 1, 2006; 37(12): 2957 - 2962. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. M. Demaerschalk The Stroke-Thrombolytic Predictive Instrument Provides Valid Quantitative Estimates of Outcome Probabilities and Aids Clinical Decision-Making Stroke, December 1, 2006; 37(12): 2865 - 2866. [Full Text] [PDF] |
||||
![]() |
D. A. Alter, D. T. Ko, A. Newman, and J. V. Tu Factors explaining the under-use of reperfusion therapy among ideal patients with ST-segment elevation myocardial infarction Eur. Heart J., July 1, 2006; 27(13): 1539 - 1549. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. M. Westfall, R. F. Van Vorst, J. McGloin, and H. P. Selker Triage and Diagnosis of Chest Pain in Rural Hospitals: Implementation of the ACI-TIPI in the High Plains Research Network Ann. Fam. Med, March 1, 2006; 4(2): 153 - 158. |