Annals
Established in 1927 by the American College of Physicians
:
Advanced search
 
box Article
 arrow  Table of Contents                
space
 arrow  Articles citing this article
space
box Services
 arrow  Send comment/rapid response letter
space
 arrow  Notify a friend about this article
space
 arrow  Alert me when this article is cited
space
 arrow  Add to Personal Archive
space
 arrow  Download to Citation Manager
space
 arrow  ACP Search                        
space
 arrow  Get Permissions
space
box Google Scholar
 arrow  Search for Related Content
space
box PubMed
Articles in PubMed by Author:
  arrow  Freemantle, N.
space
  arrow  Eccles, M. P.
space
 arrow  Related Articles in PubMed
space
 arrow  PubMed Citation
space
 arrow  PubMed
space

EDITORIAL

CONSORT: An Important Step toward Evidence-Based Health Care

right arrow Nick Freemantle, MA; James M. Mason, PhD; Andrew Haines, MD; and Martin P. Eccles, MD

1 January 1997 | Volume 126 Issue 1 | Pages 81-83


The recent publication of the Consolidated Standards of Reporting Trials (CONSORT) guidelines lines for the reporting of randomized trials [1] marks a welcome convergence of advice from the Standards of Reporting Trials (SORT) Group [2] and the Asilomar Working Group on Recommendations for the Reporting of Clinical Trials in the Biomedical Literature, which examine clinical efficacy [3]. Authors who submit papers to Annals are now being asked to adhere to the principles embodied in the sensible recommendations from these two similar but until recently largely independent projects [4]. The Lancet, JAMA, and BMJ are also adopting these recommendations. The goal of the guidelines is to improve the reporting of clinical trials. This, in turn, should enhance the interpretation and further analysis of the results of existing trials and encourage high standards in the design and conduct of future trials.

The CONSORT guidelines provide a coherent statement of standards for the practice and reporting of randomized trials-a statement that is particularly welcome for its brevity and clarity. The recommendations highlight the importance of the fundamental building blocks that minimize bias and provide the scientific rigor needed to make meaningful clinical inferences from trials. These building blocks include adequately describing the hypotheses to be tested, the sample studied, and the process of randomization; accounting for all randomly assigned participants; and providing information on either primary end points for binary outcomes or estimates of mean and variance for continuous data.

If widely implemented, the CONSORT guidelines should go far in minimizing the serious deficiencies, which are now well documented, in the design, analysis, and reporting of trials [5]. The purpose of CONSORT is to highlight these deficiencies and to help ensure that the reporting of trials provides clinicians, researchers, policymakers, and other persons who interpret trial findings with the required data [6].

The effects of many modern medical treatments are likely to be small, although potentially worthwhile, thereby making it necessary to randomly assign large numbers of patients. Although large (and expensive) single trials that address questions of clinical importance have sufficient statistical power to provide precise answers about treatment effect, such large trials remain scarce in many clinical areas. Meta-analyses that synthesize data from numerous, small, similar trials provide an alternative method with which to achieve the necessary statistical precision and may do so with increased generalizability [7]. But meta-analyses are only as good as the sample of trials they include [8]. Even with the most sensitive search strategies, however, it is almost inevitable that relevant trials-especially those that have not been published in journals-will be missed. Manuscripts that inadequately report trials only compound this deficiency because they are less likely to be published, thereby contributing to publication bias. If trials are omitted from a meta-analysis in a random manner, the results will be less precise than when all well-conducted trials are included. Such incomplete meta-analyses risk providing uncertain answers when more definite ones are potentially available from existing research.

Moreover, when availability of data is affected by some systematic influence, such as the bias against publication of trials that do not show a statistically significant difference between treatment and control groups, the results of meta-analyses will reflect that bias. It is a relatively common practice to describe results as "not significant" and to provide no estimate of variance in trials in which only a small and uncertain effect is seen. On the other hand, reporting results adequately when trials detect effects that are statistically significant or of potential practical importance is also relatively common. Such inappropriate reporting practices may similarly introduce important biases into the results of meta-analyses. In addition, relevant data are frequently not available in published reports; for example, in a meta-analysis of published comparative trials of antidepressant drugs, primary outcomes were adequately reported in only 20 of 53 (38%) trials [9].

A strong case can be made to patients to participate in randomized trials [10]. However, this imperative is seriously undermined when data on the primary end points from existing trials are not made available to guide the design of future trials and the treatment of future patients. Even if the CONSORT recommendations are universally adopted, occasions will arise when reviewers will require unpublished data from trials (for example, in the analysis of rare events that are not considered to be primary outcomes in small trials and can only be handled appropriately in large overviews) or will wish to use individual patient data that may provide more precise and valid estimates of treatment effect [11, 12]. In such situations, funding bodies, including pharmaceutical companies, should make data available rather than withholding or obfuscating it on grounds of serving commercial or other interests. Given the potential importance of publication bias [5, 8, 13], this obligation should extend to unpublished trials and unpublished data from published trials. Many trials funded by the pharmaceutical industry fail to report valid data for further interpretation and analysis [9, 14]; in some instances, such trials may appropriately be considered marketing rather than science.

To make efficient decisions about the use of health care interventions, policymakers and clinicians need to know about potential costs, as well as diagnostic and therapeutic effects [15]. There is a good case for including economic analyses alongside large, "real world" randomized trials [16]. Many mistakes can be made, however, in the course of designing, implementing, and reporting such analyses. The CONSORT guidelines clearly cannot solve all of the problems surrounding the conduct and reporting of clinical trials, but if the CONSORT checklist [1] included one additional line in its protocol section that read "Planned economic analysis (if warranted)" and provided a key reference (for example, Drummond and colleagues [17]), this area would be dealt with simply and adequately.

A major challenge surrounding the CONSORT guidelines is implementation. Although these guidelines should improve the usefulness of trial reports in journals that formally adopt them, usefulness is more likely to be enhanced if editors request referees to review manuscripts with these reporting standards in mind.

Some persons may see the suggested structure for a trial report as arbitrary and intrusive. For example, it is unclear why describing planned subgroup analyses or covariate analyses in the introduction is preferable to describing them in the methods section, which currently seems to be a common practice. In light of this concern, it may not be surprising that the lead author of a "guinea pig" paper that rigorously followed the earlier SORT guidelines described "mixed feelings" on the experience [18]. To those interested in interpreting results of trials for the benefit of patients, the availability of adequate descriptions of trials is what really matters; the precise location of data in reports is less important.

If use of the CONSORT guidelines remains restricted to a few general journals of international prominence, their effect on most trials (the reports of which are primarily published in subspecialty journals) may remain limited. One potential way to augment their effect would be to convince prospective authors (as well as referees) of the value of the guidelines to influence the authors' decision about where to send their contributions. Another way would be to actively market the guidelines to journal editors through professional networks. Ultimately, randomized trials can only achieve appropriate changes in practice if their results are reported completely, systematically, and in adequate detail. The CONSORT guidelines bring this goal closer; they should be welcomed warmly.


Author and Article Information
space
up arrowTop
dotAuthor & Article Info
down arrowReferences

University of York, Heslington, York Y01 5DD, United Kingdom.
University College London Medical School and Royal Free Hospital School of Medicine, London NW3 2PF, United Kingdom.
University of Newcastle upon Tyne, Newcastle upon Tyne NE2 4AA, United Kingdom.
Requests for Reprints: Nick Freemantle, MA, Centre for Health Economics, University of York, Heslington, York Y01 5DD, United Kingdom.


References
space
up arrowTop
up arrowAuthor & Article Info
dotReferences

1. Begg C, Cho M, Eastwod S, Horton R, Moher D, Olkin I, et al. Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA. 1996; 276:637-9.

2. A proposal for structured reporting of randomized controlled trials. The Standards of Reporting Trials Group. JAMA. 1994; 272:1926-31.

3. Checklist of information for inclusion in reports of clinical trials. The Asilomar Working Group on Recommendations for Reporting of Clinical Trials in the Biomedical Literature. Ann Intern Med. 1996; 124:741-3.

4. Information for authors. Ann Intern Med. 1997; 127:1-11.

5. Bero LA, Rennie D. Influences on the quality of published drug studies. Int J Technol Assess Health Care. 1996; 12:209-37.

6. Altman DG. Better reporting of randomised controlled trials: the CONSORT statement [Editorial]. BMJ. 1996; 313:570-1.

7. Mosteller F, Colditz GA. Understanding research synthesis (meta-analysis). Annu Rev Public Health. 1996; 17:1-23.

8. Begg CB, Berlin JA. Publication bias: a problem in interpreting medical data. Journal of the Royal Statistical Society. 1988; 151:419-63.

9. Song F, Freemantle N, Sheldon TA, House A, Watson P, Long A, et al. Selective serotonin reuptake inhibitors: meta-analysis of efficacy and acceptability. BMJ. 1993; 306:683-7.

10. Baum M. New approach for recruitment into randomised controlled trials. Lancet. 1993; 341:812-3.

11. Jeng GT, Scott JR, Burmeister LF. A comparison of meta-analytic results using literature vs individual patient data: paternal cell immunization for recurrent miscarriage. JAMA. 1995; 274:830-6.

12. Stewart LA, Parmar MK. Meta analysis of the literature or of individual patient data: Is there a difference? Lancet. 1993; 341:418-22.

13. Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR. Publication bias in clinical research. Lancet. 1991; 337:867-72.

14. Goetzsche PC. Methodology and overt and hidden bias in reports of 196 double-blind trials of nonsteroidal antiinflammatory drugs in rheumatoid arthritis. Controlled Clin Trials. 1989; 10:31-56.

15. Cochrane AL. Effectiveness and efficiency: random reflections on health services. London: Nuffield Provincial Hospitals Trust; 1972.

16. Freemantle N, Drummond MF. Should clinical trials with concurrent economic analyses be blinded? JAMA. 1997; [In press].

17. Drummond MF, Jefferson TO. Guidelines for authors and peer reviewers of economic submissions to the BMJ. The BMJ Economic Evaluation Working Party. BMJ. 1996; 313:275-83.

18. Rennie D. Reporting randomized controlled trials: an experiment and a call or responses from readers [Editorial]. JAMA. 1995; 273:1054-5.


This article has been cited by other articles:


Home page
J. Am. Podiatr. Med. Assoc.Home page
D. Moher, K. F. Schulz, and D. G. Altman
The CONSORT Statement: Revised Recommendations for Improving the Quality of Reports of Parallel-Group Randomized Trials
J Am Podiatr Med Assoc, September 1, 2001; 91(8): 437 - 442.
[Abstract] [Full Text] [PDF]


Home page
JAMAHome page
D. Moher, K. F. Schulz, D. Altman, and for the CONSORT Group
The CONSORT Statement: Revised Recommendations for Improving the Quality of Reports of Parallel-Group Randomized Trials
JAMA, April 18, 2001; 285(15): 1987 - 1991.
[Abstract] [Full Text] [PDF]


Home page
Arch OphthalmolHome page
B. S. Hawkins
The CONSORT Statement: Will It Lead to Improved Reporting of Clinical Trials in Ophthalmology?
Arch Ophthalmol, May 1, 1999; 117(5): 677 - 680.
[Full Text] [PDF]


Home page
BMJHome page
R. Walton, S. Dovey, E. Harvey, and N. Freemantle
Computer support for determining drug dose: systematic review and meta-analysis
BMJ, April 10, 1999; 318(7189): 984 - 990.
[Abstract] [Full Text]


Home page
JAMAHome page
D. Moher
CONSORT: An Evolving Tool to Help Improve the Quality of Reports of Randomized Controlled Trials
JAMA, May 13, 1998; 279(18): 1489 - 1491.
[Full Text] [PDF]


Home page
BMJHome page
M. Eccles, N. Freemantle, and J. Mason
North of England evidence based guidelines development project: methods of developing guidelines for efficient drug use in primary care
BMJ, April 18, 1998; 316(7139): 1232 - 1235.
[Full Text]


box Article
 arrow  Table of Contents                
space
 arrow  Articles citing this article
space
box Services
 arrow  Send comment/rapid response letter
space
 arrow  Notify a friend about this article
space
 arrow  Alert me when this article is cited
space
 arrow  Add to Personal Archive
space
 arrow  Download to Citation Manager
space
 arrow  ACP Search                        
space
 arrow  Get Permissions
space
box Google Scholar
 arrow  Search for Related Content
space
box PubMed
Articles in PubMed by Author:
  arrow  Freemantle, N.
space
  arrow  Eccles, M. P.
space
 arrow  Related Articles in PubMed
space
 arrow  PubMed Citation
space
 arrow  PubMed
space


 Home | Current Issue | Past Issues | In the Clinic | ACP Journal Club | CME | Collections | Audio/Video | Mobile | Subscribe | Tools | Help | ACP Online