The effects of excluding patients from the analysis in randomised controlled trials: meta-epidemiological study

Nüesch, Eveline; Trelle, Sven; Reichenbach, Stephan; Rutjes, Anne W S; Bürgi, Elizabeth; Scherer, Martin; Altman, Douglas G; Jüni, Peter (2009). The effects of excluding patients from the analysis in randomised controlled trials: meta-epidemiological study. BMJ, 339(b3244), b3244. London: BMJ Publishing Group 10.1136/bmj.b3244

[img]
Preview
Text
Nüesch BMJ 2009.pdf - Published Version
Available under License Creative Commons: Attribution-Noncommercial (CC-BY-NC).

Download (154kB) | Preview

OBJECTIVE: To examine whether excluding patients from the analysis of randomised trials are associated with biased estimates of treatment effects and higher heterogeneity between trials. DESIGN: Meta-epidemiological study based on a collection of meta-analyses of randomised trials. DATA SOURCES: 14 meta-analyses including 167 trials that compared therapeutic interventions with placebo or non-intervention control in patients with osteoarthritis of the hip or knee and used patient reported pain as an outcome. METHODS: Effect sizes were calculated from differences in means of pain intensity between groups at the end of follow-up, divided by the pooled standard deviation. Trials were combined by using random effects meta-analysis. Estimates of treatment effects were compared between trials with and trials without exclusions from the analysis, and the impact of restricting meta-analyses to trials without exclusions was assessed. RESULTS: 39 trials (23%) had included all patients in the analysis. In 128 trials (77%) some patients were excluded from the analysis. Effect sizes from trials with exclusions tended to be more beneficial than those from trials without exclusions (difference -0.13, 95% confidence interval -0.29 to 0.04). However, estimates of bias between individual meta-analyses varied considerably (tau(2)=0.07). Tests of interaction between exclusions from the analysis and estimates of treatment effects were positive in five meta-analyses. Stratified analyses indicated that differences in effect sizes between trials with and trials without exclusions were more pronounced in meta-analyses with high between trial heterogeneity, in meta-analyses with large estimated treatment benefits, and in meta-analyses of complementary medicine. Restriction of meta-analyses to trials without exclusions resulted in smaller estimated treatment benefits, larger P values, and considerable decreases in between trial heterogeneity. CONCLUSION: Excluding patients from the analysis in randomised trials often results in biased estimates of treatment effects, but the extent and direction of bias is unpredictable. Results from intention to treat analyses should always be described in reports of randomised trials. In systematic reviews, the influence of exclusions from the analysis on estimated treatment effects should routinely be assessed.

Item Type:

Journal Article (Original Article)

Division/Institute:

04 Faculty of Medicine > Pre-clinic Human Medicine > Institute of Social and Preventive Medicine (ISPM)

UniBE Contributor:

Nüesch, Eveline, Trelle, Sven, Reichenbach, Stephan, Jüni, Peter

ISSN:

1756-1833

ISBN:

19736281

Publisher:

BMJ Publishing Group

Language:

English

Submitter:

Factscience Import

Date Deposited:

04 Oct 2013 15:09

Last Modified:

05 Dec 2022 14:21

Publisher DOI:

10.1136/bmj.b3244

PubMed ID:

19736281

Web of Science ID:

000269754500001

BORIS DOI:

10.7892/boris.30338

URI:

https://boris.unibe.ch/id/eprint/30338 (FactScience: 192795)

Actions (login required)

Edit item Edit item
Provide Feedback