What is the influence of randomisation sequence generation and allocation concealment on treatment effects of physical therapy trials? A meta-epidemiological study.

Armijo-Olivo, Susan; Saltaji, Humam; Da Costa, Bruno R; Fuentes, Jorge; Ha, Christine; Cummings, Greta G (2015). What is the influence of randomisation sequence generation and allocation concealment on treatment effects of physical therapy trials? A meta-epidemiological study. BMJ open, 5(9), e008562. BMJ Publishing Group 10.1136/bmjopen-2015-008562

Preview

Text Armijo-Olivo BMJOpen 2015.pdf - Published Version Available under License Creative Commons: Attribution (CC-BY). Download (1MB) | Preview

OBJECTIVE

To determine if adequacy of randomisation and allocation concealment is associated with changes in effect sizes (ES) when comparing physical therapy (PT) trials with and without these methodological characteristics.

DESIGN

Meta-epidemiological study.

PARTICIPANTS

A random sample of randomised controlled trials (RCTs) included in meta-analyses in the PT discipline were identified.

INTERVENTION

Data extraction including assessments of random sequence generation and allocation concealment was conducted independently by two reviewers. To determine the association between sequence generation, and allocation concealment and ES, a two-level analysis was conducted using a meta-meta-analytic approach.

PRIMARY AND SECONDARY OUTCOME MEASURES

association between random sequence generation and allocation concealment and ES in PT trials.

RESULTS

393 trials included in 43 meta-analyses, analysing 44 622 patients contributed to this study. Adequate random sequence generation and appropriate allocation concealment were accomplished in only 39.7% and 11.5% of PT trials, respectively. Although trials with inappropriate allocation concealment tended to have an overestimate treatment effect when compared with trials with adequate concealment of allocation, the difference was non-statistically significant (ES=0.12; 95% CI -0.06 to 0.30). When pooling our results with those of Nuesch et al, we obtained a pooled statistically significant value (ES=0.14; 95% CI 0.02 to 0.26). There was no difference in ES in trials with appropriate or inappropriate random sequence generation (ES=0.02; 95% CI -0.12 to 0.15).

CONCLUSIONS

Our results suggest that when evaluating risk of bias of primary RCTs in PT area, systematic reviewers and clinicians implementing research into practice should pay attention to these biases since they could exaggerate treatment effects. Systematic reviewers should perform sensitivity analysis including trials with low risk of bias in these domains as primary analysis and/or in combination with less restrictive analyses. Authors and editors should make sure that allocation concealment and random sequence generation are properly reported in trial reports.

Interest & Impact

Downloads

258 since deposited on 05 Nov 2015
19 in the past 12 months

Citations

5 Citations in Web of Science ®
6 Citations in Scopus

Search

in Google Scholar™

Services

Actions (login required)

Edit item

Actions (login required)

Edit item