An empirical comparison of methods for meta-analysis of diagnostic accuracy showed hierarchical models are necessary

Harbord, Roger M; Whiting, Penny; Sterne, Jonathan A C; Egger, Matthias; Deeks, Jonathan J; Shang, Aijing; Bachmann, Lucas M (2008). An empirical comparison of methods for meta-analysis of diagnostic accuracy showed hierarchical models are necessary. Journal of clinical epidemiology, 61(11), pp. 1095-103. New York, N.Y.: Elsevier 10.1016/j.jclinepi.2007.09.013

[img] Text
Harbord JClinEpidemiol 2008_p1095.pdf - Published Version
Restricted to registered users only
Available under License Publisher holds Copyright.

Download (339kB) | Request a copy

OBJECTIVE: Meta-analysis of studies of the accuracy of diagnostic tests currently uses a variety of methods. Statistically rigorous hierarchical models require expertise and sophisticated software. We assessed whether any of the simpler methods can in practice give adequately accurate and reliable results. STUDY DESIGN AND SETTING: We reviewed six methods for meta-analysis of diagnostic accuracy: four simple commonly used methods (simple pooling, separate random-effects meta-analyses of sensitivity and specificity, separate meta-analyses of positive and negative likelihood ratios, and the Littenberg-Moses summary receiver operating characteristic [ROC] curve) and two more statistically rigorous approaches using hierarchical models (bivariate random-effects meta-analysis and hierarchical summary ROC curve analysis). We applied the methods to data from a sample of eight systematic reviews chosen to illustrate a variety of patterns of results. RESULTS: In each meta-analysis, there was substantial heterogeneity between the results of different studies. Simple pooling of results gave misleading summary estimates of sensitivity and specificity in some meta-analyses, and the Littenberg-Moses method produced summary ROC curves that diverged from those produced by more rigorous methods in some situations. CONCLUSION: The closely related hierarchical summary ROC curve or bivariate models should be used as the standard method for meta-analysis of diagnostic accuracy.

Item Type:

Journal Article (Original Article)


04 Faculty of Medicine > Pre-clinic Human Medicine > Institute of Social and Preventive Medicine (ISPM)

UniBE Contributor:

Egger, Matthias










Factscience Import

Date Deposited:

04 Oct 2013 15:04

Last Modified:

11 Jun 2015 09:36

Publisher DOI:


PubMed ID:


Web of Science ID:




URI: (FactScience: 111491)

Actions (login required)

Edit item Edit item
Provide Feedback