Accuracy of Cardiovascular Trial Outcome Ascertainment and Treatment Effect Estimates from Routine Health Data: A Systematic Review and Meta-Analysis.

Rodrigues, Craig; Odutayo, Ayodele; Patel, Sagar; Agarwal, Arnav; Da Costa, Bruno Roza; Lin, Ethan; Yeh, Robert W; Jüni, Peter; Goodman, Shaun G; Farkouh, Michael E; Udell, Jacob A (2021). Accuracy of Cardiovascular Trial Outcome Ascertainment and Treatment Effect Estimates from Routine Health Data: A Systematic Review and Meta-Analysis. Circulation - cardiovascular quality and outcomes, 14(5), e007903. Lippincott Williams & Wilkins 10.1161/CIRCOUTCOMES.120.007903

[img] Text
Rodrigues_CircCardiovascQual_Outcomes_2021.pdf - Published Version
Restricted to registered users only
Available under License Publisher holds Copyright.

Download (539kB) | Request a copy


Registry-based randomized controlled trials allow for outcome ascertainment using routine health data (RHD). While this method provides a potential solution to the rising cost and complexity of clinical trials, comparative analyses of outcome ascertainment by clinical end point committee (CEC) adjudication compared with RHD sources are sparse. Among cardiovascular trials, we set out to systematically compare the incidence of cardiovascular events and estimated randomized treatment effects ascertained from RHD versus traditional clinical evaluation and adjudication.


We searched MEDLINE (1976 to August 2020) for studies where outcome ascertainment was performed by both RHD and CEC adjudication to compare the incidence of cardiovascular events and treatment effects. We derived ratios of hazard ratios to compare treatment effects from RHD and CEC adjudication. We pooled ratios of hazard ratios using an inverse variance random-effects meta-analysis.


Nine studies (1988-2020; 32 156 patients) involving 10 randomized control trials compared outcome ascertainment with RHD and CEC in patients with or at risk of cardiovascular disease. There was a high degree of agreement and interrater reliability between CEC and RHD outcome determination for all-cause mortality (agreement percentage: 98.4%-100% and κ: 0.95-1.0) and cardiovascular mortality (agreement percentage: 97.8%-99.9% and κ: 0.66-0.99). For myocardial infarction, the κ values ranged from 0.67-0.98, and for stroke the values ranged from 0.52-0.89. In contrast, the κ value for peripheral artery disease was low (κ: 0.27). There was little difference in the randomized treatment effect derived from CEC and RHD ascertainment of events based on the ratios of hazard ratio, with pooled ratios of hazard ratios ranging from 0.93 (95% CI, 0.63-1.39) for cardiovascular mortality to 1.27 (95% CI, 0.67-2.41) for stroke.


Clinical outcome ascertainment using retrospectively acquired RHD displayed high levels of agreement with CEC adjudication for identifying all-cause mortality and cardiovascular outcomes. Importantly, cardiovascular treatment effects in randomized control trials determined from RHD and CEC resulted in similar point estimates. Overall, our review supports the use of RHD as a potential alternative source for clinical outcome ascertainment in cardiovascular trials. Validation studies with prospectively planned linkage are warranted.

Item Type:

Journal Article (Original Article)


04 Faculty of Medicine > Medical Education > Institute of General Practice and Primary Care (BIHAM)

UniBE Contributor:

Da Costa, Bruno


600 Technology > 610 Medicine & health
300 Social sciences, sociology & anthropology > 360 Social problems & social services




Lippincott Williams & Wilkins




Andrea Flükiger-Flückiger

Date Deposited:

27 May 2021 20:12

Last Modified:

27 May 2021 20:47

Publisher DOI:


PubMed ID:


Uncontrolled Keywords:

cardiovascular disease incidence myocardial infarction peripheral arterial disease




Actions (login required)

Edit item Edit item
Provide Feedback