Analysis of COVID-19 Guideline Quality and Change of Recommendations: A Systematic Review.

Zhao, Siya; Lu, Shuya; Wu, Shouyuan; Wang, Zijun; Guo, Qiangqiang; Shi, Qianling; Zhang, Hairong; Zhang, Juanjuan; Liu, Hui; Liu, Yunlan; Zhang, Xianzhuo; Wang, Ling; Ren, Mengjuan; Wang, Ping; Lan, Hui; Zhou, Qi; Sun, Yajia; Cao, Jin; Li, Qinyuan; Estill, Janne; ... (2021). Analysis of COVID-19 Guideline Quality and Change of Recommendations: A Systematic Review. Health data science, 2021, p. 9806173. American Association for the Advancement of Science 10.34133/2021/9806173

[img]
Preview
Text
9806173.pdf - Published Version
Available under License Creative Commons: Attribution (CC-BY).

Download (1MB) | Preview

Background

Hundreds of coronavirus disease 2019 (COVID-19) clinical practice guidelines (CPGs) and expert consensus statements have been developed and published since the outbreak of the epidemic. However, these CPGs are of widely variable quality. So, this review is aimed at systematically evaluating the methodological and reporting qualities of COVID-19 CPGs, exploring factors that may influence their quality, and analyzing the change of recommendations in CPGs with evidence published.

Methods

We searched five electronic databases and five websites from 1 January to 31 December 2020 to retrieve all COVID-19 CPGs. The assessment of the methodological and reporting qualities of CPGs was performed using the AGREE II instrument and RIGHT checklist. Recommendations and evidence used to make recommendations in the CPGs regarding some treatments for COVID-19 (remdesivir, glucocorticoids, hydroxychloroquine/chloroquine, interferon, and lopinavir-ritonavir) were also systematically assessed. And the statistical inference was performed to identify factors associated with the quality of CPGs.

Results

We included a total of 92 COVID-19 CPGs developed by 19 countries. Overall, the RIGHT checklist reporting rate of COVID-19 CPGs was 33.0%, and the AGREE II domain score was 30.4%. The overall methodological and reporting qualities of COVID-19 CPGs gradually improved during the year 2020. Factors associated with high methodological and reporting qualities included the evidence-based development process, management of conflicts of interest, and use of established rating systems to assess the quality of evidence and strength of recommendations. The recommendations of only seven (7.6%) CPGs were informed by a systematic review of evidence, and these seven CPGs have relatively high methodological and reporting qualities, in which six of them fully meet the Institute of Medicine (IOM) criteria of guidelines. Besides, a rapid advice CPG developed by the World Health Organization (WHO) of the seven CPGs got the highest overall scores in methodological (72.8%) and reporting qualities (83.8%). Many CPGs covered the same clinical questions (it refers to the clinical questions on the effectiveness of treatments of remdesivir, glucocorticoids, hydroxychloroquine/chloroquine, interferon, and lopinavir-ritonavir in COVID-19 patients) and were published by different countries or organizations. Although randomized controlled trials and systematic reviews on the effectiveness of treatments of remdesivir, glucocorticoids, hydroxychloroquine/chloroquine, interferon, and lopinavir-ritonavir for patients with COVID-19 have been published, the recommendations on those treatments still varied greatly across COVID-19 CPGs published in different countries or regions, which may suggest that the CPGs do not make sufficient use of the latest evidence.

Conclusions

Both the methodological and reporting qualities of COVID-19 CPGs increased over time, but there is still room for further improvement. The lack of effective use of available evidence and management of conflicts of interest were the main reasons for the low quality of the CPGs. The use of formal rating systems for the quality of evidence and strength of recommendations may help to improve the quality of CPGs in the context of the COVID-19 pandemic. During the pandemic, we suggest developing a living guideline of which recommendations are supported by a systematic review for it can facilitate the timely translation of the latest research findings to clinical practice. We also suggest that CPG developers should register the guidelines in a registration platform at the beginning for it can reduce duplication development of guidelines on the same clinical question, increase the transparency of the development process, and promote cooperation among guideline developers all over the world. Since the International Practice Guideline Registry Platform has been created, developers could register guidelines prospectively and internationally on this platform.

Item Type:

Journal Article (Review Article)

Division/Institute:

08 Faculty of Science > Department of Mathematics and Statistics > Institute of Mathematical Statistics and Actuarial Science

UniBE Contributor:

Estill, Janne Anton Markus

Subjects:

300 Social sciences, sociology & anthropology > 360 Social problems & social services
500 Science > 510 Mathematics

ISSN:

2765-8783

Publisher:

American Association for the Advancement of Science

Language:

English

Submitter:

Pubmed Import

Date Deposited:

25 Nov 2022 10:48

Last Modified:

05 Dec 2022 16:28

Publisher DOI:

10.34133/2021/9806173

PubMed ID:

36405357

BORIS DOI:

10.48350/175013

URI:

https://boris.unibe.ch/id/eprint/175013

Actions (login required)

Edit item Edit item
Provide Feedback