Computer-aided diagnosis through medical image retrieval in radiology.

Silva, Wilson; Gonçalves, Tiago; Härmä, Kirsi; Schröder, Erich; Obmann, Verena Carola; Barroso, Maria Cecilia; Poellinger, Alexander; Reyes, Mauricio; Cardoso, Jaime S (2022). Computer-aided diagnosis through medical image retrieval in radiology. Scientific reports, 12(1), p. 20732. Springer Nature 10.1038/s41598-022-25027-2

Preview

Text 1_Computer_Obmann.pdf - Published Version Available under License Creative Commons: Attribution (CC-BY). Download (2MB) | Preview

Currently, radiologists face an excessive workload, which leads to high levels of fatigue, and consequently, to undesired diagnosis mistakes. Decision support systems can be used to prioritize and help radiologists making quicker decisions. In this sense, medical content-based image retrieval systems can be of extreme utility by providing well-curated similar examples. Nonetheless, most medical content-based image retrieval systems work by finding the most similar image, which is not equivalent to finding the most similar image in terms of disease and its severity. Here, we propose an interpretability-driven and an attention-driven medical image retrieval system. We conducted experiments in a large and publicly available dataset of chest radiographs with structured labels derived from free-text radiology reports (MIMIC-CXR-JPG). We evaluated the methods on two common conditions: pleural effusion and (potential) pneumonia. As ground-truth to perform the evaluation, query/test and catalogue images were classified and ordered by an experienced board-certified radiologist. For a profound and complete evaluation, additional radiologists also provided their rankings, which allowed us to infer inter-rater variability, and yield qualitative performance levels. Based on our ground-truth ranking, we also quantitatively evaluated the proposed approaches by computing the normalized Discounted Cumulative Gain (nDCG). We found that the Interpretability-guided approach outperforms the other state-of-the-art approaches and shows the best agreement with the most experienced radiologist. Furthermore, its performance lies within the observed inter-rater variability.

Interest & Impact

Downloads

48 since deposited on 02 Dec 2022
23 in the past 12 months

Citations

5 Citations in Web of Science ®
6 Citations in Scopus

Search

in Google Scholar™

Services

Actions (login required)

Edit item

Actions (login required)

Edit item