Vision transformer assisting rheumatologists in screening for capillaroscopy changes in systemic sclerosis: an artificial intelligence model.

Garaiman, Alexandru; Nooralahzadeh, Farhad; Mihai, Carina; Gonzalez, Nicolas Perez; Gkikopoulos, Nikitas; Becker, Mike Oliver; Distler, Oliver; Krauthammer, Michael; Maurer, Britta (2023). Vision transformer assisting rheumatologists in screening for capillaroscopy changes in systemic sclerosis: an artificial intelligence model. Rheumatology, 62(7), pp. 2492-2500. Oxford University Press 10.1093/rheumatology/keac541

Preview

Text keac541.pdf - Published Version Available under License Creative Commons: Attribution-Noncommercial (CC-BY-NC). Download (1MB) | Preview

OBJECTIVES

The first objective of this study was to implement and assess the performance and reliability of a vision transformer (ViT)-based deep-learning model, an 'off-the-shelf' artificial intelligence solution, for identifying distinct signs of microangiopathy in nailfold capilloroscopy (NFC) images of patients with SSc. The second objective was to compare the ViT's analysis performance with that of practising rheumatologists.

METHODS

NFC images of patients prospectively enrolled in our European Scleroderma Trials and Research group (EUSTAR) and Very Early Diagnosis of Systemic Sclerosis (VEDOSS) local registries were used. The primary outcome investigated was the ViT's classification performance for identifying disease-associated changes (enlarged capillaries, giant capillaries, capillary loss, microhaemorrhages) and the presence of the scleroderma pattern in these images using a cross-fold validation setting. The secondary outcome involved a comparison of the ViT's performance vs that of rheumatologists on a reliability set, consisting of a subset of 464 NFC images with majority vote-derived ground-truth labels.

RESULTS

We analysed 17 126 NFC images derived from 234 EUSTAR and 55 VEDOSS patients. The ViT had good performance in identifying the various microangiopathic changes in capillaries by NFC [area under the curve (AUC) from 81.8% to 84.5%]. In the reliability set, the rheumatologists reached a higher average accuracy, as well as a better trade-off between sensitivity and specificity compared with the ViT. However, the annotators' performance was variable, and one out of four rheumatologists showed equal or lower classification measures compared with the ViT.

CONCLUSIONS

The ViT is a modern, well-performing and readily available tool for assessing patterns of microangiopathy on NFC images, and it may assist rheumatologists in generating consistent and high-quality NFC reports; however, the final diagnosis of a scleroderma pattern in any individual case needs the judgement of an experienced observer.

Interest & Impact

Downloads

58 since deposited on 09 Nov 2022
58 in the past 12 months

Citations

5 Citations in Web of Science ®
6 Citations in Scopus

Search

in Google Scholar™

Services

Actions (login required)

Edit item

Actions (login required)

Edit item