Orchestrating explainable artificial intelligence for multimodal and longitudinal data in medical imaging.

Pahud de Mortanges, Aurélie; Luo, Haozhe; Shu, Shelley Zixin; Kamath, Amith; Suter, Yannick; Shelan, Mohamed; Pöllinger, Alexander; Reyes, Mauricio (2024). Orchestrating explainable artificial intelligence for multimodal and longitudinal data in medical imaging. NPJ digital medicine, 7(1) Nature Publishing Group 10.1038/s41746-024-01190-w

[img]
Preview
Text
s41746-024-01190-w.pdf - Published Version
Available under License Creative Commons: Attribution (CC-BY).

Download (1MB) | Preview

Explainable artificial intelligence (XAI) has experienced a vast increase in recognition over the last few years. While the technical developments are manifold, less focus has been placed on the clinical applicability and usability of systems. Moreover, not much attention has been given to XAI systems that can handle multimodal and longitudinal data, which we postulate are important features in many clinical workflows. In this study, we review, from a clinical perspective, the current state of XAI for multimodal and longitudinal datasets and highlight the challenges thereof. Additionally, we propose the XAI orchestrator, an instance that aims to help clinicians with the synopsis of multimodal and longitudinal data, the resulting AI predictions, and the corresponding explainability output. We propose several desirable properties of the XAI orchestrator, such as being adaptive, hierarchical, interactive, and uncertainty-aware.

Item Type:

Journal Article (Review Article)

Division/Institute:

10 Strategic Research Centers > ARTORG Center for Biomedical Engineering Research > ARTORG Center - AI in Medical Imaging Laboratory
04 Faculty of Medicine > Department of Haematology, Oncology, Infectious Diseases, Laboratory Medicine and Hospital Pharmacy (DOLS) > Clinic of Radiation Oncology
04 Faculty of Medicine > Department of Radiology, Neuroradiology and Nuclear Medicine (DRNN) > Institute of Diagnostic, Interventional and Paediatric Radiology
10 Strategic Research Centers > ARTORG Center for Biomedical Engineering Research

UniBE Contributor:

Pahud de Mortanges, Aurélie Hortense Caroline, Shu, Zixin, Kamath, Amith Jagannath, Suter, Yannick Raphael, Shelan, Mohamed, Pöllinger, Alexander, Reyes, Mauricio

Subjects:

600 Technology > 610 Medicine & health
500 Science > 570 Life sciences; biology

ISSN:

2398-6352

Publisher:

Nature Publishing Group

Language:

English

Submitter:

Pubmed Import

Date Deposited:

23 Jul 2024 09:41

Last Modified:

23 Jul 2024 09:49

Publisher DOI:

10.1038/s41746-024-01190-w

PubMed ID:

39039248

BORIS DOI:

10.48350/199147

URI:

https://boris.unibe.ch/id/eprint/199147

Actions (login required)

Edit item Edit item
Provide Feedback