Towards quality management of artificial intelligence systems for medical applications.

Mercolli, Lorenzo; Rominger, Axel Oliver; Shi, Kuangyu (2024). Towards quality management of artificial intelligence systems for medical applications. Zeitschrift für medizinische Physik, 34(2), pp. 343-352. Elsevier 10.1016/j.zemedi.2024.02.001

Preview

Text 1-s2.0-S0939388924000242-main.pdf - Published Version Available under License Creative Commons: Attribution (CC-BY). Download (749kB) | Preview

The use of artificial intelligence systems in clinical routine is still hampered by the necessity of a medical device certification and/or by the difficulty of implementing these systems in a clinic's quality management system. In this context, the key questions for a user are how to ensure robust model predictions and how to appraise the quality of a model's results on a regular basis. In this paper we discuss some conceptual foundation for a clinical implementation of a machine learning system and argue that both vendors and users should take certain responsibilities, as is already common practice for high-risk medical equipment. We propose the methodology from AAPM Task Group 100 report No. 283 as a conceptual framework for developing risk-driven a quality management program for a clinical process that encompasses a machine learning system. This is illustrated with an example of a clinical workflow. Our analysis shows how the risk evaluation in this framework can accommodate artificial intelligence based systems independently of their robustness evaluation or the user's in-house expertise. In particular, we highlight how the degree of interpretability of a machine learning system can be systematically accounted for within the risk evaluation and in the development of a quality management system.

Interest & Impact

Downloads

131 since deposited on 28 Feb 2024
131 in the past 12 months

Citations

5 Citations in Web of Science ®
6 Citations in Scopus

Search

in Google Scholar™

Services

Actions (login required)

Edit item

Actions (login required)

Edit item