Assessing Reliability and Challenges of Uncertainty Estimations for Medical Image Segmentation

Jungo, Alain; Reyes, Mauricio (2019). Assessing Reliability and Challenges of Uncertainty Estimations for Medical Image Segmentation. Lecture notes in computer science, 11765, pp. 48-56. Springer 10.1007/978-3-030-32245-8_6

[img] Text
978-3-030-32245-8_6.pdf - Published Version
Restricted to registered users only
Available under License Publisher holds Copyright.

Download (324kB) | Request a copy

Despite the recent improvements in overall accuracy, deep learning systems still exhibit low levels of robustness. Detecting possible failures is critical for a successful clinical integration of these systems, where each data point corresponds to an individual patient. Uncertainty measures are a promising direction to improve failure detection since they provide a measure of a system’s confidence. Although many uncertainty estimation methods have been proposed for deep learning, little is known on their benefits and current challenges for medical image segmentation. Therefore, we report results of evaluating common voxel-wise uncertainty measures with respect to their reliability, and limitations on two medical image segmentation datasets. Results show that current uncertainty methods perform similarly and although they are well-calibrated at the dataset level, they tend to be miscalibrated at subject-level. Therefore, the reliability of uncertainty estimates is compromised, highlighting the importance of developing subject-wise uncertainty estimations. Additionally, among the benchmarked methods, we found auxiliary networks to be a valid alternative to common uncertainty methods since they can be applied to any previously trained segmentation model.

Item Type:

Conference or Workshop Item (Paper)

Division/Institute:

10 Strategic Research Centers > ARTORG Center for Biomedical Engineering Research

Graduate School:

Graduate School for Cellular and Biomedical Sciences (GCB)

UniBE Contributor:

Jungo, Alain, Reyes, Mauricio

Subjects:

500 Science > 570 Life sciences; biology
600 Technology > 610 Medicine & health

ISSN:

0302-9743

ISBN:

978-3-030-32245-8

Publisher:

Springer

Funders:

[42] Schweizerischer Nationalfonds

Language:

English

Submitter:

Alain Jungo

Date Deposited:

28 Jan 2020 15:23

Last Modified:

23 May 2023 12:21

Publisher DOI:

10.1007/978-3-030-32245-8_6

ArXiv ID:

1907.03338

BORIS DOI:

10.48350/138564

URI:

https://boris.unibe.ch/id/eprint/138564

Actions (login required)

Edit item Edit item
Provide Feedback