Analyzing the Quality and Challenges of Uncertainty Estimations for Brain Tumor Segmentation

Jungo, Alain; Balsiger, Fabian; Reyes, Mauricio (2020). Analyzing the Quality and Challenges of Uncertainty Estimations for Brain Tumor Segmentation. Frontiers in neuroscience, 14(282), p. 282. Frontiers Research Foundation 10.3389/fnins.2020.00282

Preview	Text fnins-14-00282.pdf - Published Version Available under License Creative Commons: Attribution (CC-BY). Download (1MB) | Preview
Preview	Text Data_Sheet_1_Analyzing the Quality and Challenges of Uncertainty Estimations for Brain Tumor Segmentation.pdf - Supplemental Material Available under License Creative Commons: Attribution (CC-BY). Download (5MB) | Preview

Automatic segmentation of brain tumors has the potential to enable volumetric measures and high-throughput analysis in the clinical setting. Reaching this potential seems almost achieved, considering the steady increase in segmentation accuracy. However, despite segmentation accuracy, the current methods still do not meet the robustness levels required for patient-centered clinical use. In this regard, uncertainty estimates are a promising direction to improve the robustness of automated segmentation systems. Different uncertainty estimation methods have been proposed, but little is known about their usefulness and limitations for brain tumor segmentation. In this study, we present an analysis of the most commonly used uncertainty estimation methods in regards to benefits and challenges for brain tumor segmentation. We evaluated their quality in terms of calibration, segmentation error localization, and segmentation failure detection. Our results show that the uncertainty methods are typically well-calibrated when evaluated at the dataset level. Evaluated at the subject level, we found notable miscalibrations and limited segmentation error localization (e.g., for correcting segmentations), which hinder the direct use of the voxel-wise uncertainties. Nevertheless, voxel-wise uncertainty showed value to detect failed segmentations when uncertainty estimates are aggregated at the subject level. Therefore, we suggest a careful usage of voxel-wise uncertainty measures and highlight the importance of developing solutions that address the subject-level requirements on calibration and segmentation error localization.

Interest & Impact

Downloads

102 since deposited on 20 Nov 2020
28 in the past 12 months

Citations

5 Citations in Web of Science ®
6 Citations in Scopus

Search

in Google Scholar™

Services

Actions (login required)

Edit item

Actions (login required)

Edit item