Advancing laser ablation assessment in hyperspectral imaging through machine learning.

Danilov, Viacheslav V; De Landro, Martina; Felli, Eric; Barberio, Manuel; Diana, Michele; Saccomandi, Paola (2024). Advancing laser ablation assessment in hyperspectral imaging through machine learning. Computers in biology and medicine, 179(108849), p. 108849. Elsevier 10.1016/j.compbiomed.2024.108849

Preview

Text 1-s2.0-S0890509624004059-main.pdf - Published Version Available under License Creative Commons: Attribution (CC-BY). Download (765kB) | Preview

Hyperspectral imaging (HSI) is gaining increasing relevance in medicine, with an innovative application being the intraoperative assessment of the outcome of laser ablation treatment used for minimally invasive tumor removal. However, the high dimensionality and complexity of HSI data create a need for end-to-end image processing workflows specifically tailored to handle these data. This study addresses this challenge by proposing a multi-stage workflow for the analysis of hyperspectral data and allows investigating the performance of different components and modalities for ablation detection and segmentation. To address dimensionality reduction, we integrated principal component analysis (PCA) and t-distributed stochastic neighbor embedding (t-SNE) to capture dominant variations and reveal intricate structures, respectively. Additionally, we employed the Faster Region-based Convolutional Neural Network (Faster R-CNN) to accurately localize ablation areas. The two-stage detection process of Faster R-CNN, along with the choice of dimensionality reduction technique and data modality, significantly influenced the performance in detecting ablation areas. The evaluation of the ablation detection on an independent test set demonstrated a mean average precision of approximately 0.74, which validates the generalization ability of the models. In the segmentation component, the Mean Shift algorithm showed high quality segmentation without manual cluster definition. Our results prove that the integration of PCA, t-SNE, and Faster R-CNN enables improved interpretation of hyperspectral data, leading to the development of reliable ablation detection and segmentation systems.

Interest & Impact

Downloads

4 since deposited on 18 Jul 2024
4 in the past 12 months

Citations

5 Citations in Web of Science ®
6 Citations in Scopus

Search

in Google Scholar™

Services

Actions (login required)

Edit item

Actions (login required)

Edit item