Correlation-aware active learning for surgery video segmentation

Wu, Fei Hugo; Marquez Neila, Pablo; Zheng, Mingyi; Rafii-Tari, Hedyeh; Sznitman, Raphael (January 2024). Correlation-aware active learning for surgery video segmentation. In: WACV. IEEE/CVF

Preview

Text COWAL.pdf - Published Version Available under License Creative Commons: Attribution (CC-BY). Download (8MB) | Preview

Semantic segmentation is a complex task that relies heavily on large amounts of annotated image data. However, annotating such data can be time-consuming and resource-intensive, especially in the medical domain. Active Learning (AL) is a popular approach that can help to reduce this burden by iteratively selecting images for annotation to improve the model performance. In the case of video data, it is important to consider the model uncertainty and the temporal nature of the sequences when selecting images for annotation. This work proposes a novel AL strategy for surgery video segmentation, COWAL, COrrelation-aWare Active Learning. Our approach involves projecting images into a latent space that has been fine-tuned using contrastive learning and then selecting a fixed number of representative images from local clusters of video frames. We demonstrate the effectiveness of this approach on two video datasets of surgical instruments and three real-world video datasets. The datasets and code will be made publicly available upon receiving necessary approvals.

Interest & Impact

Downloads

0 since deposited on 17 Jul 2024
0 in the past 12 months

Citations

5 Citations in Web of Science ®
6 Citations in Scopus

Search

in Google Scholar™

Services

Actions (login required)

Edit item

Actions (login required)

Edit item