Technical skill assessment in minimally invasive surgery using artificial intelligence: a systematic review.

Pedrett, Romina; Mascagni, Pietro; Beldi, Guido; Padoy, Nicolas; Lavanchy, Joël L (2023). Technical skill assessment in minimally invasive surgery using artificial intelligence: a systematic review. Surgical endoscopy, 37(10), pp. 7412-7424. Springer 10.1007/s00464-023-10335-z

[img]
Preview
Text
s00464-023-10335-z.pdf - Published Version
Available under License Creative Commons: Attribution (CC-BY).

Download (2MB) | Preview

BACKGROUND

Technical skill assessment in surgery relies on expert opinion. Therefore, it is time-consuming, costly, and often lacks objectivity. Analysis of intraoperative data by artificial intelligence (AI) has the potential for automated technical skill assessment. The aim of this systematic review was to analyze the performance, external validity, and generalizability of AI models for technical skill assessment in minimally invasive surgery.

METHODS

A systematic search of Medline, Embase, Web of Science, and IEEE Xplore was performed to identify original articles reporting the use of AI in the assessment of technical skill in minimally invasive surgery. Risk of bias (RoB) and quality of the included studies were analyzed according to Quality Assessment of Diagnostic Accuracy Studies criteria and the modified Joanna Briggs Institute checklists, respectively. Findings were reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement.

RESULTS

In total, 1958 articles were identified, 50 articles met eligibility criteria and were analyzed. Motion data extracted from surgical videos (n = 25) or kinematic data from robotic systems or sensors (n = 22) were the most frequent input data for AI. Most studies used deep learning (n = 34) and predicted technical skills using an ordinal assessment scale (n = 36) with good accuracies in simulated settings. However, all proposed models were in development stage, only 4 studies were externally validated and 8 showed a low RoB.

CONCLUSION

AI showed good performance in technical skill assessment in minimally invasive surgery. However, models often lacked external validity and generalizability. Therefore, models should be benchmarked using predefined performance metrics and tested in clinical implementation studies.

Item Type:

Journal Article (Review Article)

Division/Institute:

04 Faculty of Medicine > Department of Gastro-intestinal, Liver and Lung Disorders (DMLL) > Clinic of Visceral Surgery and Medicine > Visceral Surgery
04 Faculty of Medicine > Department of Gastro-intestinal, Liver and Lung Disorders (DMLL) > Clinic of Visceral Surgery and Medicine

UniBE Contributor:

Beldi, Guido Jakob Friedrich, Lavanchy, Joël Lukas

Subjects:

600 Technology > 610 Medicine & health

ISSN:

1432-2218

Publisher:

Springer

Language:

English

Submitter:

Pubmed Import

Date Deposited:

17 Aug 2023 13:56

Last Modified:

24 Oct 2023 12:41

Publisher DOI:

10.1007/s00464-023-10335-z

PubMed ID:

37584774

Uncontrolled Keywords:

Artificial intelligence Minimally invasive surgery Surgical data science Surgical skill assessment Technical skill assessment

BORIS DOI:

10.48350/185512

URI:

https://boris.unibe.ch/id/eprint/185512

Actions (login required)

Edit item Edit item
Provide Feedback