Power David, Burke Cathy, Madden Michael G, Ullah Ihsan
ASSERT Centre, College of Medicine and Health, University College Cork, Cork, Ireland.
Cork University Maternity Hospital, Cork, Ireland.
Sci Rep. 2025 Apr 19;15(1):13591. doi: 10.1038/s41598-025-96336-5.
Artificial intelligence (AI) has the potential to improve healthcare and patient safety and is currently being adopted across various fields of medicine and healthcare. AI and in particular computer vision (CV) are well suited to the analysis of minimally invasive surgical simulation videos for training and performance improvement. CV techniques have rapidly improved in recent years from accurately recognizing objects, instruments, and gestures to phases of surgery and more recently to remembering past surgical steps. Lack of labeled data is a particular problem in surgery considering its complexity, as human annotation and manual assessment are both expensive in time and cost, and in most cases rely on direct intervention of clinical expertise. In this study, we introduce a newly collected simulated Laparoscopic Surgical Performance Dataset (LSPD) specifically designed to address these challenges. Unlike existing datasets that focus on instrument tracking or anatomical structure recognition, the LSPD is tailored for evaluating simulated laparoscopic surgical skill performance at various expertise levels. We provide detailed statistical analyses to identify and compare poorly performed and well-executed operations across different skill levels (novice, trainee, expert) for three specific skills: stack, bands, and tower. We employ a 3-dimensional convolutional neural network (3DCNN) with a weakly-supervised approach to classify the experience levels of surgeons. Our results show that the 3DCNN effectively distinguishes between novices, trainees, and experts, achieving an F1 score of 0.91 and an AUC of 0.92. This study highlights the value of the LSPD dataset and demonstrates the potential of leveraging 3DCNN-based and weakly-supervised approaches to automate the evaluation of surgical performance, reducing reliance on manual expert annotation and assessments. These advancements contribute to improving surgical training and performance analysis.
人工智能(AI)有改善医疗保健和患者安全的潜力,目前正在医学和医疗保健的各个领域得到应用。人工智能,尤其是计算机视觉(CV),非常适合用于分析微创手术模拟视频,以进行培训和提高手术表现。近年来,CV技术迅速发展,从准确识别物体、器械和手势到手术阶段,最近还发展到能够记住过去的手术步骤。考虑到手术的复杂性,缺乏标注数据是一个特别的问题,因为人工标注和手动评估在时间和成本上都很高,而且在大多数情况下依赖临床专业知识的直接干预。在本研究中,我们引入了一个新收集的模拟腹腔镜手术表现数据集(LSPD),专门设计用于应对这些挑战。与现有的专注于器械跟踪或解剖结构识别的数据集不同,LSPD是为评估不同专业水平的模拟腹腔镜手术技能表现而量身定制的。我们提供详细的统计分析,以识别和比较不同技能水平(新手、实习生、专家)在三种特定技能(堆叠、绑扎、搭建塔状结构)方面表现不佳和执行良好的操作。我们采用具有弱监督方法的三维卷积神经网络(3DCNN)来对外科医生的经验水平进行分类。我们的结果表明,3DCNN能够有效地区分新手、实习生和专家,F1分数达到0.91,曲线下面积(AUC)为0.92。本研究突出了LSPD数据集的价值,并展示了利用基于3DCNN和弱监督方法自动评估手术表现的潜力,减少对人工专家标注和评估的依赖。这些进展有助于改善手术培训和表现分析。