ICube, University of Strasbourg, CNRS, c/o IHU-Strasbourg, 1, place de l'hôpital, 67000, Strasbourg, France.
Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy.
Surg Endosc. 2022 Nov;36(11):8379-8386. doi: 10.1007/s00464-022-09112-1. Epub 2022 Feb 16.
A computer vision (CV) platform named EndoDigest was recently developed to facilitate the use of surgical videos. Specifically, EndoDigest automatically provides short video clips to effectively document the critical view of safety (CVS) in laparoscopic cholecystectomy (LC). The aim of the present study is to validate EndoDigest on a multicentric dataset of LC videos.
LC videos from 4 centers were manually annotated with the time of the cystic duct division and an assessment of CVS criteria. Incomplete recordings, bailout procedures and procedures with an intraoperative cholangiogram were excluded. EndoDigest leveraged predictions of deep learning models for workflow analysis in a rule-based inference system designed to estimate the time of the cystic duct division. Performance was assessed by computing the error in estimating the manually annotated time of the cystic duct division. To provide concise video documentation of CVS, EndoDigest extracted video clips showing the 2 min preceding and the 30 s following the predicted cystic duct division. The relevance of the documentation was evaluated by assessing CVS in automatically extracted 2.5-min-long video clips.
144 of the 174 LC videos from 4 centers were analyzed. EndoDigest located the time of the cystic duct division with a mean error of 124.0 ± 270.6 s despite the use of fluorescent cholangiography in 27 procedures and great variations in surgical workflows across centers. The surgical evaluation found that 108 (75.0%) of the automatically extracted short video clips documented CVS effectively.
EndoDigest was robust enough to reliably locate the time of the cystic duct division and efficiently video document CVS despite the highly variable workflows. Training specifically on data from each center could improve results; however, this multicentric validation shows the potential for clinical translation of this surgical data science tool to efficiently document surgical safety.
最近开发了一种名为 EndoDigest 的计算机视觉 (CV) 平台,旨在方便使用手术视频。具体来说,EndoDigest 会自动提供短视频剪辑,以有效记录腹腔镜胆囊切除术 (LC) 中的关键安全视图 (CVS)。本研究的目的是在多中心 LC 视频数据集上验证 EndoDigest。
对来自 4 个中心的 LC 视频进行手动注释,记录胆囊管分离的时间,并评估 CVS 标准。排除不完整的记录、抢救程序和术中胆管造影程序。EndoDigest 利用深度学习模型的预测结果,通过基于规则的推理系统进行工作流程分析,旨在估计胆囊管分离的时间。通过计算估计的胆囊管分离的手动注释时间的误差来评估性能。为了简洁地记录 CVS 的视频,EndoDigest 提取了显示预测的胆囊管分离前 2 分钟和后 30 秒的视频剪辑。通过评估自动提取的 2.5 分钟长视频剪辑中的 CVS 来评估文档的相关性。
对来自 4 个中心的 144 个 LC 视频进行了分析。尽管在 27 个程序中使用了荧光胆管造影术,并且不同中心的手术流程存在很大差异,但 EndoDigest 仍能以平均误差 124.0±270.6 秒定位胆囊管分离的时间。手术评估发现,108 个(75.0%)自动提取的短视频剪辑有效地记录了 CVS。
尽管工作流程高度可变,EndoDigest 仍然能够可靠地定位胆囊管分离的时间,并有效地记录 CVS。专门针对每个中心的数据进行培训可以提高结果;然而,这项多中心验证表明,这种手术数据科学工具具有高效记录手术安全性的临床转化潜力。