Intraoperative Performance Analytics Laboratory (IPAL), Department of General Surgery, Northwell Health, Lenox Hill Hospital, New York, NY, USA.
Donald and Barbara Zucker School of Medicine at Hofstra/Northwell, Hempstead, NY, USA.
Surg Endosc. 2023 Jun;37(6):4321-4327. doi: 10.1007/s00464-022-09825-3. Epub 2023 Feb 2.
Surgical video recording provides the opportunity to acquire intraoperative data that can subsequently be used for a variety of quality improvement, research, and educational applications. Various recording devices are available for standard operating room camera systems. Some allow for collateral data acquisition including activities of the OR staff, kinematic measurements (motion of surgical instruments), and recording of the endoscopic video streams. Additional analysis through computer vision (CV), which allows software to understand and perform predictive tasks on images, can allow for automatic phase segmentation, instrument tracking, and derivative performance-geared metrics. With this survey, we summarize available surgical video acquisition technologies and associated performance analysis platforms.
In an effort promoted by the SAGES Artificial Intelligence Task Force, we surveyed the available video recording technology companies. Of thirteen companies approached, nine were interviewed, each over an hour-long video conference. A standard set of 17 questions was administered. Questions spanned from data acquisition capacity, quality, and synchronization of video with other data, availability of analytic tools, privacy, and access.
Most platforms (89%) store video in full-HD (1080p) resolution at a frame rate of 30 fps. Most (67%) of available platforms store data in a Cloud-based databank as opposed to institutional hard drives. CV powered analysis is featured in some platforms: phase segmentation in 44% platforms, out of body blurring or tool tracking in 33%, and suture time in 11%. Kinematic data are provided by 22% and perfusion imaging in one device.
Video acquisition platforms on the market allow for in depth performance analysis through manual and automated review. Most of these devices will be integrated in upcoming robotic surgical platforms. Platform analytic supplementation, including CV, may allow for more refined performance analysis to surgeons and trainees. Most current AI features are related to phase segmentation, instrument tracking, and video blurring.
手术视频记录提供了获取术中数据的机会，这些数据随后可用于各种质量改进、研究和教育应用。各种记录设备可用于标准手术室摄像系统。有些设备允许获取附带数据，包括手术室工作人员的活动、运动学测量（手术器械的运动）以及内镜视频流的记录。通过计算机视觉 (CV) 进行额外的分析，使软件能够理解和执行图像上的预测任务，允许自动相位分割、器械跟踪和衍生的性能导向指标。通过这项调查，我们总结了现有的手术视频采集技术和相关的性能分析平台。
在 SAGES 人工智能工作组推动的一项努力中，我们调查了现有的视频录制技术公司。在联系的十三家公司中，有九家接受了采访，每家采访都进行了一个多小时的视频会议。采用了一套标准的 17 个问题。问题涵盖了视频采集容量、质量以及与其他数据的同步、分析工具的可用性、隐私和访问权限。
大多数平台（89%）以全高清（1080p）分辨率和 30 fps 的帧率存储视频。大多数（67%）可用平台将数据存储在基于云的数据银行中，而不是机构硬盘中。一些平台具有 CV 驱动的分析功能：44%的平台具有相位分割功能，33%的平台具有体外模糊或工具跟踪功能，11%的平台具有缝合时间功能。22%的平台提供运动学数据，一种设备提供灌注成像。
市场上的视频采集平台允许通过手动和自动审查进行深入的性能分析。这些设备中的大多数将被集成到即将推出的机器人手术平台中。平台分析补充，包括 CV，可能允许外科医生和学员进行更精细的性能分析。目前大多数人工智能功能都与相位分割、器械跟踪和视频模糊有关。
