Division of Computer Assisted Medical Interventions (CAMI), German Cancer Research Center (DKFZ), Im Neuenheimer Feld 223, 69120, Heidelberg, Germany.
Department for General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany.
Sci Data. 2021 Apr 12;8(1):101. doi: 10.1038/s41597-021-00882-2.
Image-based tracking of medical instruments is an integral part of surgical data science applications. Previous research has addressed the tasks of detecting, segmenting and tracking medical instruments based on laparoscopic video data. However, the proposed methods still tend to fail when applied to challenging images and do not generalize well to data they have not been trained on. This paper introduces the Heidelberg Colorectal (HeiCo) data set - the first publicly available data set enabling comprehensive benchmarking of medical instrument detection and segmentation algorithms with a specific emphasis on method robustness and generalization capabilities. Our data set comprises 30 laparoscopic videos and corresponding sensor data from medical devices in the operating room for three different types of laparoscopic surgery. Annotations include surgical phase labels for all video frames as well as information on instrument presence and corresponding instance-wise segmentation masks for surgical instruments (if any) in more than 10,000 individual frames. The data has successfully been used to organize international competitions within the Endoscopic Vision Challenges 2017 and 2019.
基于图像的医疗器械跟踪是外科手术数据科学应用的一个组成部分。先前的研究已经解决了基于腹腔镜视频数据检测、分割和跟踪医疗器械的任务。然而，当应用于具有挑战性的图像时，所提出的方法仍然容易失败，并且不能很好地推广到它们没有经过训练的数据上。本文介绍了海德堡结直肠（HeiCo）数据集-第一个公开可用的数据集，可用于全面基准测试医疗器械检测和分割算法，特别强调方法的稳健性和泛化能力。我们的数据集包括 30 个腹腔镜视频和来自手术室中三种不同类型腹腔镜手术的医疗设备的相应传感器数据。注释包括所有视频帧的手术阶段标签，以及有关手术器械存在的信息，以及超过 10000 个单独帧中手术器械的实例分割掩模（如果有）。该数据已成功用于组织 2017 年和 2019 年内窥镜视觉挑战赛（Endoscopic Vision Challenges）中的国际竞赛。
