Moscow State University of Medicine and Dentistry Named After A.I. Evdokimov, 20/1 Delegatskaya ul., Moscow, Russian Federation, 127473.
Moscow State University of Technology "STANKIN", 1 Vadkovsky per., Moscow, Russian Federation, 127055.
Sci Rep. 2023 Apr 25;13(1):6765. doi: 10.1038/s41598-023-30930-3.
This study aims to compare the tracking algorithms provided by the OpenCV library to use on ultrasound video. Despite the widespread application of this computer vision library, few works describe the attempts to use it to track the movement of liver tumors on ultrasound video. Movements of the neoplasms caused by the patient`s breath interfere with the positioning of the instruments during the process of biopsy and radio-frequency ablation. The main hypothesis of the experiment was that tracking neoplasms and correcting the position of the manipulator in case of using robotic-assisted surgery will allow positioning the instruments more precisely. Another goal of the experiment was to check if it is possible to ensure real-time tracking with at least 25 processed frames per second for standard definition video. OpenCV version 4.5.0 was used with 7 tracking algorithms from the extra modules package. They are: Boosting, CSRT, KCF, MedianFlow, MIL, MOSSE, TLD. More than 5600 frames of standard definition were processed during the experiment. Analysis of the results shows that two algorithms-CSRT and KCF-could solve the problem of tumor tracking. They lead the test with 70% and more of Intersection over Union and more than 85% successful searches. They could also be used in real-time processing with an average processing speed of up to frames per second in CSRT and 100 + frames per second for KCF. Tracking results reach the average deviation between centers of neoplasms to 2 mm and maximum deviation less than 5 mm. This experiment also shows that no frames made CSRT and KCF algorithms fail simultaneously. So, the hypothesis for future work is combining these algorithms to work together, with one of them-CSRT-as support for the KCF tracker on the rarely failed frames.
本研究旨在比较 OpenCV 库提供的跟踪算法,以应用于超声视频。尽管该计算机视觉库得到了广泛的应用,但很少有文献描述尝试使用它来跟踪超声视频中肝肿瘤的运动。肿瘤因患者呼吸而移动,会干扰活检和射频消融过程中仪器的定位。实验的主要假设是,在使用机器人辅助手术时,跟踪肿瘤并校正操纵器的位置将使仪器定位更加精确。实验的另一个目标是检查是否可以确保每秒至少处理 25 个处理帧的实时跟踪,用于标准定义视频。使用 OpenCV 版本 4.5.0 和来自额外模块包的 7 种跟踪算法。它们是:Boosting、CSRT、KCF、MedianFlow、MIL、MOSSE 和 TLD。在实验过程中处理了超过 5600 帧标准定义的视频。结果分析表明,两种算法——CSRT 和 KCF——可以解决肿瘤跟踪问题。它们以 70%及以上的交并比和 85%以上的成功搜索率领先测试。它们还可以用于实时处理,CSRT 的平均处理速度高达每秒帧数,而 KCF 的平均处理速度高达 100 帧每秒。跟踪结果达到了肿瘤中心平均偏差 2 毫米,最大偏差小于 5 毫米。该实验还表明,没有任何帧同时使 CSRT 和 KCF 算法失效。因此,未来工作的假设是将这些算法结合在一起,其中一个算法——CSRT——作为 KCF 跟踪器在很少失败的帧上的支持。