Zhou Yuchen, Li Rui, Dai Yu, Chen Gongping, Zhang Jianxun, Cui Liang, Yin Xiaotao
The College of Artificial Intelligence, Nankai University, Tianjin 300350, China; The Institute of Robotics and Automatic Information System, Tianjin Key Laboratory of Intelligent Robotics, Tianjin 300350, China.
The College of Artificial Intelligence, Nankai University, Tianjin 300350, China; The Institute of Robotics and Automatic Information System, Tianjin Key Laboratory of Intelligent Robotics, Tianjin 300350, China.
Comput Methods Programs Biomed. 2024 Nov;256:108380. doi: 10.1016/j.cmpb.2024.108380. Epub 2024 Aug 19.
In endoscopy, measurement of target size can assist medical diagnosis. However, limited operating space, low image quality, and irregular target shape pose great challenges to traditional vision-based measurement methods.
In this paper, we propose a novel approach to measure irregular target size under monocular endoscope using image rendering. Firstly synthesize virtual poses on the same main optical axis as known camera poses, and use implicit neural representation module that considers brightness and target boundaries to render images corresponding to virtual poses. Then, Swin-Unet and rotating calipers are utilized to obtain maximum pixel length of the target in image pairs with the same main optical axis. Finally, the similarity triangle relationship of the endoscopic imaging model is used to measure the size of the target.
The evaluation is conducted using renal stone fragments of patients which are placed in the kidney model and the isolated porcine kidney. The mean error of measurement is 0.12 mm.
The approached method can automatically measure object size within narrow body cavities in any visible direction. It improves the effectiveness and accuracy of measurement in limited endoscopic space.
