EnCoV, Institut Pascal, UMR 6602, CNRS/UBP/SIGMA, EnCoV, 63000, Clermont-Ferrand, France.
IHU Strasbourg, 1 Place de l'Hôpital, 67091, Strasbourg, France.
Int J Comput Assist Radiol Surg. 2020 May;15(5):859-866. doi: 10.1007/s11548-020-02161-8. Epub 2020 Apr 28.
A better understanding of photometry in laparoscopic images can increase the reliability of computer-assisted surgery applications. Photometry requires modelling illumination, tissue reflectance and camera response. There exists a large variety of light models, but no systematic and reproducible evaluation. We present a review of light models in laparoscopic surgery, a unified calibration approach, an evaluation methodology, and a practical use of photometry.
We use images of a calibration checkerboard to calibrate the light models. We then use these models in a proposed dense stereo algorithm exploiting the shading and simultaneously extracting the tissue albedo, which we call dense shading stereo. The approach works with a broad range of light models, giving us a way to test their respective merits.
We show that overly complex light models are usually not needed and that the light source position must be calibrated. We also show that dense shading stereo outperforms existing methods, in terms of both geometric and photometric errors, and achieves sub-millimeter accuracy.
This work demonstrates the importance of careful light modelling and calibration for computer-assisted surgical applications. It gives guidelines on choosing the best performing light model.
更好地理解腹腔镜图像中的光度学可以提高计算机辅助手术应用的可靠性。光度学需要对照明、组织反射和相机响应进行建模。存在着各种各样的光照模型,但没有系统和可重复的评估。我们介绍了腹腔镜手术中的光照模型、统一的校准方法、评估方法以及光度学的实际应用。
我们使用校准棋盘的图像来校准光照模型。然后,我们在一个提出的密集立体算法中使用这些模型,该算法利用阴影并同时提取组织反照率,我们称之为密集阴影立体。该方法适用于广泛的光照模型,为我们提供了测试各自优点的方法。
我们表明,过于复杂的光照模型通常不需要,并且必须校准光源位置。我们还表明,密集阴影立体在几何和光度误差方面都优于现有的方法,并实现了亚毫米级的精度。
这项工作证明了在计算机辅助手术应用中仔细的光照建模和校准的重要性。它为选择性能最佳的光照模型提供了指导。