Salmon Alexander E, Cooper Robert F, Langlo Christopher S, Baghaie Ahmadreza, Dubra Alfredo, Carroll Joseph
Department of Cell Biology, Neurobiology, & Anatomy, Medical College of Wisconsin, Milwaukee, WI, USA.
Department of Psychology, University of Pennsylvania, Philadelphia, PA, USA ; Department of Ophthalmology, University of Pennsylvania, Philadelphia, PA, USA.
Transl Vis Sci Technol. 2017 Apr 3;6(2):9. doi: 10.1167/tvst.6.2.9. eCollection 2017 Apr.
To develop an automated reference frame selection (ARFS) algorithm to replace the subjective approach of manually selecting reference frames for processing adaptive optics scanning light ophthalmoscope (AOSLO) videos of cone photoreceptors.
Relative distortion was measured within individual frames before conducting image-based motion tracking and sorting of frames into distinct spatial clusters. AOSLO images from nine healthy subjects were processed using ARFS and human-derived reference frames, then aligned to undistorted AO-flood images by nonlinear registration and the registration transformations were compared. The frequency at which humans selected reference frames that were rejected by ARFS was calculated in 35 datasets from healthy subjects, and subjects with achromatopsia, albinism, or retinitis pigmentosa. The level of distortion in this set of human-derived reference frames was assessed.
The average transformation vector magnitude required for registration of AOSLO images to AO-flood images was significantly reduced from 3.33 ± 1.61 pixels when using manual reference frame selection to 2.75 ± 1.60 pixels (mean ± SD) when using ARFS ( = 0.0016). Between 5.16% and 39.22% of human-derived frames were rejected by ARFS. Only 2.71% to 7.73% of human-derived frames were ranked in the top 5% of least distorted frames.
ARFS outperforms expert observers in selecting minimally distorted reference frames in AOSLO image sequences. The low success rate in human frame choice illustrates the difficulty in subjectively assessing image distortion.
Manual reference frame selection represented a significant barrier to a fully automated image-processing pipeline (including montaging, cone identification, and metric extraction). The approach presented here will aid in the clinical translation of AOSLO imaging.
开发一种自动参考帧选择(ARFS)算法,以取代在处理锥体细胞光感受器的自适应光学扫描激光检眼镜(AOSLO)视频时手动选择参考帧的主观方法。
在进行基于图像的运动跟踪并将帧分类到不同的空间簇之前,测量各个帧内的相对失真。使用ARFS和人工选择的参考帧处理来自9名健康受试者的AOSLO图像,然后通过非线性配准将其与无失真的AO泛光图像对齐,并比较配准变换。计算了来自健康受试者、色盲症患者、白化病患者或视网膜色素变性患者的35个数据集中,人工选择的被ARFS拒绝的参考帧的频率。评估了这组人工选择的参考帧中的失真水平。
将AOSLO图像与AO泛光图像配准所需的平均变换向量大小,从使用手动参考帧选择时的3.33±1.61像素显著降低到使用ARFS时的2.75±1.60像素(平均值±标准差)(P = 0.0016)。ARFS拒绝了5.16%至39.22%的人工选择的帧。只有2.71%至7.73%的人工选择的帧在失真最小的前5%的帧中。
在选择AOSLO图像序列中失真最小的参考帧方面,ARFS优于专家观察者。人工选择帧的成功率较低,说明了主观评估图像失真的难度。
手动参考帧选择是全自动图像处理流程(包括拼接、锥体细胞识别和度量提取)的一个重大障碍。这里介绍的方法将有助于AOSLO成像的临床转化。