Jung Jae-Hyun, Pu Tian, Peli Eli
Harvard Medical School, Massachusetts Eye and Ear, Department of Ophthalmology, Schepens Eye Research Institute, 20 Staniford Street, Boston, Massachusetts 02114, United States.
University of Electronic Science and Technology of China, School of Optoelectronic Information, No. 4, Section 2, North Jianshe Road, Chengdu 610054, China.
J Electron Imaging. 2016 Nov;25(6). doi: 10.1117/1.JEI.25.6.061619. Epub 2016 Dec 22.
Visual prostheses require an effective representation method due to the limited display condition which has only 2 or 3 levels of grayscale in low resolution. Edges derived from abrupt luminance changes in images carry essential information for object recognition. Typical binary (black and white) edge images have been used to represent features to convey essential information. However, in scenes with a complex cluttered background, the recognition rate of the binary edge images by human observers is limited and additional information is required. The polarity of edges and cusps (black or white features on a gray background) carries important additional information; the polarity may provide shape from shading information missing in the binary edge image. This depth information may be restored by using bipolar edges. We compared object recognition rates from 16 binary edge images and bipolar edge images by 26 subjects to determine the possible impact of bipolar filtering in visual prostheses with 3 or more levels of grayscale. Recognition rates were higher with bipolar edge images and the improvement was significant in scenes with complex backgrounds. The results also suggest that erroneous shape from shading interpretation of bipolar edges resulting from pigment rather than boundaries of shape may confound the recognition.
由于视觉假体的显示条件有限,分辨率较低,只有2或3级灰度,因此需要一种有效的表示方法。图像中亮度突然变化产生的边缘携带了物体识别的重要信息。典型的二值(黑白)边缘图像已被用于表示特征以传达重要信息。然而,在背景复杂杂乱的场景中,人类观察者对二值边缘图像的识别率有限,还需要额外的信息。边缘和尖点的极性(灰色背景上的黑色或白色特征)携带重要的附加信息;极性可以从二值边缘图像中缺失的阴影信息提供形状。这种深度信息可以通过使用双极边缘来恢复。我们让26名受试者比较了16幅二值边缘图像和双极边缘图像的物体识别率,以确定双极滤波在具有3级或更多级灰度的视觉假体中的可能影响。双极边缘图像的识别率更高,并且在背景复杂的场景中改善显著。结果还表明,由色素而非形状边界导致的双极边缘的错误阴影形状解释可能会混淆识别。