Ebrahimi D, Kunov H
Institute of Biomedical Engineering, University of Toronto, Ont., Canada.
IEEE Trans Biomed Eng. 1991 Oct;38(10):944-52. doi: 10.1109/10.88440.
Lipreading provides a limited amount of information about speech signals to profoundly deaf people. Visual displays using peripheral vision as an alternative sensory modality can provide supplementary speech information. The utility of a cosmetically acceptable peripheral vision display was explored. A pair of eyeglasses with a commercially available two-dimensional red LED array (5 x 7), and its associated electronics was developed. The display is visible only to the wearer, and is located in the temporal field and the horizontal meridian of the right eye. Selected speech features were encoded as visual patterns for presentation to the lipreader. These features of the speech signal (the fundamental frequency of the speech, high-frequency energy, and low-passed speech signal or total energy envelope) were presented with the objective of providing information about voicing and plosion/frication. Experiments demonstrate the capability of the peripheral display in conveying speech information. Presenting vowel-consonant-vowel syllables, the performance was in excess of 76% with aided lipreading as compared to 41% by lipreading only.
唇读为极重度聋人提供了关于语音信号的有限信息。使用周边视觉作为替代感官模态的视觉显示器可以提供补充语音信息。人们探索了一种外观可接受的周边视觉显示器的效用。开发了一副带有市售二维红色发光二极管阵列（5×7）及其相关电子设备的眼镜。该显示器仅佩戴者可见，位于右眼的颞侧视野和水平子午线处。选定的语音特征被编码为视觉模式，以呈现给唇读者。呈现语音信号的这些特征（语音的基频、高频能量以及低通语音信号或总能量包络）的目的是提供有关发声和爆破/摩擦的信息。实验证明了周边显示器传达语音信息的能力。呈现元音-辅音-元音音节时，借助唇读的表现超过76%，而仅靠唇读的表现为41%。
