Mattys Sven L, Bernstein Lynne E, Auer Edward T
House Ear Institute, Los Angeles, California 90057, USA.
Percept Psychophys. 2002 May;64(4):667-79. doi: 10.3758/bf03194734.
Word recognition is generally assumed to be achieved via competition in the mental lexicon between phonetically similar word forms. However, this process has so far been examined only in the context of auditory phonetic similarity. In the present study, we investigated whether the influence of word-form similarity on word recognition holds in the visual modality and with the patterns of visual phonetic similarity. Deaf and hearing participants identified isolated spoken words presented visually on a video monitor. On the basis of computational modeling of the lexicon from visual confusion matrices of visual speech syllables, words were chosen to vary in visual phonetic distinctiveness, ranging from visually unambiguous (lexical equivalence class [LEC] size of 1) to highly confusable (LEC size greater than 10). Identification accuracy was found to be highly related to the word LEC size and frequency of occurrence in English. Deaf and hearing participants did not differ in their sensitivity to word LEC size and frequency. The results indicate that visual spoken word recognition shows strong similarities with its auditory counterpart in that the same dependencies on lexical similarity and word frequency are found to influence visual speech recognition accuracy. In particular, the results suggest that stimulus-based lexical distinctiveness is a valid construct to describe the underlying machinery of both visual and auditory spoken word recognition.
一般认为,单词识别是通过心理词库中语音相似的单词形式之间的竞争来实现的。然而,到目前为止,这一过程仅在听觉语音相似性的背景下进行了研究。在本研究中,我们调查了单词形式相似性对单词识别的影响在视觉模态以及视觉语音相似性模式下是否成立。聋人和听力正常的参与者识别在视频监视器上以视觉方式呈现的孤立口语单词。基于从视觉语音音节的视觉混淆矩阵对词库进行的计算建模,选择的单词在视觉语音独特性方面有所不同,范围从视觉上明确无误(词汇等价类[LEC]大小为1)到高度易混淆(LEC大小大于10)。研究发现,识别准确率与单词的LEC大小和在英语中的出现频率高度相关。聋人和听力正常的参与者在对单词LEC大小和频率的敏感度上没有差异。结果表明,视觉口语单词识别与其听觉对应物有很强的相似性,因为发现对词汇相似性和单词频率的相同依赖性会影响视觉语音识别准确率。特别是,结果表明基于刺激的词汇独特性是描述视觉和听觉口语单词识别潜在机制的一个有效概念。