Spatial, tactile presentation of voice fundamental frequency as a supplement to lipreading: results of extended training with a single subject.

An adult with a severe, postlingually-acquired, sensorineural, hearing loss was given 2 hours a week of training in the perception of connected discourse by lipreading, supplemented by voice fundamental frequency (Fo), encoded as locus of vibratory stimulation of the forearm. Three, 3-week blocks of training in the supplemented condition were interspersed with 1-week periods of training by lipreading alone. Training was conducted via a computer-controlled, interactive video system, using a semi-automated connected discourse tracking procedure. Performance was measured as the percentage of words correctly recognized on the first presentation of new sentence material. Scores by lipreading alone averaged approximately 65 percent and remained essentially constant over the 13 weeks of training. Scores under the supplemented condition rose from 65 percent at the beginning of the study to 85 percent at the end. The final supplemented score represented roughly a 50 percent reduction of error rate, when compared with lipreading alone. Performance with the tactile supplement was not as good as with auditorily presented Fo, but was better than has previously been reported in the literature. These data provide evidence to support the notion that subjects can learn to integrate novel tactile codes with the visual stimulus during the lipreading of connected speech.