Roark Brian, Mitchell Margaret, Hosom John-Paul, Hollingshead Kristy, Kaye Jeffrey
Center for Spoken Language Understanding, Department of Biomedical Engineering, Oregon Health and Science University, Portland, OR 97239 USA.
IEEE Trans Audio Speech Lang Process. 2011 Sep 1;19(7):2081-2090. doi: 10.1109/TASL.2011.2112351.
Spoken responses produced by subjects during neuropsychological exams can provide diagnostic markers beyond exam performance. In particular, characteristics of the spoken language itself can discriminate between subject groups. We present results on the utility of such markers in discriminating between healthy elderly subjects and subjects with mild cognitive impairment (MCI). Given the audio and transcript of a spoken narrative recall task, a range of markers are automatically derived. These markers include speech features such as pause frequency and duration, and many linguistic complexity measures. We examine measures calculated from manually annotated time alignments (of the transcript with the audio) and syntactic parse trees, as well as the same measures calculated from automatic (forced) time alignments and automatic parses. We show statistically significant differences between clinical subject groups for a number of measures. These differences are largely preserved with automation. We then present classification results, and demonstrate a statistically significant improvement in the area under the ROC curve (AUC) when using automatic spoken language derived features in addition to the neuropsychological test scores. Our results indicate that using multiple, complementary measures can aid in automatic detection of MCI.
在神经心理学测试中,受试者给出的口头回答能够提供超越测试表现的诊断标志物。特别是,口语本身的特征能够区分不同的受试者群体。我们展示了此类标志物在区分健康老年人和轻度认知障碍(MCI)受试者方面的效用。给定一个口头叙述回忆任务的音频和文字记录,一系列标志物会自动生成。这些标志物包括诸如停顿频率和时长等语音特征,以及许多语言复杂性度量。我们研究了根据(文字记录与音频的)手动标注时间对齐和句法剖析树计算得出的度量,以及根据自动(强制)时间对齐和自动剖析计算得出的相同度量。我们发现,对于许多度量,临床受试者群体之间存在统计学上的显著差异。这些差异在自动化处理后基本得以保留。然后我们展示了分类结果,并证明在使用神经心理学测试分数之外,再加上从自动口语衍生特征时,ROC曲线下面积(AUC)有统计学上的显著提升。我们的结果表明,使用多种互补的度量有助于MCI的自动检测。