Feinstein Hagar, Daşdöğen Ümit, Awan Jordan A, Awan Shaheen N, Abbott Katherine Verdolini
Department of Communication Sciences & Disorders, University of Delaware, Newark, Delaware.
Department of Communication Sciences & Disorders, University of Delaware, Newark, Delaware.
J Voice. 2023 Mar 10. doi: 10.1016/j.jvoice.2023.01.005.
The primary aim was to compare two methods for perceptual evaluation of voice - paired comparison (PC) and visual analog scale (VAS) ratings. Secondary aims were to assess the correspondence between two dimensions of voice- overall severity of voice quality and resonant voice, and to investigate the influence of rater experience on perceptual rating scores and rating confidence scores.
Experimental design.
Voice samples from six children (pre and post therapy) were rated by 15 Speech-Language Pathologists specialized in voice. Raters completed four tasks corresponding to the two rating methods and voice qualities: PC-severity, PC-resonance, VAS-severity, and VAS-resonance. For PC tasks, raters chose the better of two voice samples (better voice quality or better resonance, depending on the task) and indicated the degree of confidence in each choice. Rating and confidence score were combined to produce a number on a 1-10 scale (PC-confidence adjusted). VAS ratings involved rating voices on a scale for degree of severity and resonance, respectively.
PC-confidence adjusted and VAS ratings were moderately correlated for overall severity and also vocal resonance. VAS ratings were normally distributed and had greater rater consistency than PC-confidence adjusted ratings. VAS scores reliably predicted binary PC choices (choice of voice sample only). Overall severity and vocal resonance were weakly correlated and rater experience was not linearly related to rating scores or confidence.
Results suggest that the VAS rating method holds advantages over PC, including normally distributed ratings, superior consistency of ratings, and the ability to provide more finely grained detail regarding the auditory perception of voice. Overall severity and vocal resonance were not redundant in the current data set, suggesting that resonant voice and overall severity are not isomorphic. Finally, the number of years of clinical experience was not linearly related to perceptual ratings or rating confidence.
主要目的是比较两种嗓音感知评估方法——配对比较(PC)和视觉模拟量表(VAS)评分。次要目的是评估嗓音的两个维度——嗓音质量总体严重程度和共鸣嗓音之间的对应关系,并研究评分者经验对感知评分分数和评分置信度分数的影响。
实验设计。
15名专门从事嗓音研究的言语病理学家对6名儿童(治疗前后)的嗓音样本进行评分。评分者完成了与两种评分方法和嗓音质量相对应的四项任务:PC-严重程度、PC-共鸣、VAS-严重程度和VAS-共鸣。对于PC任务,评分者选择两个嗓音样本中较好的一个(根据任务,嗓音质量更好或共鸣更好),并指出对每个选择的置信度。将评分和置信度分数结合起来,得出一个1至10分的数值(调整后的PC置信度)。VAS评分分别涉及在严重程度和共鸣程度量表上对嗓音进行评分。
调整后的PC置信度与VAS评分在总体严重程度和嗓音共鸣方面呈中度相关。VAS评分呈正态分布,并且比调整后的PC置信度评分具有更高的评分者一致性。VAS分数能够可靠地预测二元PC选择(仅嗓音样本的选择)。总体严重程度和嗓音共鸣呈弱相关,评分者经验与评分分数或置信度不存在线性关系。
结果表明,VAS评分方法比PC具有优势,包括评分呈正态分布、评分一致性更高,以及能够提供有关嗓音听觉感知的更细致细节。在当前数据集中,总体严重程度和嗓音共鸣并非冗余,这表明共鸣嗓音和总体严重程度并非同构。最后,临床经验年限与感知评分或评分置信度不存在线性关系。