Poburka Bruce J, Patel Rita R, Bless Diane M
Department of Speech, Hearing, & Rehabilitation Services, Minnesota State University, Mankato, Minnesota.
Department of Speech and Hearing Sciences, Indiana University, Bloomington, Indiana.
J Voice. 2017 Jul;31(4):513.e1-513.e14. doi: 10.1016/j.jvoice.2016.12.003. Epub 2016 Dec 28.
The purpose of the study was to evaluate the inter-judge and intra-judge reliability of raters using the Voice-Vibratory Assessment with Laryngeal Imaging (VALI) rating form that was developed for assessing videostroboscopy and high-speed videoendoscopic (HSV) recordings.
Nine speech-language pathologists with an average of 12.8 years of experience with laryngeal imaging were trained to use the VALI form for rating 66 de-identified and randomized samples with voice disorders. Inter-judge reliability for parameters with scale data (amplitude, mucosal wave, nonvibratory portion, supraglottic activity, phase closure, symmetry, and regularity or periodicity) was assessed with intraclass correlations, and parameters with nominal data (glottal closure, vertical level, and free edge contour) were assessed with Fleiss' kappa. Intra-judge reliability was assessed using the Spearman rho statistic for scale data and percentage of concordant pairs for nominal data.
Inter-judge reliability for parameters with scale data ranged from 0.57 to 0.96 for stroboscopy and from 0.81 to 0.94 for HSV. For nominal parameters, correlations ranged from 0.18 to 0.35 for stroboscopy and from 0.13 to 0.33 for HSV. Intra-judge reliability correlations for parameters with scale data ranged from 0.19 to 0.87 for stroboscopy and from 0.28 to 0.85 for HSV. For parameters with nominal data, percentage of concordance ranged from 44% to 78% for stroboscopy and from 52% to 89% for HSV.
The VALI rating form and the training protocol is a first, a priori developed rating form that includes visual-perceptual ratings of both stroboscopy and HSV. The current form can be used to make reliable visual-perceptual judgments for selected features of vibratory motion from stroboscopy and HSV.
本研究旨在评估使用为评估频闪喉镜检查和高速视频内镜(HSV)记录而开发的嗓音 - 振动评估与喉部成像(VALI)评分表的评估者之间和评估者内部的可靠性。
九名平均有12.8年喉部成像经验的言语病理学家接受培训,使用VALI表对66份去识别化且随机排列的嗓音障碍样本进行评分。对于具有量表数据的参数(振幅、黏膜波、非振动部分、声门上活动、相位闭合、对称性以及规律性或周期性),使用组内相关系数评估评估者间可靠性;对于具有名义数据的参数(声门闭合、垂直水平和游离缘轮廓),使用Fleiss' kappa评估评估者间可靠性。对于量表数据,使用Spearman等级相关系数评估评估者内部可靠性;对于名义数据,使用一致对百分比评估评估者内部可靠性。
对于频闪喉镜检查,具有量表数据的参数评估者间可靠性范围为0.57至0.96,对于HSV为0.81至0.94。对于名义参数,频闪喉镜检查的相关性范围为0.18至0.35,HSV为0.13至0.33。对于频闪喉镜检查,具有量表数据的参数评估者内部可靠性相关性范围为0.19至0.87,HSV为0.28至0.85。对于具有名义数据的参数,频闪喉镜检查的一致百分比范围为44%至78%,HSV为52%至89%。
VALI评分表和培训方案是首个先验开发的评分表,包括对频闪喉镜检查和HSV的视觉感知评分。当前的表格可用于对频闪喉镜检查和HSV中振动运动的选定特征进行可靠的视觉感知判断。