Leandro Catarina, Ávila-Carvalho Lurdes, Sierra-Palmeiro Elena, Bobo-Arce Marta
Faculty of Psychology, Education and Sport, University Lusófona of Porto, Porto, Portugal.
Faculty of sport Science and Physical Education, University of Coruña, Coruña, Spain.
J Hum Kinet. 2017 Dec 28;60:159-165. doi: 10.1515/hukin-2017-0099. eCollection 2017 Dec.
This study aimed to analyse the quality of difficulty judging in rhythmic gymnastics, at different levels of performance. The sample consisted of 1152 difficulty scores concerning 288 individual routines, performed in the World Championships in 2013. The data were analysed using the mean absolute judge deviation from the final difficulty score, a Cronbach's alpha coefficient and intra-class correlations, for consistency and reliability assessment. For validity assessment, mean deviations of judges' difficulty scores, the Kendall's coefficient of concordance W and ANOVA eta-squared values were calculated. Overall, the results in terms of consistency (Cronbach's alpha mostly above 0.90) and reliability (intra-class correlations for single and average measures above 0.70 and 0.90, respectively) were satisfactory, in the first and third parts of the ranking on all apparatus. The medium level gymnasts, those in the second part of the ranking, had inferior reliability indices and highest score dispersion. In this part, the minimum of corrected item-total correlation of individual judges was 0.55, with most values well below, and the matrix for between-judge correlations identified remarkable inferior correlations. These findings suggest that the quality of difficulty judging in rhythmic gymnastics may be compromised at certain levels of performance. In future, special attention should be paid to the judging analysis of the medium level gymnasts, as well as the Code of Points applicability at this level.
本研究旨在分析不同表现水平的艺术体操难度评分质量。样本包括2013年世界锦标赛上288套个人成套动作的1152个难度得分。使用与最终难度得分的平均绝对裁判偏差、克朗巴哈系数α和组内相关系数对数据进行分析,以评估一致性和可靠性。为了进行有效性评估,计算了裁判难度得分的平均偏差、肯德尔和谐系数W和方差分析的eta平方值。总体而言,在所有器械排名的第一和第三部分,一致性(克朗巴哈系数α大多高于0.90)和可靠性(单项和平均测量的组内相关系数分别高于0.70和0.90)方面的结果令人满意。中等水平的体操运动员,即排名第二部分的运动员,可靠性指标较差且得分离散度最高。在这一部分,个别裁判的校正项总相关系数最小值为0.55,大多数值远低于此,并且裁判间相关矩阵显示出明显较低的相关性。这些发现表明,艺术体操难度评分质量在某些表现水平上可能受到影响。未来,应特别关注中等水平体操运动员的评分分析,以及该水平的评分规则适用性。