University of Hull, School of Sport, Exercise and Rehabilitation Sciences, Hull, United Kingdom.
Department for Health, University of Bath, Bath, United Kingdom.
PLoS One. 2024 Mar 8;19(3):e0295953. doi: 10.1371/journal.pone.0295953. eCollection 2024.
The aim of this research was to assess the validity and reliability of a newly developed scoring tool, designed for monitoring youth soccer players during match-play performance to support coaches/scouts with the talent identification process. The method used to design the Hull Soccer Behavioural Scoring Tool comprised of a five-stage process of (i) conducting an initial literature review to establish content validity (ii) gaining content validity through a cross sectional online survey (iii) establishing face validity via expert coach feedback (iv) conducting inter-rater reliability tests and (v) intra-rater reliability tests. In stage two, twenty-two soccer academy practitioners completed an online survey, which revealed that player behaviours such as resilience, competitiveness, and decision making were all valued as the most important behavioural characteristics by practitioners (90.9%), whilst X-factor was valued as least important by a significant amount (27.2%). Stages three to five of the testing procedure included a sample of four academy coaches not involved in the preceding stage. Twenty male collegiate soccer players (under-16 to under-18) involved in the study took part in four versus four small-sided games (SSG) in a 'round-robin' tournament across three weeks which accumulated 14 SSG's, 100-140 minutes of playing time and 70-98 individual player grades. Two of the four academy coaches watched the SSG's and used the Hull Soccer Behavioural Scoring Tool to assess live evidence of desirable player behaviours, which was subsequently followed by retrospective video analysis for intra-rater reliability testing. The remaining two academy coaches watched the same SSG retrospective video footage to test for inter-rater reliability. Reliability results revealed an acceptable level of agreement with scores between 81.25%-89.9% for inter-rater whilst intra-rater provided scores between 80.35%-99.4%. Preliminary evidence here suggests that the Hull Soccer Behavioural Scoring Tool is both a valid and reliable method to assess desirable player behaviours during talent identification processes. Thus, youth soccer practitioners and researchers should seek to test and further validate the tool in order to confirm its utility as a means of measuring behavioural characteristics of youth soccer players.
本研究旨在评估一种新开发的评分工具的有效性和可靠性,该工具旨在监测青年足球运动员在比赛中的表现,以支持教练/球探进行人才识别过程。设计 Hull 足球行为评分工具的方法包括五个阶段:(i)进行初步文献综述以建立内容有效性;(ii)通过横断面在线调查获得内容有效性;(iii)通过专家教练反馈建立表面有效性;(iv)进行评分者间信度测试;(v)评分者内信度测试。在第二阶段,22 名足球学院从业者完成了一项在线调查,结果显示,韧性、竞争力和决策能力等球员行为被从业者视为最重要的行为特征(90.9%),而“X 因素”被认为是最不重要的行为特征(27.2%)。测试程序的第三至第五阶段包括前一阶段未参与的四名学院教练的样本。20 名参与研究的男性大学生足球运动员(16 岁以下至 18 岁以下)参加了为期三周的“循环赛”四对四小场比赛(SSG),共进行了 14 场 SSG,100-140 分钟的比赛时间和 70-98 个个人球员等级。四名学院教练中的两名观看了 SSG,并使用 Hull 足球行为评分工具评估了理想球员行为的现场证据,随后进行了回顾性视频分析以进行评分者内信度测试。剩下的两名学院教练观看了相同的 SSG 回顾性视频片段,以测试评分者间信度。信度结果显示,评分者间的一致性水平可接受,得分为 81.25%-89.9%,而评分者内的一致性水平为 80.35%-99.4%。这里的初步证据表明,Hull 足球行为评分工具是一种在人才识别过程中评估理想球员行为的有效且可靠的方法。因此,青年足球从业者和研究人员应该寻求测试和进一步验证该工具,以确认其作为衡量青年足球运动员行为特征的手段的实用性。