Mateen Bilal Akhter, Doogan Catherine, Hayward Kate, Hourihan Susan, Hurford Joanne, Playford E Diane
University College London Medical School, London, UK; Therapy and Rehabilitation Services, National Hospital for Neurology and Neurosurgery, London, UK.
Therapy and Rehabilitation Services, National Hospital for Neurology and Neurosurgery, London, UK.
Arch Phys Med Rehabil. 2017 Mar;98(3):534-560. doi: 10.1016/j.apmr.2016.06.013. Epub 2016 Jul 15.
To examine the state of psychometric validation in the health-related work outcome literature.
We searched PubMed, PubMed Central, CINAHL, Embase (plus Embase Classic), and PsycINFO from inception to January 2016 using the following search terms: stroke, multiple sclerosis, epilepsy, spinal cord injury, brain injury, musculoskeletal disease, work, absenteeism, presenteeism, occupation, employment, job, outcome measure, assessment, work capacity evaluation, scale, and questionnaire.
From the 22,676 retrieved abstracts, 597 outcome measures were identified. Inclusion was based on content analysis. There were 95 health-related work outcome measures retained; of these, 2 were treated as outliers and therefore are discussed separately. All 6 authors individually organized the 93 remaining scales based on their content.
A follow-up search using the same sources, and time period, with the name of the outcome measures and the terms psychometric, reliability, validity, and responsiveness, identified 263 unique classical test theory psychometric property datasets for the 93 tools. An assessment criterion for psychometric properties was applied to each article, and where consensus was not achieved, the rating delivered by most of the assessors was reported.
Of the articles reported, 18 reporting psychometric data were not accessible and therefore could not be assessed. There were 39 that scored <20% of the maximum achievable score, 106 scored between 20% and 40%, 82 scored between 40% and 60%, 15 scored between 60% and 80%, and only 1 scored >80%. The 3 outcome measures associated with the highest scoring datasets were the Sheehan Disability Scale, the Fear Avoidance Beliefs Questionnaire, and the assessment of the Subjective Handicap of Epilepsy. Finally, only 2 psychometric validation datasets reported the complete set of baseline psychometric properties.
This systematic review highlights the current limitations of the health-related work outcome measure literature, including the limited number of robust tools available.
探讨健康相关工作成果文献中的心理测量学验证状况。
我们使用以下检索词,从创刊至2016年1月在PubMed、PubMed Central、CINAHL、Embase(包括Embase Classic)和PsycINFO中进行检索:中风、多发性硬化症、癫痫、脊髓损伤、脑损伤、肌肉骨骼疾病、工作、旷工、出勤主义、职业、就业、工作、结果测量、评估、工作能力评估、量表和问卷。
从检索到的22676篇摘要中,识别出597种结果测量方法。纳入基于内容分析。保留了95种与健康相关的工作成果测量方法;其中,2种被视为异常值,因此单独讨论。所有6位作者根据其内容分别对其余93个量表进行了整理。
使用相同来源和时间段,以结果测量方法的名称以及心理测量学、信度、效度和反应度等术语进行后续检索,为93种工具识别出263个独特的经典测试理论心理测量学特性数据集。将心理测量学特性的评估标准应用于每篇文章,在未达成共识的情况下,报告多数评估者给出的评分。
在报告的文章中,18篇报告心理测量学数据的文章无法获取,因此无法进行评估。有39篇得分低于最高可得分的20%,106篇得分在20%至40%之间,82篇得分在40%至60%之间,15篇得分在60%至80%之间,只有1篇得分超过80%。得分最高的数据集所关联的3种结果测量方法是希恩残疾量表、恐惧回避信念问卷和癫痫主观障碍评估。最后,只有2个心理测量学验证数据集报告了完整的基线心理测量学特性。
本系统评价突出了健康相关工作成果测量文献当前的局限性,包括可用的可靠工具数量有限。