Department of Community Mental Health & Law, National Institute of Mental Health, National Center of Neurology and Psychiatry, Tokyo, Japan.
Faculty of Health and Social Services, Kanagawa University of Human Services, Yokosuka, Japan.
Neuropsychopharmacol Rep. 2021 Jun;41(2):248-254. doi: 10.1002/npr2.12172. Epub 2021 Mar 18.
The Japanese version of the individualized Supported Employment Fidelity scale (JiSEF) was developed by modifying the 25-item Individual Placement and Support Fidelity Scale (IPS-25). While a preliminary study partly confirmed the concurrent validity with vocational outcomes, this replication study aimed to examine the stability of the concurrent validity and the inter-rater reliability of the JiSEF and to test its convergent validity with IPS-25.
Fidelity assessments were conducted in 2016 (n = 17), 2017 (n = 13), and 2018 (n = 18) to examine the employment rate and the fidelity scores at the agency level. We also evaluated the fidelity scores for the IPS-25 in 2018. We examined the associations between the fidelity scale scores and vocational outcomes for the concurrent validity and between the fidelity scales for convergent validity. The inter-rater reliability was examined in the 2016 and 2017 assessments.
High intraclass correlation coefficients (0.93 in 2016 and 0.92 in 2017) were obtained for the inter-rater reliability. The JiSEF score in each year was associated with the agency employment rate (r = 0.710, P = 0.001 in 2016; r = 0.722, P = 0.005 in 2017; and r = 0.665, P = 0.003 in 2018). A supplementary longitudinal data analysis also confirmed the association between the JiSEF score and the employment outcomes. Additionally, the JiSEF was significantly correlated with the IPS-25 (r = 0.760, P < 0.001).
This study stably replicated good inter-rater reliability and concurrent validity of the JiSEF. Additionally, the convergent validity was confirmed. Further studies with large samples are needed to confirm these findings.
个性化支持就业保真度量表（JiSEF）的日译本是通过修改 25 项个体安置和支持保真度量表（IPS-25）而开发的。虽然一项初步研究部分证实了与职业结果的同时效度，但本复制研究旨在检验 JiSEF 的同时效度的稳定性和评分者间信度，并检验其与 IPS-25 的收敛效度。
2016 年（n=17）、2017 年（n=13）和 2018 年（n=18）进行了保真度评估，以检验机构层面的就业率和保真度得分。我们还评估了 2018 年 IPS-25 的保真度得分。我们检验了保真度量表分数与同时效度的职业结果之间的相关性，以及与收敛效度的保真度量表之间的相关性。2016 年和 2017 年的评估检验了评分者间信度。
在 2016 年和 2017 年，评分者间信度的组内相关系数（0.93 和 0.92）较高。每年的 JiSEF 评分与机构就业率相关（2016 年 r=0.710，P=0.001；2017 年 r=0.722，P=0.005；2018 年 r=0.665，P=0.003）。补充的纵向数据分析也证实了 JiSEF 评分与就业结果之间的关联。此外，JiSEF 与 IPS-25 显著相关（r=0.760，P<0.001）。
本研究稳定复制了 JiSEF 的良好评分者间信度和同时效度。此外，还证实了收敛效度。需要进一步进行大样本研究来证实这些发现。
