Obesity Research Center, Research Institute for Endocrine Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran.
Ophthalmic Epidemiology Research Center, Research Institute for Ophthalmology and Vision Science, Shahid Beheshti University of Medical Sciences, Tehran, Iran.
BMC Health Serv Res. 2023 Jul 4;23(1):726. doi: 10.1186/s12913-023-09605-2.
Clinical registries facilitate medical research by providing 'real data'. In the past decade, an increasing number of disease registry systems (DRS) have been initiated in Iran. Here, we assessed the quality control (QC) of the data recorded in the DRS established by Shahid Beheshti University of Medical Sciences in Tehran, the capital city of Iran, in 2021.
The present study was conducted in two consecutive qualitative and quantitative phases and employed a mixed-method design. A checklist containing 23 questions was developed based on a consensus reached following several panel group discussions, whose face content and construct validities were confirmed. Cronbach's alpha was calculated to verify the tool's internal consistency. Overall, the QC of 49 DRS was assessed in six dimensions, including completeness, timeliness, accessibility, validity, comparability, and interpretability. The seventy percent of the mean score was considered a cut-point for desirable domains.
The total content validity index (CVI) was obtained as 0.79, which is a reasonable level. Cronbach's alpha coefficients obtained showed acceptable internal consistency for all of the six QC domains. The data recorded in the registries included different aspects of diagnosis/treatment (81.6%) and treatment quality requirements outcomes (12.2%). According to the acceptable quality cut-point, out of 49 evaluated registries, 48(98%), 46(94%), 41(84%), and 38(77.5%), fulfilled desirable quality scores in terms of interpretability, accessibility, completeness, and comparability, however, 36(73.5%) and 32(65.3%) of registries obtained the quality requirement for timeliness and validity, respectively.
The checklist developed here, containing customized questions to assess six QC domains of DRSs, provided a valid and reliable tool that could be considered as a proof-of-concept for future investigations. The clinical data available in the studied DRSs fulfilled desirable levels in terms of interpretability, accessibility, comparability, and completeness; however, timeliness and validity of these registries needed to be improved.
临床注册系统通过提供“真实数据”来促进医学研究。在过去的十年中,伊朗启动了越来越多的疾病登记系统(DRS)。在这里,我们评估了 2021 年由伊朗首都德黑兰的沙希德·贝赫什提大学医学科学研究所建立的 DRS 中记录的数据的质量控制(QC)。
本研究分两个连续的定性和定量阶段进行,采用混合方法设计。根据多次小组讨论达成的共识制定了一份包含 23 个问题的检查表,其内容和结构效度得到了确认。采用克朗巴赫 α 系数验证工具的内部一致性。总体而言,从六个维度评估了 49 个 DRS 的 QC,包括完整性、及时性、可及性、有效性、可比性和可解释性。70%的平均得分为理想域的截定点。
总内容效度指数(CVI)为 0.79,属于合理水平。六个 QC 领域的克朗巴赫α系数均显示出可接受的内部一致性。登记册中记录的数据包括诊断/治疗的不同方面(81.6%)和治疗质量要求结果(12.2%)。根据可接受的质量截定点,在所评估的 49 个登记册中,有 48(98%)、46(94%)、41(84%)和 38(77.5%)在可解释性、可及性、完整性和可比性方面达到了理想的质量评分,然而,36(73.5%)和 32(65.3%)的登记册分别达到了及时性和有效性的质量要求。
这里开发的检查表包含了评估 DRS 六个 QC 领域的定制问题,提供了一个有效和可靠的工具,可以作为未来研究的概念验证。研究中 DRS 中的临床数据在可解释性、可及性、可比性和完整性方面达到了理想水平;然而,这些登记册的及时性和有效性需要改进。