National Neuroscience Institute, Singapore, Singapore.
Neuroinformatics. 2010 Dec;8(4):261-71. doi: 10.1007/s12021-010-9079-5.
Systematic reviews and meta-analyses constitute one of the central pillars of evidence-based medicine. However, clinical trials are poorly reported which delays meta-analyses and consequently the translation of clinical research findings to clinical practice. We propose a Center of Excellence in Research Reporting in Neurosurgery (CERR-N) and the creation of a clinically significant computational ontology to encode Randomized Controlled Trials (RCT) studies in neurosurgery. A 128 element strong computational ontology was derived from the Trial Bank ontology by omitting classes which were not required to perform meta-analysis. Three researchers from our team tagged five randomly selected RCT's each, published in the last 5 years (2004-2008), in the Journal of Neurosurgery (JoN), Neurosurgery Journal (NJ) and Journal of Neurotrauma (JoNT). We evaluated inter and intra observer reliability for the ontology using percent agreement and kappa coefficient. The inter-observer agreement was 76.4%, 75.97% and 74.9% and intra-observer agreement was 89.8%, 80.8% and 86.56% for JoN, NJ and JoNT respectively. The inter-observer kappa coefficient was 0.60, 0.54 and 0.53 and the intra-observer kappa coefficient was 0.79, 0.82 and 0.79 for JoN, NJ and JoNT journals respectively. The high degree of inter and intra-observer agreement confirms tagging consistency in sections of a given scientific manuscript. Standardizing reporting for neurosurgery articles can be reliably achieved through the integration of a computational ontology within the context of a CERR-N. This approach holds potential for the overall improvement in the quality of reporting of RCTs in neurosurgery, ultimately streamlining the translation of clinical research findings to improvement in patient care.
系统评价和荟萃分析构成循证医学的核心支柱之一。然而，临床试验报告质量较差，这延迟了荟萃分析的进行，并进而影响了临床研究结果向临床实践的转化。我们建议成立神经外科学研究报告卓越中心（CERR-N），并创建一个具有临床意义的计算本体，用于对神经外科的随机对照试验（RCT）进行编码。通过从 Trial Bank 本体中删除不进行荟萃分析所需的类，得到了一个由 128 个元素组成的计算本体。我们团队的三名研究人员分别对《神经外科学杂志》（JoN）、《神经外科杂志》（NJ）和《神经创伤杂志》（JoNT）过去五年（2004-2008 年）发表的五篇随机 RCT 进行了标记。我们使用百分比一致性和 Kappa 系数评估了本体的观察者间和观察者内可靠性。观察者间的一致性分别为 76.4%、75.97%和 74.9%，观察者内的一致性分别为 89.8%、80.8%和 86.56%。JoN、NJ 和 JoNT 期刊的观察者间 Kappa 系数分别为 0.60、0.54 和 0.53，观察者内 Kappa 系数分别为 0.79、0.82 和 0.79。高的观察者间和观察者内一致性证实了在给定科学手稿的部分中标记的一致性。通过在 CERR-N 背景下整合计算本体，可以可靠地实现对神经外科文章报告的标准化。这种方法有可能全面提高神经外科 RCT 的报告质量，最终简化临床研究结果向改善患者护理的转化。
