Eady Angela May, Wilczynski Nancy L, Haynes R Brian
Health Information Research Unit, Department of Clinical Epidemiology and Biostatistics, McMaster University, 1200 Main Street West, Hamilton, Ontario, Canada.
J Clin Epidemiol. 2008 Jan;61(1):34-40. doi: 10.1016/j.jclinepi.2006.09.016.
This study evaluated search strategies for finding high-quality studies on treatment and systematic reviews in PsycINFO.
Sixty-four journals were hand searched at McMaster University. Methodologic criteria were applied to clinically relevant articles to identify "pass" and "fail" articles; 4,985 candidate terms were compiled, 7,463 combinations for therapy articles, and 5,246 combinations for reviews. Candidate search strategy results were compared with hand searches. The proposed strategies served as "diagnostic tests" for sound studies; the hand searches were the "gold standard." Sensitivity, specificity, precision, and accuracy were calculated.
Of 716 treatment articles, 233 (32.5%) met criteria for scientific merit, and 58 (11.5%) of 506 review articles met criteria for systematic reviews. For treatment studies, combined terms had a peak sensitivity of 97.9% (specificity 52.2%). Maximum specificity was 97.7% (sensitivity 51.5%). Sensitivity and specificity were each 79% when optimizing both while minimizing their difference. For review articles, combined terms had a peak sensitivity of 81.0% (specificity 54.4%). Maximum specificity was 98.1% (sensitivity 51.7%). Sensitivity and specificity were each 65% when optimizing both while minimizing their difference.
Empirically derived search strategies can achieve high sensitivity and specificity for retrieving sound treatment studies and review articles from PsycINFO.
本研究评估了在PsycINFO中查找关于治疗的高质量研究和系统评价的检索策略。
在麦克马斯特大学对64种期刊进行了手工检索。将方法学标准应用于临床相关文章,以识别“通过”和“未通过”的文章;汇编了4985个候选术语,治疗文章有7463种组合,综述文章有5246种组合。将候选检索策略的结果与手工检索结果进行比较。所提出的策略作为对可靠研究的“诊断测试”;手工检索是“金标准”。计算了敏感性、特异性、精确性和准确性。
在716篇治疗文章中,233篇(32.5%)符合科学价值标准,在506篇综述文章中,58篇(11.5%)符合系统评价标准。对于治疗研究,组合术语的峰值敏感性为97.9%(特异性为52.2%)。最大特异性为97.7%(敏感性为51.5%)。在优化两者同时最小化差异时,敏感性和特异性均为79%。对于综述文章,组合术语的峰值敏感性为81.0%(特异性为54.4%)。最大特异性为98.1%(敏感性为51.7%)。在优化两者同时最小化差异时,敏感性和特异性均为65%。
通过实证得出的检索策略在从PsycINFO中检索可靠的治疗研究和综述文章时可实现较高的敏感性和特异性。