J Med Libr Assoc. 2021 Oct 1;109(4):583-589. doi: 10.5195/jmla.2021.1224.
We previously developed draft MEDLINE and Embase (Ovid) geographic search filters for Organisation for Economic Co-operation and Development (OECD) countries to assess their feasibility for finding evidence about the countries. Here, we describe the validation of these search filters.
We identified OECD country references from thirty National Institute for Health and Care Excellence (NICE) guidelines to generate gold standard sets for MEDLINE (n=2,065) and Embase (n=2,023). We validated the filters by calculating their recall against these sets. We then applied the filters to existing search strategies for three OECD-focused NICE guideline reviews (NG103 on flu vaccination, NG140 on abortion care, and NG146 on workplace health) to calculate the filters' impact on the number needed to read (NNR) of the searches.
The filters both achieved 99.95% recall against the gold standard sets. Both filters achieved 100% recall for the three NICE guideline reviews. The MEDLINE filter reduced NNR from 256 to 232 for the NG103 review, from 38 to 27 for the NG140 review, and from 631 to 591 for the NG146 review. The Embase filter reduced NNR from 373 to 341 for the NG103 review, from 101 to 76 for the NG140 review, and from 989 to 925 for the NG146 review.
The NICE OECD countries' search filters are the first validated filters for the countries. They can save time for research topics about OECD countries by finding the majority of evidence about OECD countries while reducing search result volumes in comparison to no filter use.
我们之前开发了针对经济合作与发展组织（OECD）国家的 MEDLINE 和 Embase（Ovid）地理搜索筛选器草案，以评估其在寻找有关这些国家的证据方面的可行性。在此，我们描述了这些搜索筛选器的验证过程。
我们从三十项英国国家卫生与临床优化研究所（NICE）指南中确定了 OECD 国家的参考文献，以生成 MEDLINE（n=2065）和 Embase（n=2023）的黄金标准集。我们通过计算这些筛选器与这些数据集的召回率来验证筛选器的性能。然后，我们将筛选器应用于三个针对 OECD 国家的 NICE 指南审查（关于流感疫苗接种的 NG103、关于堕胎护理的 NG140 和关于工作场所健康的 NG146）的现有搜索策略中，以计算筛选器对搜索的所需阅读次数（NNR）的影响。
这两个筛选器在黄金标准集上的召回率均达到 99.95%。这两个筛选器在三个 NICE 指南审查中均达到了 100%的召回率。MEDLINE 筛选器将 NG103 审查的 NNR 从 256 减少到 232，将 NG140 审查的 NNR 从 38 减少到 27，将 NG146 审查的 NNR 从 631 减少到 591。Embase 筛选器将 NG103 审查的 NNR 从 373 减少到 341，将 NG140 审查的 NNR 从 101 减少到 76，将 NG146 审查的 NNR 从 989 减少到 925。
这些针对英国国家卫生与临床优化研究所的 OECD 国家搜索筛选器是首批针对这些国家的经过验证的筛选器。与不使用筛选器相比，它们可以通过查找关于 OECD 国家的大部分证据来节省研究主题的时间，同时减少搜索结果量。
