J Med Libr Assoc. 2022 Jan 1;110(1):23-33. doi: 10.5195/jmla.2022.1283.
This study compared the recall and precision of MeSH-term versus text-word searching to better understand psychosocial MeSH terms and to provide guidance on whether to include both strategies in an information literacy session or how much time should be spent on teaching each search strategy.
Using the relevant recall method, a total of 3,162 resources were considered and evaluated to form a gold standard set of 1,521 relevant resources. We compared resources discussing psychosocial aspects of children and adolescents living with type 1 diabetes using two search strategies: text-word strategy versus MeSH-term strategy. The frequency of MeSH terms, the MeSH hierarchy, and elements of each search strategy were also examined.
Using the 1,521 relevant articles, we found that the text-word search strategy had 54% recall, while the MeSH-term strategy had 75% recall. Also, the precision of the text-word strategy was 34.4%, while the precision of the MeSH-term strategy was 47.7%. Therefore, the MeSH-term search strategy yielded both greater recall and greater precision. The MeSH strategy was also more complicated in design and usage than the text-word strategy.
This study demonstrates the effectiveness of text-word and MeSH search strategies on precision and recall. The combination of text-word and MeSH strategies is recommended to achieve the most comprehensive results. These results support the idea that MeSH or a similar controlled vocabulary should be taught to experienced and knowledgeable students and practitioners who require a myriad of resources for their literature searches.
本研究比较了 MeSH 术语与文本词搜索的召回率和精度,以更好地理解心理社会 MeSH 术语,并就信息素养课程中是否应同时包含这两种策略以及应花费多少时间教授每种搜索策略提供指导。
使用相关的召回方法,共考虑并评估了 3162 个资源,以形成 1521 个相关资源的黄金标准集。我们比较了使用两种搜索策略(文本词策略与 MeSH 术语策略)讨论 1 型糖尿病儿童和青少年心理社会方面的资源。还检查了 MeSH 术语的频率、MeSH 层次结构以及每个搜索策略的元素。
使用 1521 篇相关文章,我们发现文本词搜索策略的召回率为 54%,而 MeSH 术语策略的召回率为 75%。此外,文本词策略的精度为 34.4%,而 MeSH 术语策略的精度为 47.7%。因此,MeSH 术语搜索策略既具有更高的召回率,又具有更高的精度。MeSH 策略在设计和使用上也比文本词策略更为复杂。
本研究表明文本词和 MeSH 搜索策略在精度和召回率上都有效。建议同时使用文本词和 MeSH 策略以获得最全面的结果。这些结果支持这样的观点,即 MeSH 或类似的受控词汇应教授给需要为其文献搜索检索大量资源的有经验和知识渊博的学生和从业人员。