Kagolovsky Yuri, Moehr Jochen R
School of Health Information Science, University of Victoria, P.O. Box 3050, Victoria, British Columbia, Canada V8W 3P5.
J Med Syst. 2003 Oct;27(5):409-24. doi: 10.1023/a:1025603704680.
This is the second in the series of the articles on an application of the systems analytic approach to evaluation of information retrieval (IR). In the previous article a historical overview of IR was presented and existing terminological problems associated with IR were identified and discussed. In the presented article the current status of IR evaluation is summarized, and different evaluation approaches are discussed. The Cranfield evaluation model and the most often used relevance-based measures of recall and precision are explained, and their problems are presented. Possible evaluation alternatives to the Cranfield model are discussed, and the case for a systems analytic approach to IR is summarized.
这是关于系统分析方法应用于信息检索(IR)评估系列文章中的第二篇。在前一篇文章中,呈现了信息检索的历史概述,并识别和讨论了与信息检索相关的现有术语问题。在本文中,总结了信息检索评估的现状,并讨论了不同的评估方法。解释了克兰菲尔德评估模型以及最常用的基于相关性的召回率和精确率度量,并指出了它们存在的问题。讨论了克兰菲尔德模型可能的评估替代方案,并总结了采用系统分析方法进行信息检索的理由。