期刊文献+

信息检索中的相关性判断和系统评价述评 被引量:11

Judgment of Relevance and the Evaluation of Information Retrieval Systems
在线阅读 下载PDF
导出
摘要 信息检索系统的效果评价是信息检索研究必不可少的环节,也是检验信息检索理论和进行方法研究的重要途径之一。本文首先从相关性理论出发,讨论了信息检索中检出文档相关性的维度和度量问题,以及等级相关性判断和大规模数据集的相关性评估方法。其次,进一步介绍了信息检索系统效果评价的基本指标查全率和查准率,并对常用评价指标MAP、Bpref等进行了比较和分析。最后,笔者认为未来信息检索系统效果评价的研究应注重将用户纳入评价体系中,使评价结果更具有真实性和实用性。 The evaluation on the effectiveness of information retrieval system is indispensable in information retrieval study, and is also one of the important approaches to testify theories and study methods in IR fields. Firstly, this paper discusses the obstacles about dimensions and measures of relevance, and approches for judging relevance of documents on the basis of relevance framework, such as rank relevance judgment, and etc. Secondly, the paper focuses on the two basic measures (Precision and Recall ) , and frequently used measures for evaluating and IR system, then make a comparison between them. Finally, the future study of information retrieval effectiveness evaluation should give more focus on Users, which makes the evaluation results more valuable.
出处 《图书情报知识》 CSSCI 北大核心 2009年第4期89-94,共6页 Documentation,Information & Knowledge
基金 国家社科基金青年项目"基于网络信息计量的网络信息资源配置与调控机制研究"(05CTQ004)研究成果之一
关键词 信息检索 相关性判断 评价 Information retrieval Relevance judgment Evaluation
作者简介 秦喜艳,女,硕士生; 陆伟,男,博士、副教授; 姜捷璞,男,硕士生。
  • 相关文献

参考文献33

  • 1Rijsbergen C. J. Information retrieval. Butterworth- Heinemann, Newton, MA, 1979.
  • 2Cosijn E, Bothma T. Contexts of relevance for informa tion retrieval system design.//Crestani F,Ruthven Ⅰ. In formation context: nature, impact, and role, Springer Ber lin/Heidelberg, 2005.47-58.
  • 3Mizzaro S. How many relevances in information retrieval?. Interacting with Computers, 10: 303-320, 1998.
  • 4Saracevic T. The stratified model of information retrieval interaction: Extension and applications. Proceedings of the American Society for Information Science, 34: 313- 327, 1997.
  • 5Goffman W. On relevance as a measure. Information Storage and Retrieval, 1964, 2(3): 201-203.
  • 6Park T. K. The nature of relevance in information re trieval: An empirical study. Library Quarterly, 1993, 63 (3) : 318-351.
  • 7Chamber L. Relevance and information behavior. Annual review of information science and technology, 1994, 29: 3-48.
  • 8Lest M. E, Salton G. Relevance assessments and retrieval system evaluation. Information Storage and Retrieval, 1969, 4: 343-359.
  • 9Sormunen E. A novel method for the evaluation of boolean query effectiveness across a wide operational range. ACM SIGIR 23, 2000, 25-32.
  • 10INEX官方网站.http://inex.is.informatik.uni-duis-burg.de/(2008-05-11).

二级参考文献18

  • 1Belkin, N. J, R. N. Oddy and H. M. Brooks. 1982. "ASK for information retrieval." Journal of Documentation 38(2): 61-71 and 38(3):145-164.
  • 2Cooper, W. S. 1971. "A definition of relevance for information retrieval." Information Storage and Retrieval 7(1): 19-37.
  • 3Cooper, W. S. 1973. "On selecting a measure of retrieval effectiveness, part 1. The subjective philosophy of evaluation." Journal of the American Society for Information Science 24(2): 87-100.
  • 4Cosijn, E. and P. Ingwersen. 2000. "Dimensions of relevance". Information Processing and Management 36: 533-550.
  • 5Cuadra, C. A. and R. V. Katter. 1967. Experimental Studies of Relevance Judgments: Final Report. I: Project Summary (NSF Report No. TM-3520/001/00). Santa Monica, CA: System Development Corporation.
  • 6Dervin, B. 1983. An Overview of Sense-Making Research: Concepts, Methods and Results to Date. Paper presented at the International Communication Association Annual Meeting, Dallas, TX.
  • 7Fairthorne, R. A. 1963. "Implications of test procedures." In A. Kent ed. Information Retrieval in Action. Cleveland: Case Western Reserve University Press.
  • 8MacMullin, S. E., and R. S. Taylor. 1984. "Problem dimensions and information traits." The Information Society 3( 1 ): 91 - 111.
  • 9Mizzaro, S. 1998. "How many relevances in information retrieval?" Interacting with Computers 10:305-322.
  • 10Rees, A. M., and D. G. Schultz. 1967. A Field Experimental Approach to the Study of Relevance Assessments in Relation to Document Searching. I: Final Report (NSF Contract No. C-423). Cleveland: Case Western Reserve University.

共引文献36

同被引文献123

引证文献11

二级引证文献23

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部