The Web Retrieval Task and its evaluation in the Third NTCIR Workshop

Koji Eguchi, Keizo Oyama, Emi Ishida, Kazuko Kuriyama, Noriko Kando

Research output: Contribution to journalConference articlepeer-review

7 Citations (Scopus)


This paper gives an overview of the evaluation method used for the Web Retrieval Task in the Third NTCIR Workshop, which is currently in progress. In the Web Retrieval Task, we try to assess the retrieval effectiveness of each Web search engine system using a common data set, and attempt to build a re-usable test collection suitable for evaluating Web search engine systems. With these objectives, we have built 100-gigabyte and 10-gigabyte document sets, mainly gathered from the 'jp' domain. Relevance judgment is performed on the retrieved documents, which are written in Japanese or English.

Original languageEnglish
Pages (from-to)375-376
Number of pages2
JournalSIGIR Forum (ACM Special Interest Group on Information Retrieval)
Publication statusPublished - 2002
Externally publishedYes
EventProceedings of the Twenty-Fifth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval - Tampere, Finland
Duration: Aug 11 2002Aug 15 2002

All Science Journal Classification (ASJC) codes

  • Management Information Systems
  • Hardware and Architecture


Dive into the research topics of 'The Web Retrieval Task and its evaluation in the Third NTCIR Workshop'. Together they form a unique fingerprint.

Cite this