Abstract
This paper introduces the NTCIR Workshops, a series of evaluation workshops designed to enhance research in Japanese and Asian language text retrieval, cross-lingual information retrieval, and related text processing techniques such as summarization, extraction, etc. by providing large-scale test collections and a forum of researchers. Twenty-eight groups from six countries participated in the first workshop and forty-six groups from eight countries have registered for the second. The test collections used in the Workshops are basically TREC-type collections but they contain several unique characteristics including multi-grade relevance judgments. Finally some thoughts on future directions are suggested.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
NTCIR Project: http://research.nii.ac.jp/ntcir/
NTCIR Workshop 1: Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition, Aug. 30-Sept. 1, 1999, Tokyo, ISBN 4-924600-77-6. (http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings
TREC URL: http://trec.nist.gov
NTCIR Workshop 2: http://research.nii.ac.jp/ntcir-ws2
Kando, N.: Cross-Linguistic Scholarly Information Transfer and Database Services in Japan. Annual Meeting of the ASIS, Washington DC. 1997
Chiang, Yu-ting: A Study on Design and Implementation for Chinese Information Retrieval Benchmark. Master Thesis, National Taiwan University, 1999, 184 p.
Shaw, W.M., Jr, et al.: The cystic fibrosis database: Content and research opportunities. Library and Information Science Research, 13, 347–366, 1991.
Hersh, W., et al.: OHSUMED: an Interactive Retrieval Evaluation and New Large Test Collection for Research. Proceedings of ACM-SIGIR’94. p.192–201, 1994.
Losee, R.M.: Text retrieval and filtering: analytic models of performance. Kluwer, 1998
Borlund, P., Ingwersen, P.: Measures of relative relevance and ranked half-life: Performance indicators for interactive IR. Proceedings of ACM-SIGIR 98, p.324–331, 1998.
Jarvelin, K., Kekalainen, J.: IR evaluation methods for retrieving highly relevant documents. Proceedings of ACM-SIGIR 2000, p. 41–48, 2000.
Kando, N. et al.: NTCIR-1: Its Policy and Practice, IPSJ SIG Notes, Vol.99, No.20, pp. 33–40, 1999 [in Japanese].
Kuriyama, K. et al.: Pooling for a Large Scale Test Collection: Analysis of the Search Results for the Pre-test of the NTCIR-1 Workshop, IPSJ SIG Notes, May, 1999 [in Japanese].
Kuriyama, K. et al.: Construction of a Large Scale Test Collection: Analysis of the Training Topics of the NTCIR-1, IPSJ SIG Notes, July 1999 [in Japanese].
Kando, N. et al.: Construction of a Large Scale Test Collection: Analysis of the Test Topics of the NTCIR-1, in Proceedings of IPSJ Annual Meeting [in Japanese]. Sept, 30-Oct.3, 1999.
Voorhees, E.M.: Variations in Relevance Judgments and the Measurement of Retrieval Effectiveness, in Proceedings of the ACM SIGIR’ 98, pp. 315–323.
Ballesteros, L. et al.: Resolving ambiguity for cross-language retrieval, in Proceedings of the ACM SIGIR’ 98, pp. 64–71.
Shauble, P. et al.: Cross-language Information Retrieval (CLIR) Track overview, in Proceedings of TREC 6, pp. 25–30, 1998.
Kando, N. et al.: Cross-Lingual Information Retrieval using Automatically Generated Multilingual Keyword Clusters, in Proceedings of the 3rd IRAL, pp. 86–94, 1998.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kando, N. (2001). NTCIR Workshop : Japanese- and Chinese-English Cross-Lingual Information Retrieval and Multi-grade Relevance Judgments. In: Peters, C. (eds) Cross-Language Information Retrieval and Evaluation. CLEF 2000. Lecture Notes in Computer Science, vol 2069. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44645-1_3
Download citation
DOI: https://doi.org/10.1007/3-540-44645-1_3
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-42446-8
Online ISBN: 978-3-540-44645-3
eBook Packages: Springer Book Archive