Abstract
Hummingbird submitted ranked result sets for all 5 Monolingual Information Retrieval tasks (German, French, Italian, Spanish and Dutch) of the Cross-Language Evaluation Forum (CLEF) 2001. Search-Server’s Intuitive Searching™ produced the highest average precision score in the German task of the 12 groups submitting automatic, Title +Description runs. Enabling stemming in SearchServer increased average precision by 43% in German, 30% in Dutch, 18% in French, 16% in Italian, 12% in Spanish and 12% in English. All points in the 95% confidence interval for the impact of stemming on average precision in German (based on the two-sided Wilcoxon signed rank test) were greater than all points in the corresponding intervals for French, English and Italian, evidence that stemming is more beneficial in German than in French, English or Italian.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cross-Language Evaluation Forum web site. http://www.clef-campaign.org/
Andrew Hodgson. Converting the Fulcrum Search Engine to Unicode. In Sixteenth International Unicode Conference, Amsterdam, The Netherlands, March 2000.
Myles Hollander and Douglas A. Wolfe. Nonparametric Statistical Methods. Second Edition, 1999. John Wiley & Sons.
S.E. Robertson, S. Walker, S. Jones, M. M. Hancock-Beaulieu, M. Gatford. (City University.) Okapi at TREC-3. In D.K. Harman, editor, Overview of the Third Text REtrieval Conference (TREC-3), 1995. NIST Special Publication 500-226. http://trec.nist.gov/pubs/trec3/t3_proceedings.html
Amit Singhal, John Choi, Donald Hindle, David Lewis and Fernando Pereira. AT&T at TREC-7. In E. M. Voorhees and D.K. Harman, editors, Proceedings of the Seventh Text REtrieval Conference (TREC-7), 1999. NIST Special Publication 500-242. http://trec.nist.gov/pubs/trec7/t7_proceedings.html
Stephen Tomlinson. Hummingbird’s Fulcrum SearchServer at CLEF 2001. In Carol Peters, editor, Results of the CLEF 2001 Cross-Language System Evaluation Campaign: Working Notes for the CLEF 2001 Workshop. 3 September, Darmstadt, Germany. DELOS Network of Excellence on Digital Libraries Workshop Series. http://www.ercim.org/publication/ws-proceedings/CLEF2/index.html
Stephen Tomlinson and Tom Blackwell. Hummingbird’s Fulcrum SearchServer at TREC-9. To appear in E. M. Voorhees and D. K. Harman, editors, Proceedings of the Ninth Text REtrieval Conference (TREC-9). NIST Special Publication 500-249. http://trec.nist.gov/pubs/trec9/t9_proceedings.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tomlinson, S. (2002). Stemming Evaluated in 6 Languages by Hummingbird SearchServer™ at CLEF 2001. In: Peters, C., Braschler, M., Gonzalo, J., Kluck, M. (eds) Evaluation of Cross-Language Information Retrieval Systems. CLEF 2001. Lecture Notes in Computer Science, vol 2406. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45691-0_25
Download citation
DOI: https://doi.org/10.1007/3-540-45691-0_25
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44042-0
Online ISBN: 978-3-540-45691-9
eBook Packages: Springer Book Archive