Abstract
Esfinge is a general domain Portuguese question answering system, which uses the information available in the Web as an additional resource when searching for answers. The experiments described in this paper show that the Web helped more with this year’s questions than in previous years and that using the Web to support answers also enables the system to answer correctly or at least to find relevant documents for more questions. In this third participation in CLEF, the main goals were (i) to check whether a database of word co-occurrences could improve the answer scoring algorithm and (ii) to get higher benefits from the use of a named entity recognizer that was used last year in sub-optimal conditions. 2006 results were slightly better than last year’s, even though the question set included more definitions of type Que é X? (What is X?), with which the system had the worst results in previous participations.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Brill, E.: Processing Natural Language without Natural Language Processing. In: Gelbukh, A. (ed.) CICLing 2003. LNCS, vol. 2588, pp. 360–369. Springer, Heidelberg (2003)
Gomes, D., Silva, M.J.: Characterizing a National Community Web. ACM Transactions on Internet Technology (TOIT) 5(3), 508–531 (2005)
Costa, L.: First Evaluation of Esfinge - a Question Answering System for Portuguese. In: Peters, C., Clough, P.D., Gonzalo, J., Jones, G.J.F., Kluck, M., Magnini, B. (eds.) CLEF 2004. LNCS, vol. 3491, pp. 522–533. Springer, Heidelberg (2005)
Costa, L.: 20th Century Esfinge (Sphinx) solving the riddles at CLEF 2005. In: Peters, C., Gey, F.C., Gonzalo, J., Müller, H., Jones, G.J.F., Kluck, M., Magnini, B., de Rijke, M., Giampiccolo, D. (eds.) CLEF 2005. LNCS, vol. 4022, pp. 467–476. Springer, Heidelberg (2006)
Sarmento, L.: BACO - A large database of text and co-occurrences. In: Proceedings of LREC, May 22-28, Genoa, Italy (2006)
Sarmento, L.: SIEMÊS - a named entity recognizer for Portuguese relying on similarity rules. In: Vieira, R., Quaresma, P., Nunes, M.d.G.V., Mamede, N.J., Oliveira, C., Dias, M.C. (eds.) PROPOR 2006. LNCS (LNAI), vol. 3960, pp. 90–99. Springer, Heidelberg (2006)
Bick, E.: The Parsing System “Palavras”: Automatic Grammatical Analysis of Portuguese in a Constraint Grammar Framework. Aarhus University Press, Aarhus (2000)
Mota, C., Santos, D., Ranchhod, E.: Avaliação de reconhecimento de entidades mencionadas: princípio de AREM. In: Santos, D. (ed.) Avaliação conjunta: um novo paradigma no processamento computacional da língua portuguesa, pp. 161–175. IST Press (2007)
Costa, L., Sarmento, L.: Component Evaluation in a Question Answering System. In: Calzolari, N., Choukri, K., Gangemi, A., Maegaard, B., Mariani, J., Odjik, J., Tapias, D. (eds.) Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC’2006 ), Genoa, Italy, 22-28 May 2006, pp. 1520–1523 (2006)
Clarke, C.L.A., Cormack, G.V., Lynam, T.R.: Exploiting Redundancy in Question Answering. In: Research and Development in Information Retrieval, pp. 358–365 (2001)
Cardoso, N., Martins, B., Gomes, D., Silva, M.J.: WPT 03: a primeira colecção pública proveniente de uma recolha da web portuguesa. In: Santos, D. (ed.) Avaliação conjunta: um novo paradigma no processamento computacional da língua portuguesa, pp. 279–288. IST Press (2007)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Costa, L. (2007). Question Answering Beyond CLEF Document Collections. In: Peters, C., et al. Evaluation of Multilingual and Multi-modal Information Retrieval. CLEF 2006. Lecture Notes in Computer Science, vol 4730. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74999-8_48
Download citation
DOI: https://doi.org/10.1007/978-3-540-74999-8_48
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74998-1
Online ISBN: 978-3-540-74999-8
eBook Packages: Computer ScienceComputer Science (R0)