Abstract
The huge amount of textual user-generated content on the Web has incredibly grown in the last decade, creating new relevant opportunities for different real-world applications and domains. In particular, microblogging platforms enables the collection of continuously and instantly updated information. The organization and extraction of valuable knowledge from these contents are fundamental for ensuring profitability and efficiency to companies and institutions. This paper presents an unsupervised model for the task of Named Entity Linking in microblogging environments. The aim is to link the named entity mentions in a text with their corresponding knowledge-base entries exploiting a novel heterogeneous representation space characterized by more meaningful similarity measures between words and named entities, obtained by Word Embeddings. The proposed model has been evaluated on different benchmark datasets proposed for Named Entity Linking challenges for English and Italian language. It obtains very promising performance given the highly challenging environment of user-generated content over microblogging platforms.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
In the experimental investigation, the considered NER model is the one proposed by Ritter et al. [33], which has been specifically designed for dealing with user-generated content.
References
Basile, P., Caputo, A., Gentile, A.L., Rizzo, G.: Overview of the EVALITA 2016 Named Entity rEcognition and Linking in Italian Tweets (NEEL-IT) Task. In: Proceedings of 3rd Italian Conference on Computational Linguistics & 5th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian, vol. 1749 (2016)
Basile, P., Caputo, A., Semeraro, G., Narducci, F.: UNIBA: exploiting a distributional semantic model for disambiguating and linking entities in tweets. In: Proceedings of the 5th Workshop on Making Sense of Microposts Co-located with the 24th International World Wide Web Conference, vol. 1395, p. 62 (2015)
Basile, P., et al. (eds.): Proceedings of 3rd Italian Conference on Computational Linguistics & 5th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian, vol. 1749 (2016)
Bunescu, R.C., Pasca, M.: Using encyclopedic knowledge for named entity disambiguation. In: Proceedings of the 11th Conference of the European Chapter of the Association for Computational Linguistics (2006)
Caliano, D., Fersini, E., Manchanda, P., Palmonari, M., Messina, E.: UniMiB: entity linking in tweets using Jaro-Winkler distance, popularity and coherence. In: Proceedings of the 6th Workshop on Making Sense of Microposts Co-located with the 25th International World Wide Web Conference, vol. 1691, pp. 70–72 (2016)
Cecchini, F.M., et al.: UNIMIB@NEEL-IT: named entity recognition and linking of italian tweets. In: Proceedings of 3rd Italian Conference on Computational Linguistics & 5th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian, vol. 1749 (2016)
Cozza, V., Bruna, W.L., Noia, T.D.: sisinflab: an ensemble of supervised and unsupervised strategies for the NEEL-IT challenge at Evalita 2016. In: Proceedings of 3rd Italian Conference on Computational Linguistics & 5th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian, vol. 1749 (2016)
Cucerzan, S.: Large-scale named entity disambiguation based on wikipedia data. In: Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pp. 708–716 (2007)
Derczynski, L., Maynard, D., Aswani, N., Bontcheva, K.: Microblog-genre noise and impact on semantic annotation accuracy. In: Proceedimgs of the 24th ACM Conference on Hypertext and Social Media, pp. 21–30 (2013)
Dredze, M., McNamee, P., Rao, D., Gerber, A., Finin, T.: Entity disambiguation for knowledge base population. In: Proceedings of the 23rd International Conference on Computational Linguistics, pp. 277–285 (2010)
Ferragina, P., Scaiella, U.: TAGME: on-the-fly annotation of short text fragments (by Wikipedia entities). In: Proceedings of the 19th ACM Conference on Information and Knowledge Management, pp. 1625–1628 (2010)
Fersini, E., Manchanda, P., Messina, E., Nozza, D., Palmonari, M.: Adapting named entity types to new ontologies in a microblogging environment. In: Mouhoub, M., Sadaoui, S., Ait Mohamed, O., Ali, M. (eds.) IEA/AIE 2018. LNCS (LNAI), vol. 10868, pp. 783–795. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-92058-0_76
Fersini, E., Messina, E., Felici, G., Roth, D.: Soft-constrained inference for Named Entity Recognition. Inf. Process. Manag. 50(5), 807–819 (2014)
Gottipati, S., Jiang, J.: Linking entities to a knowledge base with query expansion. In: Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, pp. 804–813 (2011)
Greenfield, K., et al.: A reverse approach to named entity extraction and linking in microposts. In: Proceedings of the 6th Workshop on Making Sense of Microposts Co-located with the 25th International World Wide Web Conference, vol. 1691, pp. 67–69 (2016)
Guo, S., Chang, M., Kiciman, E.: To link or not to link? A study on end-to-end tweet entity linking. In: Proceedings of the 2013 Conference of the North American Chapter of the Association of Computational Linguistics: Human Language Technologies, pp. 1020–1030 (2013)
Hachey, B., Radford, W., Nothman, J., Honnibal, M., Curran, J.R.: Evaluating Entity Linking with Wikipedia. Artif. Intell. 194, 130–150 (2013)
Han, X., Zhao, J.: NLPR_KBP in TAC 2009 KBP track: a two-stage method to entity linking. In: Proceedings of the 2nd Text Analysis Conference (2009)
Hoffart, J., et al.: Robust disambiguation of named entities in text. In: Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, pp. 782–792 (2011)
Lehmann, J., et al.: DBpedia - a large-scale, multilingual knowledge base extracted from Wikipedia. Semant. Web 6(2), 167–195 (2015)
Lehmann, J., Monahan, S., Nezda, L., Jung, A., Shi, Y.: LCC approaches to knowledge base population at TAC 2010. In: Proceedings of the 3rd Text Analysis Conference (2010)
Manchanda, P., Fersini, E., Palmonari, M., Nozza, D., Messina, E.: Towards adaptation of named entity classification. In: Proceedings of the Symposium on Applied Computing, pp. 155–157 (2017)
Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. In: Proceedings of the 1st International Conference on Learning Representations (2013)
Minard, A., Qwaider, M.R.H., Magnini, B.: FBK-NLP at NEEL-IT: active learning for domain adaptation. In: Proceedings of 3rd Italian Conference on Computational Linguistics & 5th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian, vol. 1749 (2016)
Monahan, S., Lehmann, J., Nyberg, T., Plymale, J., Jung, A.: Cross-lingual cross-document coreference with entity linking. In: Proceedings of the Fourth Text Analysis Conference (2011)
Nozza, D., Ristagno, F., Palmonari, M., Fersini, E., Manchanda, P., Messina, E.: TWINE: a real-time system for TWeet analysis via INformation Extraction. In: Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics, pp. 25–28 (2017)
Piccinno, F., Ferragina, P.: From TagME to WAT: a new Entity Annotator. In: Proceedings of the 1st ACM International Workshop on Entity Recognition & Disambiguation, pp. 55–62 (2014)
Pilz, A., Paaß, G.: From names to entities using thematic context distance. In: Proceedings of the 20th ACM Conference on Information and Knowledge Management, pp. 857–866 (2011)
Pound, J., Mika, P., Zaragoza, H.: Ad-hoc object retrieval in the web of data. In: Proceedings of the 19th International Conference on World Wide Web, pp. 771–780 (2010)
Rao, D., McNamee, P., Dredze, M.: Entity linking: finding extracted entities in a knowledge base. In: Poibeau, T., Saggion, H., Piskorski, J., Yangarber, R. (eds.) Multi-source, Multilingual Information Extraction and Summarization. Theory and Applications of Natural Language Processing, pp. 93–115. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-28569-1_5
Ratinov, L., Roth, D.: Design challenges and misconceptions in named entity recognition. In: Proceedings of the 13th Conference on Computational Natural Language Learning, pp. 147–155 (2009)
Ratinov, L., Roth, D., Downey, D., Anderson, M.: Local and global algorithms for disambiguation to wikipedia. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pp. 1375–1384 (2011)
Ritter, A., Clark, S., Mausam, Etzioni, O.: Named entity recognition in tweets: an experimental study. In: Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, pp. 1524–1534 (2011)
Rizzo, G., Basave, A.E.C., Pereira, B., Varga, A.: Making sense of microposts (#Microposts2015) Named Entity rEcognition and Linking (NEEL) challenge. In: Proceedings of the the 5th Workshop on Making Sense of Microposts Co-located with the 24th International World Wide Web Conference, vol. 1395, pp. 44–53 (2015)
Rizzo, G., van Erp, M., Plu, J., Troncy, R.: Making sense of microposts (#Microposts2016) Named Entity rEcognition and Linking (NEEL) challenge. In: Proceedings of the 6th Workshop on ‘Making Sense of Microposts’ Co-located with the 25th International World Wide Web Conference, vol. 1691, pp. 50–59 (2016)
Shen, W., Wang, J., Han, J.: Entity linking with a knowledge base: issues, techniques, and solutions. IEEE Trans. Knowl. Data Eng. 27(2), 443–460 (2015)
Shen, W., Wang, J., Luo, P., Wang, M.: LINDEN: linking named entities with knowledge base via semantic knowledge. In: Proceedings of the 21st World Wide Web Conference 2012, pp. 449–458 (2012)
Shen, W., Wang, J., Luo, P., Wang, M.: Linking named entities in tweets with knowledge base via user interest modeling. In: Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 68–76 (2013)
Torres-Tramón, P., Hromic, H., Walsh, B., Heravi, B.R., Hayes, C.: Kanopy4Tweets: entity extraction and linking for Twitter. In: Proceedings of the 6th Workshop on ‘Making Sense of Microposts’ Co-located with the 25th International World Wide Web Conference, vol. 1691, pp. 64–66 (2016)
Waitelonis, J., Sack, H.: Named Entity Linking in #Tweets with KEA. In: Proceedings of the 6th Workshop on ‘Making Sense of Microposts’ Co-located with the 25th International World Wide Web Conference, vol. 1691, pp. 61–63 (2016)
Yamada, I., Asai, A., Shindo, H., Takeda, H., Takefuji, Y.: Wikipedia2Vec: an optimized tool for learning embeddings of words and entities from Wikipedia. CoRR abs/1812.06280 (2018)
Yamada, I., Takeda, H., Takefuji, Y.: An end-to-end entity linking approach for tweets. In: Proceedings of the 5th Workshop on Making Sense of Microposts Co-located with the 24th International World Wide Web Conference, vol. 1395, pp. 55–56 (2015)
Zhang, W., Su, J., Tan, C.L., Wang, W.: Entity linking leveraging automatically generated annotation. In: Proceedings of the 23rd International Conference on Computational Linguistics, pp. 1290–1298 (2010)
Zheng, Z., Li, F., Huang, M., Zhu, X.: Learning to link entities with knowledge base. In: Proceedings of the 2010 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 483–491 (2010)
Acknowledgements
This work has been partially supported by PON I&R 2014-20, with the grant for research project “SmartCal”, CUP B48I15000180008.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Nozza, D., Sas, C., Fersini, E., Messina, E. (2019). Word Embeddings for Unsupervised Named Entity Linking. In: Douligeris, C., Karagiannis, D., Apostolou, D. (eds) Knowledge Science, Engineering and Management. KSEM 2019. Lecture Notes in Computer Science(), vol 11776. Springer, Cham. https://doi.org/10.1007/978-3-030-29563-9_13
Download citation
DOI: https://doi.org/10.1007/978-3-030-29563-9_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-29562-2
Online ISBN: 978-3-030-29563-9
eBook Packages: Computer ScienceComputer Science (R0)