Skip to main content
SpringerLink
Log in

Ontology Population from Raw Text Corpus for Open-Source Intelligence

  • Conference paper
  • First Online:
Current Trends in Web Engineering (ICWE 2017)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10544))

Included in the following conference series:

Abstract

Open-Source INTelligence (OSINT) is intelligence based on publicly available sources, such as news sites, blogs, forums, etc. The Web is the primary source of information, but once data are crawled from it, they need to be interpreted and structured. Ontologies may play a crucial role in this process, but due to the vast amount of documents available, automatic mechanisms for their population starting from the crawled text are needed. In this paper, we present an approach for the automatic population of pre-defined ontologies based on the General Architecture for Text Engineering (GATE) system. We present some experimental results, which are encouraging in terms of extracted correct instances of the ontology. Finally, we describe an alternative approach and additional experiments for one of the phases of our pipeline, which requires the use of pre-defined dictionaries for relevant entities. Thanks to such variant, we were able to reduce the manual effort required in this phase, still obtaining promising results.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://researcher.watson.ibm.com/researcher/view_group_subpage.php?id=5577.

  2. 2.

    http://alias-i.com/lingpipe/.

  3. 3.

    https://opennlp.apache.org/.

  4. 4.

    https://gate.ac.uk/.

  5. 5.

    https://www.wikidata.org/.

  6. 6.

    https://www.w3.org/TR/owl2-primer/.

  7. 7.

    https://gate.ac.uk/gate/doc/plugins.html.

  8. 8.

    http://www.cis.uni-muenchen.de/~schmid/tools/TreeTagger.

  9. 9.

    http://www.semanticsoftware.info/munpex.

  10. 10.

    http://www.semanticsoftware.info/owlexporter.

  11. 11.

    http://www.newprosoft.com/web-content-extractor.htm.

  12. 12.

    http://politici.openpolis.it/.

  13. 13.

    https://www.blazegraph.com/.

  14. 14.

    https://www.wikidata.org/wiki/Q47729.

References

  1. Antonioli, N., Castanò, F., Coletta, S., Grossi, S., Lembo, D., Lenzerini, M., Poggi, A., Virardi, E., Castracane, P.: Ontology-based data management for the Italian public debt. Proceedings of FOIS 2014, 372–385 (2014)

    Google Scholar 

  2. Baader, F., Calvanese, D., McGuinness, D., Nardi, D., Patel-Schneider, P.F. (eds.): The Description Logic Handbook: Theory, Implementation and Applications, 2nd edn. Cambridge University Press, New York (2007)

    MATH  Google Scholar 

  3. Baldoni, R., Nicola, R.D.: The White Book on Cyber-security (2015)

    Google Scholar 

  4. Bird, S., Klein, E., Loper, E.: Natural Language Processing with Python: Analyzing Text with the Natural Language Toolkit. O’Reilly, Beijing (2009)

    MATH  Google Scholar 

  5. Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., Kuksa, P.: Natural language processing (almost) from scratch. J. Mach. Learn. Res. 12, 2493–2537 (2011)

    MATH  Google Scholar 

  6. Cunningham, H.: Developing Language Processing Components with GATE Version 8. University of Sheffield Department of Computer Science (2014)

    Google Scholar 

  7. Cunningham, H., Maynard, D., Bontcheva, K., Tablan, V.: GATE: A framework and graphical development environment for robust NLP tools and applications. In: Proceedings of ACL 2002 (2002)

    Google Scholar 

  8. Guarino, N.: Formal ontology in information systems. In: Proceedings of FOIS 1998, Frontiers in Artificial Intelligence, pp. 3–15. IOS Press (1998)

    Google Scholar 

  9. Johnson, M., Khudanpur, S., Ostendorf, M., Rosenfeld, R.: Mathematical Foundations of Speech and Language Processing. Springer, New York (2004)

    Book  MATH  Google Scholar 

  10. Kibble, R.: Introduction to Natural Language Processing. University of London (2013)

    Google Scholar 

  11. Maynard, D., Li, Y., Peters, W.: NLP techniques for term extraction and ontology population. In: Ontology Learning and Population: Bridging the Gap between Text and Knowledge, pp. 107–127. IOS Press (2008)

    Google Scholar 

  12. Navigli, R.: Word sense disambiguation: a survey. ACM Comput. Surv. 41(2), 1–69 (2009)

    Article  Google Scholar 

  13. Scannapieco, M., Barcaroli, G., Summa, D., Scarnò, M.: Using internet as a data source for official statistics: a comparative analysis of web scraping technologies. In: Proceedings of NTTS 2015 (2015)

    Google Scholar 

  14. Schmid, H.: Probabilistic part-of-speech tagging using decision trees. In: Proceedings of the International Conference on New Methods in Language Processing, pp. 44–49 (1994)

    Google Scholar 

  15. Witte, R., Khamis, N., Rilling, J.: Flexible ontology population from text: the OwlExporter. In: Proceedings of LREC 2010. May 2010

    Google Scholar 

  16. Zhao, H., Zhang, X., Kit, C.: Integrative semantic dependency parsing via efficient large-scale feature selection. J Artif. Intell. Res. 46, 203–233 (2013)

    MathSciNet  Google Scholar 

Download references

Acknowledgments

This work has been partly supported by Leonardo Company (formerly Selex ES) in the context of the XASMOS initiative, and by the Italian project RoMA (SCN_00064). The work of Giulio Ganino has been supported by the FILAS grant Laboratori teorico-sperimentali a supporto delle applicazioni spaziali delle industrie laziali (FILAS-RU-2014-1058).

Author information

Authors and Affiliations

  1. Sapienza Università di Roma, DIAG, Rome, Italy

    Giulio Ganino, Domenico Lembo & Federico Scafoglieri

Authors
  1. Giulio Ganino
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Domenico Lembo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Federico Scafoglieri
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Domenico Lembo .

Editor information

Editors and Affiliations

  1. Universidad de Alicante, Alicante, Spain

    Irene Garrigós

  2. Institute of Software Technology and Interactive Systems, TU Wien, Vienna, Austria

    Manuel Wimmer

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ganino, G., Lembo, D., Scafoglieri, F. (2018). Ontology Population from Raw Text Corpus for Open-Source Intelligence. In: Garrigós, I., Wimmer, M. (eds) Current Trends in Web Engineering. ICWE 2017. Lecture Notes in Computer Science(), vol 10544. Springer, Cham. https://doi.org/10.1007/978-3-319-74433-9_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-74433-9_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-74432-2

  • Online ISBN: 978-3-319-74433-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation