Skip to main content
SpringerLink
Log in

Asynchronous System for Clustering and Classifications of Texts in Polish

  • Conference paper
  • First Online:
Dependability Engineering and Complex Systems (DepCoS-RELCOMEX 2016)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 470))

Included in the following conference series:

Abstract

The paper presents an online system for clustering and classification of texts in the Polish language. It allows running complex workflows of language and machine learning tools. A high throughput and low latency was achieved by an asynchronous style of programming and a usage of message oriented middleware—RabbitMQ. Authors discuss the architecture assumptions, the language processing modelling notation for a workflow definition and the system architecture. Moreover, a sample Single Page Application is presented that clusters uploaded corpora and shows results online.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.nltk.org/.

  2. 2.

    https://www.rabbitmq.com.

  3. 3.

    https://www.r-project.org.

  4. 4.

    http://glaros.dtc.umn.edu/gkhome/cluto/cluto/overview.

  5. 5.

    http://scikit-learn.org/.

  6. 6.

    http://www.cherrypy.org/.

  7. 7.

    https://www.amqp.org/.

  8. 8.

    http://www.bpmn.org/.

  9. 9.

    https://www.rabbitmq.com/tutorials/tutorial-six-java.html.

  10. 10.

    https://clarin-pl.eu/dspace.

References

  1. Allamaraju, S.: RESTful Web Services Cookbook: Solutions for Improving Scalability and Simplicity. O’Reilly Media and Yahoo (2010)

    Google Scholar 

  2. Banavar, G., Chandra, T., Strom, R., Sturman, D.: A case for message oriented middle-ware. In: Proceedings of the 13th International Symposium on Distributed Computing, pp. 1–18 (1999)

    Google Scholar 

  3. Broda, B., Piasecki, M.: Parallel, massive processing in SuperMatrix—a general tool for distributional semantic analysis of corpora. Int. J. Data Min. Model. Manag. 5(1), 1–19 (2013)

    Google Scholar 

  4. Broda, B., Kędzia, P., Marcińczuk, M., Radziszewski, A., Ramocki, R., Wardyński, A.: Fextor: a feature extraction framework for natural language processing: a case study in word sense disambiguation, relation recognition and anaphora resolution. Stud. Comput. Intel. 458, 41–62 (2013)

    Google Scholar 

  5. Hinrichs, M., Zastrow, T., Hinrichs, E.: WebLicht: Web-based LRT services in a distributed science infrastructure. In: Proceedings of the International Conference on Language Resources and Evaluation, pp. 489–493. European Language Resources Association (2010)

    Google Scholar 

  6. Marcinczuk, M., Kocon, J., Janicki, M.: Liner2—a customizable framework for proper names recognition for Polish. Stud. Comput. Intel. 467, 231–253 (2013)

    Google Scholar 

  7. Ogrodniczuk, M., Lenart, M.: A Multi-purpose Online Toolset for NLP Applications. LNCS, vol. 7934, pp. 392–395. Springer, Berlin (2013)

    Google Scholar 

  8. Palczynski, M., Walkowiak, T.: Synchronous vs asynchronous processing in high throughput web applications. In: 15th International Conference Reliability and Statistics in Transportation and Communication, pp. 195–202. Transport and Telecommunication Institute, Riga (2015)

    Google Scholar 

  9. Piasecki, M., Walkowiak, T., Eder, M.: WebSty—an Open Web-based System for Exploring Stylometric Structures in Document Collections. In: Digital Humanities, accepted abstract, Krakow (2016)

    Google Scholar 

  10. Radziszewski, A.: A tiered CRF tagger for Polish, intelligent tools for building a scientific information platform. Stud. Comput. Intel. 467, 215–230 (2013)

    Google Scholar 

  11. Walkowiak, T.: Web based engine for processing and clustering of Polish texts. In: Proceedings of the Tenth International Conference on Dependability and Complex Systems DepCoS-RELCOMEX, pp. 515–522. Springer (2015)

    Google Scholar 

  12. Walkowiak, T., Piasecki M.: Web-based natural language processing workflows for the research infrastructure in humanities. In: 5th Conference of the Japanese Association for Digital Humanities, JADH 2015, pp. 61–63 (2015)

    Google Scholar 

  13. Wittenburg, P., et al.: Resource and service centres as the backbone for a sustainable service infrastructure. In: Proceedings of the International Conference on Language Resources and Evaluation, pp. 60–63. European Language Resources Association (2010)

    Google Scholar 

  14. Wróblewska, A.: Polish Dependency Bank. Linguist. Issues Lang. Technol. 7(1) (2012)

    Google Scholar 

  15. Zhao, Y., Karypis, G.: Hierarchical clustering algorithms for document Datasets. Data Min. Knowl. Disc. 10(2), 141–168 (2005)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Electronics, Wroclaw University of Science and Technology, Wybrzeze Wyspianskiego 27, 50-320, Wroclaw, Poland

    Tomasz Walkowiak

Authors
  1. Tomasz Walkowiak
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tomasz Walkowiak .

Editor information

Editors and Affiliations

  1. Department of Computer Engineering, Wrocław University of Technology, Wrocław, Poland

    Wojciech Zamojski

  2. Department of Computer Engineering, Wrocław University of Technology, Wrocław, Poland

    Jacek Mazurkiewicz

  3. Department of Computer Engineering, Wrocław University of Technology, Wroclaw, Poland

    Jarosław Sugier

  4. Department of Computer Engineering, Wrocław University of Technology, Wrocław, Poland

    Tomasz Walkowiak

  5. Polish Academy of Sciences, Systems Research Institute, Warszawa, Poland

    Janusz Kacprzyk

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Walkowiak, T. (2016). Asynchronous System for Clustering and Classifications of Texts in Polish. In: Zamojski, W., Mazurkiewicz, J., Sugier, J., Walkowiak, T., Kacprzyk, J. (eds) Dependability Engineering and Complex Systems. DepCoS-RELCOMEX 2016. Advances in Intelligent Systems and Computing, vol 470. Springer, Cham. https://doi.org/10.1007/978-3-319-39639-2_46

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-39639-2_46

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-39638-5

  • Online ISBN: 978-3-319-39639-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation