Skip to main content

Linguistic Habit Graphs Used for Text Representation and Correction

  • Conference paper
  • First Online:
Artificial Intelligence and Soft Computing (ICAISC 2017)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10246))

Included in the following conference series:

  • 1946 Accesses

Abstract

This paper introduces a novel associative way of storing, compressing, and processing sentences. The Linguistic Habit Graphs (LHG) are introduced as graph models that could be used for spell checking, text correction, proof–reading, and compression of sentences. All the above mentioned functionalities are always available in the constant computational complexity as a result of the associative way of text processing, special kinds of connections and graph nodes that enable to activate various important relations between letters and words simultaneously for any given contexts. Furthermore, using the proposed graph structure, new algorithms have been developed to provide effective text analyzes and contextual text correction. These new algorithms can properly locate and often automatically correct typical mistakes in texts written in a given language for which the graph was build.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. 1000x Faster Spelling Correction algorithm, June 2012. http://blog.faroo.com/2012/06/07/improved-edit-distance-based-spelling-correction/. Online; Visited 03 Oct 2016

  2. Brown, P.F., et al.: Class-based n-gram models of natural language. Comput. Linguist. 18(4), 467–479 (1992)

    Google Scholar 

  3. Blunsom, P.: Hidden Markov Models. Lecture notes, vol. 15, pp. 18–19, August 2004

    Google Scholar 

  4. Chen, S.F., Goodman, J.: An empirical study of smoothing techniques for language modeling. In: Proceedings of the 34th Annual Meeting on Association for Computational Linguistics. Association for Computational Linguistics (1996)

    Google Scholar 

  5. Ide, N., Pustejovsky, J. (eds.): Handbook of Linguistic Annotation. Springer, Netherlands (2017). doi:10.1007/978-94-024-0881-2

    Google Scholar 

  6. Deepak, P., Deshpande, P.M.: Operators for Similarity Search. Semantics, Techniques and Usage Scenarios. Springer International Publishing, Cham (2015)

    Google Scholar 

  7. Gadamer, M., Horzyk, A.: Text analysis and correction using specialized linguistic habit graphs LHG. Image Process. Commun. 17(4), 245–250 (2012). Bydgoszcz

    Google Scholar 

  8. Horzyk, A.: Artificial Associative Systems and Associative Artificial Intelligence, pp. 1–280. Academic Publishing House EXIT, Warsaw (2013)

    Google Scholar 

  9. Horzyk, A.: How does generalization and creativity come into being in neural associative systems and how does it form human-like knowledge? Neurocomputing 144, 238–257 (2014). Elsevier

    Google Scholar 

  10. Horzyk, A.: Innovative types and abilities of neural networks based on associative mechanisms and a new associative model of neurons. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2015. LNCS, vol. 9119, pp. 26–38. Springer, Cham (2015). doi:10.1007/978-3-319-19324-3_3

    Chapter  Google Scholar 

  11. Horzyk, A., Gadamer, M.: Associative text representation and correction. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2013. LNCS (LNAI), vol. 7894, pp. 76–87. Springer, Heidelberg (2013). doi:10.1007/978-3-642-38658-9_7

    Chapter  Google Scholar 

  12. How to write a spelling corrector. http://norvig.com/spell-correct.html. Online; Visited: 05 Oct 2016

  13. Jurafsky, D.: Speech & language processing. Pearson Education India, Noida (2000)

    Google Scholar 

  14. Kohonen, T., Somervuo, P.: Self-organizing maps of symbol strings. Neurocomputing 21(1), 19–30 (1998)

    Article  MATH  Google Scholar 

  15. Manning, C.D., Schütze, H.: Foundations of Statistical Natural Language Processing, vol. 999. MIT Press, Cambridge (1999)

    MATH  Google Scholar 

  16. Manning, C.D., Surdeanu, M., Bauer, J., Finkel, J.R., Bethard, S., McClosky, D.: The stanford CoreNLP natural language processing toolkit. In: ACL (System Demonstrations), pp. 55–60 (2014)

    Google Scholar 

  17. Martin, D., Jurafsky, J.H., Jurafsky, D.: Speech and Language Processing. An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition. Prentice Hall, Upper Saddle River (2000)

    Google Scholar 

  18. Savary, A., Piskorski, J.: Lexicons and Grammars For Named Entity Annotation in the National Corpus of Polish, pp. 141–154. Intelligent Information Systems, Siedlce (2010)

    Google Scholar 

  19. Stolcke, A.: SRILM-an extensible language modeling toolkit. In: Proceedings International Conference on Spoken Language Processing, pp. 257–286 (2002)

    Google Scholar 

  20. Täckström, O., Das, D., Petrov, S., McDonald, R., Nivre, J.: Token and type constraints for cross-lingual part-of-speech tagging. Trans. Assoc. Comput. Linguist. 1, 1–12 (2013)

    Google Scholar 

  21. The soundex indexing system. https://goo.gl/5BUcR5 (May 2007). Online; Visited 04 Oct 2016

  22. What are some algorithms of spelling correction that were used by search engine? https://goo.gl/8xhvpQ. Online; Visited 03 Oct 2016

  23. Whitelaw, C., Hutchinson, B., Chung, G.Y., Ellis, G.: Using the web for language independent spellchecking and autocorrection. In: Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, vol. 2, pp. 890–899. Association for Computational Linguistics (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marcin Gadamer .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Gadamer, M. (2017). Linguistic Habit Graphs Used for Text Representation and Correction. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L., Zurada, J. (eds) Artificial Intelligence and Soft Computing. ICAISC 2017. Lecture Notes in Computer Science(), vol 10246. Springer, Cham. https://doi.org/10.1007/978-3-319-59060-8_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-59060-8_22

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-59059-2

  • Online ISBN: 978-3-319-59060-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics