Skip to main content

Grammatical analysis of English by statistical pattern recognition

  • Speech And Text
  • Conference paper
  • First Online:
Pattern Recognition (PAR 1988)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 301))

Included in the following conference series:

  • 155 Accesses

Abstract

Artificial Intelligence and Computational Linguistics researchers are currently debating the value of ‘Deep’ knowledge-representations in language processing and related computations. Incorporating deep knowledge as well as surface statistical pattern recognition requires much greater processing, but it has been assumed that, for many applications of Artificial Intelligence, purely surface statistical analyses cannot yield useful results. One NLP application provides a counter-argument to this widespread tenet: a system for grammatical error detection, using only probabilistic, Markovian, pattern-matching was devised, and in tests compared favourably with a much larger system which computed deep grammatical analyses of each sentence. Those who argue that statistical pattern recognition has no place in Computational Linguistics or Artificial Intelligence have still to prove their case.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Cohn, A G 1985 "Deep Knowledge Representation Techniques" in M Merry (ed), Expert Systems 85: proceedings of the fifth technical conference of the British Computer Society Specialist Group on Expert Systems Cambridge University Press.

    Google Scholar 

  2. Hayes, P J 1979 "The Naive Physics Manifesto" in D Michie (ed), Expert Systems in the Micro Electronic Age Edinburgh University Press

    Google Scholar 

  3. Forbus, K 1984 "Qualitative Process Theory" in D Bobrow (ed), Qualitative Reasoning about Physical Systems North Holland

    Google Scholar 

  4. Alvey Directorate 1985 IKBS Report on the first Workshop on Deep Knowledge Institution of Electrical Engineers

    Google Scholar 

  5. Alvey Directorate 1986 KIBS Report on the second Workshop on Deep Knowledge Institution of Electrical Engineers

    Google Scholar 

  6. Atwell, E S 1987 "A parsing expert system which learns from corpus analysis" to appear in W Meijs (ed), Corpus Linguistics and Beyond: Proceedings of the ICAME 7th International Conference on English Language Research on Computerised Corpora Rodopi, Amsterdam.

    Google Scholar 

  7. Davis R and D Lenat 1982, Knowledge Based Systems in Artificial Intelligence McGraw Hill

    Google Scholar 

  8. Cunningham, J 1985 "Comprehension by model-building as a basis for an expert system" in M Merry (ed), Expert Systems 85: proceedings of the fifth technical conference of the British Computer Society Specialist Group on Expert Systems Cambridge University Press.

    Google Scholar 

  9. Atwell, E S 1987 "Transforming a Parsed Corpus into a Corpus Parser", to appear in Proceedings of the ICAME 8th International Conference on English Language Research on Computerised Corpora (forthcoming)

    Google Scholar 

  10. Atwell, E S 1987 "An Expert System for the Automatic Discovery of Particles" to appear in Proceedings of the International Conference on the Study of Particles (forthcoming).

    Google Scholar 

  11. Chomsky, N 1957 Syntactic Structures Mouton, The Hague

    Google Scholar 

  12. Winograd, T 1983 Language as a cognitive process; volume 1: syntax Addison-Wesley

    Google Scholar 

  13. Johnson, T 1985 Natural Language Computing: the commercial applications Ovum, London

    Google Scholar 

  14. Woods, W 1970 "Transition Network Grammars for Natural Language Analysis" in Communications of the Association for Computing Machinery 13(10): 591–606

    Google Scholar 

  15. Bresnan, J and R Kaplan 1982 "Lexical-Functional Grammar: a formal system for grammatical representation" in Joan Bresnan (ed), The Mental Representation of Grammatical Relations 173–281, MIT Press

    Google Scholar 

  16. Gazdar, G, E Klein, G Pullum, and I Sag 1985 Generalized Phrase Structure Grammar Blackwell, Oxford

    Google Scholar 

  17. Heidorn, G E, Jensen, K, Miller, L A, Byrd, R J, and Chodorow, M S, 1982 "The EPISTLE text-critiquing system" in IBM Systems Journal 21(3): 305–326

    Google Scholar 

  18. Jensen, K, Heidorn, G E, Miller, L A, and Ravin, Y 1983 "Parse fitting and prose fixing: getting a hold on ill-formedness" in American Journal of Computational Linguistics 9(3–4): 147–160

    Google Scholar 

  19. Carbonell, J and P Hayes 1983 "Recovery strategies for parsing extragrammatical language" in American Journal of Computational Linguistics 9(3–4): 123–146

    Google Scholar 

  20. Fass, D, and Y Wilks 1983 "Preference semantics, ill-formedness, and metaphor" in American Journal of Computational Linguistics 9(3–4): 178–187

    Google Scholar 

  21. Granger, R 1983) "The NOMAD system: expectation-based detection and correction of errors during understanding of syntactically and semantically ill-formed text" in American Journal of Computational Linguistics 9(3–4): 188–196

    Google Scholar 

  22. Hayes, P J, and G V Mouradian 1981 "Flexible Parsing" in American Journal of Computational Linguistics 7(4): 232–242

    Google Scholar 

  23. Kwasny, S, and N Sondheimer 1981 "Relaxation techniques for parsing grammatically ill-formed input in natural language understanding systems" in American Journal of Computational Linguistics 7(2): 99–108

    Google Scholar 

  24. Weischedel, R, and J Black 1980 "Responding intelligently to unparsable inputs" in American Journal of Computational Linguistics 6(2) 97–109

    Google Scholar 

  25. Weischedel, R, and N Sondheimer 1983 "Meta-rules as a basis for processing ill-formed input" in American Journal of Computational Linguistics 9(3–4):161–177

    Google Scholar 

  26. Atwell, E S 1983 "Constituent-Likelihood Grammar" in Newsletter of the International Computer Archive of Modern English (ICAME NEWS) 7: 34–67, Norwegian Computing Centre for the Humanities, Bergen University.

    Google Scholar 

  27. Atwell, E S (forthcoming), "Constituent-likelihood grammar" to appear in Roger Garside, Geoffrey Sampson and Geoffrey Leech (eds) The computational analysis of English Longman

    Google Scholar 

  28. Atwell, E S, G Leech and R Garside 1984, "Analysis of the LOB Corpus: progress and prospects", in J Aarts and W Meijs (ed), Corpus Linguistics Rodopi.

    Google Scholar 

  29. Leech, G, R Garside, and E S Atwell 1983a: "Recent developments in the use of computer corpora in English language research" in Transactions of the Philological Society 1983: 23–40.

    Google Scholar 

  30. Leech, G, R Garside, and E S Atwell 1983b "The Automatic Grammatical Tagging of the LOB Corpus" in Newsletter of the International Computer Archive of Modern English (ICAME NEWS) 7: 13–33, Norwegian Computing Centre for the Humanities, Bergen University

    Google Scholar 

  31. Johansson, S, E Atwell, R Garside and G Leech 1986, The Tagged LOB Corpus Norwegian Computing Centre for the Humanities, Bergen.

    Google Scholar 

  32. Atwell, E S 1986, "How to detect grammatical errors in a text without parsing it", Department of Computer Studies Research Report 212; to appear in Proceedings of the Association for Computational Linguistics Third European Chapter Conference, Copenhagen, Denmark (forthcoming).

    Google Scholar 

  33. Atwell, Eric Steven (forthcoming) "Measuring grammaticality of machine-readable text" to appear in Proceedings of the 1987 XIV International Congress of Linguists, Berlin, East Germany

    Google Scholar 

  34. Wolff, J G 1976 "Frequency, Conceptual Structure and Pattern Recognition" in British Journal of Psychology 67:377–390

    Google Scholar 

  35. Wolff, J G 1978 "The Discovery of Syntagmatic and Paradigmatic Classes" in ALLC Bulletin 6(1):141

    Google Scholar 

  36. Atwell, Eric Steven 1986 Extracting a Natural Language grammar from raw text Department of Computer Studies Research Report no.208, University of Leeds

    Google Scholar 

  37. Atwell, Eric Steven 1986 "A parsing expert system which learns from corpus analysis" in Willem Meijs (ed) Corpus Linguistics and Beyond: Proceedings of the 1986 Seventh International Conference on English Language Research on Computerised Corpora, Amsterdam, Netherlands Rodopi, Amsterdam

    Google Scholar 

  38. Atwell, Eric Steven, and Nikos Drakos (forthcoming), "Pattern Recognition Applied to the Acquisition of a Grammatical Classification System from Unrestricted English Text" to appear in Proceedings of the 1987 Association for Computational Linguistics Third European Chapter Conference, Copenhagen, Denmark

    Google Scholar 

  39. Atwell, Eric Steven (forthcoming) "An Expert System for the Automatic Discovery of Particles" to appear in Proceedings of the 1987 International Conference on the Study of Language Particles, West Berlin, West Germany

    Google Scholar 

  40. Thomas, A N 1961, "Now Kruschev Hots Up" in News of the World July 9 (LOB Corpus text sample A21)

    Google Scholar 

  41. 'The Walrus’ 1961, "Of Shoes and Ships and Sealing Wax" in Yachting World December (LOB Corpus text sample E18)

    Google Scholar 

  42. (Anonymous) 1961, "Editorial Points" in Hair and Beauty 41: 6 (June) (LOB Corpus text sample E34)

    Google Scholar 

  43. Hamblin, H 1961, "Give Back My Dreams" in Smart Novels February 6 (LOB Corpus text sample P17)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

J. Kittler

Rights and permissions

Reprints and permissions

Copyright information

© 1988 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Atwell, E.S. (1988). Grammatical analysis of English by statistical pattern recognition. In: Kittler, J. (eds) Pattern Recognition. PAR 1988. Lecture Notes in Computer Science, vol 301. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-19036-8_63

Download citation

  • DOI: https://doi.org/10.1007/3-540-19036-8_63

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-19036-3

  • Online ISBN: 978-3-540-38947-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics