Abstract
Artificial Intelligence and Computational Linguistics researchers are currently debating the value of ‘Deep’ knowledge-representations in language processing and related computations. Incorporating deep knowledge as well as surface statistical pattern recognition requires much greater processing, but it has been assumed that, for many applications of Artificial Intelligence, purely surface statistical analyses cannot yield useful results. One NLP application provides a counter-argument to this widespread tenet: a system for grammatical error detection, using only probabilistic, Markovian, pattern-matching was devised, and in tests compared favourably with a much larger system which computed deep grammatical analyses of each sentence. Those who argue that statistical pattern recognition has no place in Computational Linguistics or Artificial Intelligence have still to prove their case.
Preview
Unable to display preview. Download preview PDF.
References
Cohn, A G 1985 "Deep Knowledge Representation Techniques" in M Merry (ed), Expert Systems 85: proceedings of the fifth technical conference of the British Computer Society Specialist Group on Expert Systems Cambridge University Press.
Hayes, P J 1979 "The Naive Physics Manifesto" in D Michie (ed), Expert Systems in the Micro Electronic Age Edinburgh University Press
Forbus, K 1984 "Qualitative Process Theory" in D Bobrow (ed), Qualitative Reasoning about Physical Systems North Holland
Alvey Directorate 1985 IKBS Report on the first Workshop on Deep Knowledge Institution of Electrical Engineers
Alvey Directorate 1986 KIBS Report on the second Workshop on Deep Knowledge Institution of Electrical Engineers
Atwell, E S 1987 "A parsing expert system which learns from corpus analysis" to appear in W Meijs (ed), Corpus Linguistics and Beyond: Proceedings of the ICAME 7th International Conference on English Language Research on Computerised Corpora Rodopi, Amsterdam.
Davis R and D Lenat 1982, Knowledge Based Systems in Artificial Intelligence McGraw Hill
Cunningham, J 1985 "Comprehension by model-building as a basis for an expert system" in M Merry (ed), Expert Systems 85: proceedings of the fifth technical conference of the British Computer Society Specialist Group on Expert Systems Cambridge University Press.
Atwell, E S 1987 "Transforming a Parsed Corpus into a Corpus Parser", to appear in Proceedings of the ICAME 8th International Conference on English Language Research on Computerised Corpora (forthcoming)
Atwell, E S 1987 "An Expert System for the Automatic Discovery of Particles" to appear in Proceedings of the International Conference on the Study of Particles (forthcoming).
Chomsky, N 1957 Syntactic Structures Mouton, The Hague
Winograd, T 1983 Language as a cognitive process; volume 1: syntax Addison-Wesley
Johnson, T 1985 Natural Language Computing: the commercial applications Ovum, London
Woods, W 1970 "Transition Network Grammars for Natural Language Analysis" in Communications of the Association for Computing Machinery 13(10): 591–606
Bresnan, J and R Kaplan 1982 "Lexical-Functional Grammar: a formal system for grammatical representation" in Joan Bresnan (ed), The Mental Representation of Grammatical Relations 173–281, MIT Press
Gazdar, G, E Klein, G Pullum, and I Sag 1985 Generalized Phrase Structure Grammar Blackwell, Oxford
Heidorn, G E, Jensen, K, Miller, L A, Byrd, R J, and Chodorow, M S, 1982 "The EPISTLE text-critiquing system" in IBM Systems Journal 21(3): 305–326
Jensen, K, Heidorn, G E, Miller, L A, and Ravin, Y 1983 "Parse fitting and prose fixing: getting a hold on ill-formedness" in American Journal of Computational Linguistics 9(3–4): 147–160
Carbonell, J and P Hayes 1983 "Recovery strategies for parsing extragrammatical language" in American Journal of Computational Linguistics 9(3–4): 123–146
Fass, D, and Y Wilks 1983 "Preference semantics, ill-formedness, and metaphor" in American Journal of Computational Linguistics 9(3–4): 178–187
Granger, R 1983) "The NOMAD system: expectation-based detection and correction of errors during understanding of syntactically and semantically ill-formed text" in American Journal of Computational Linguistics 9(3–4): 188–196
Hayes, P J, and G V Mouradian 1981 "Flexible Parsing" in American Journal of Computational Linguistics 7(4): 232–242
Kwasny, S, and N Sondheimer 1981 "Relaxation techniques for parsing grammatically ill-formed input in natural language understanding systems" in American Journal of Computational Linguistics 7(2): 99–108
Weischedel, R, and J Black 1980 "Responding intelligently to unparsable inputs" in American Journal of Computational Linguistics 6(2) 97–109
Weischedel, R, and N Sondheimer 1983 "Meta-rules as a basis for processing ill-formed input" in American Journal of Computational Linguistics 9(3–4):161–177
Atwell, E S 1983 "Constituent-Likelihood Grammar" in Newsletter of the International Computer Archive of Modern English (ICAME NEWS) 7: 34–67, Norwegian Computing Centre for the Humanities, Bergen University.
Atwell, E S (forthcoming), "Constituent-likelihood grammar" to appear in Roger Garside, Geoffrey Sampson and Geoffrey Leech (eds) The computational analysis of English Longman
Atwell, E S, G Leech and R Garside 1984, "Analysis of the LOB Corpus: progress and prospects", in J Aarts and W Meijs (ed), Corpus Linguistics Rodopi.
Leech, G, R Garside, and E S Atwell 1983a: "Recent developments in the use of computer corpora in English language research" in Transactions of the Philological Society 1983: 23–40.
Leech, G, R Garside, and E S Atwell 1983b "The Automatic Grammatical Tagging of the LOB Corpus" in Newsletter of the International Computer Archive of Modern English (ICAME NEWS) 7: 13–33, Norwegian Computing Centre for the Humanities, Bergen University
Johansson, S, E Atwell, R Garside and G Leech 1986, The Tagged LOB Corpus Norwegian Computing Centre for the Humanities, Bergen.
Atwell, E S 1986, "How to detect grammatical errors in a text without parsing it", Department of Computer Studies Research Report 212; to appear in Proceedings of the Association for Computational Linguistics Third European Chapter Conference, Copenhagen, Denmark (forthcoming).
Atwell, Eric Steven (forthcoming) "Measuring grammaticality of machine-readable text" to appear in Proceedings of the 1987 XIV International Congress of Linguists, Berlin, East Germany
Wolff, J G 1976 "Frequency, Conceptual Structure and Pattern Recognition" in British Journal of Psychology 67:377–390
Wolff, J G 1978 "The Discovery of Syntagmatic and Paradigmatic Classes" in ALLC Bulletin 6(1):141
Atwell, Eric Steven 1986 Extracting a Natural Language grammar from raw text Department of Computer Studies Research Report no.208, University of Leeds
Atwell, Eric Steven 1986 "A parsing expert system which learns from corpus analysis" in Willem Meijs (ed) Corpus Linguistics and Beyond: Proceedings of the 1986 Seventh International Conference on English Language Research on Computerised Corpora, Amsterdam, Netherlands Rodopi, Amsterdam
Atwell, Eric Steven, and Nikos Drakos (forthcoming), "Pattern Recognition Applied to the Acquisition of a Grammatical Classification System from Unrestricted English Text" to appear in Proceedings of the 1987 Association for Computational Linguistics Third European Chapter Conference, Copenhagen, Denmark
Atwell, Eric Steven (forthcoming) "An Expert System for the Automatic Discovery of Particles" to appear in Proceedings of the 1987 International Conference on the Study of Language Particles, West Berlin, West Germany
Thomas, A N 1961, "Now Kruschev Hots Up" in News of the World July 9 (LOB Corpus text sample A21)
'The Walrus’ 1961, "Of Shoes and Ships and Sealing Wax" in Yachting World December (LOB Corpus text sample E18)
(Anonymous) 1961, "Editorial Points" in Hair and Beauty 41: 6 (June) (LOB Corpus text sample E34)
Hamblin, H 1961, "Give Back My Dreams" in Smart Novels February 6 (LOB Corpus text sample P17)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1988 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Atwell, E.S. (1988). Grammatical analysis of English by statistical pattern recognition. In: Kittler, J. (eds) Pattern Recognition. PAR 1988. Lecture Notes in Computer Science, vol 301. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-19036-8_63
Download citation
DOI: https://doi.org/10.1007/3-540-19036-8_63
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-19036-3
Online ISBN: 978-3-540-38947-7
eBook Packages: Springer Book Archive