Skip to main content
SpringerLink
Log in

Distributional Semantics: A Montagovian View

  • Chapter
Categories and Types in Logic, Language, and Physics

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 8222))

  • 1128 Accesses

Abstract

This paper describes the current status of research in Distributional Semantics looking at the results from the Montagovian tradition stand point. It considers the main aspects of the Montagovian view as binoculars to observe those results, in particular: compositionality, syntax-semantics interface, logical words and entailment. To this end, it reviews some work that aims to tackle those issues within the Distributional Semantics Models and tries to highlight some open questions formal and distributional semanticists could address together.

Credits: Some of the material in the background section is based on distributional semantics talks by Marco Baroni, Stefan Evert, Alessandro Lenci and Roberto Zamparelli.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Barker, C., Shan, C.-C.: Types as graphs: Continuations in type logical grammar. Journal of Logic, Language and Information 15, 331–370 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  2. Baroni, M., Bernardi, R., Shan, C.-C., Do, N.Q.: Entailment above the word level in distributional semantics. In: Proceedings of EACL (2012)

    Google Scholar 

  3. Baroni, M., Bernardi, R., Zamparelli, R.: Frege in space: A program for compositional distributional semantics. Linguistic Issues in Language Technology; Special issues on Semantics for textual inference (in press)

    Google Scholar 

  4. Baroni, M., Evert, S., Lenci, A. (eds.): Proceedings of the ESSLLI Workshop on Distributional Lexical Semantics, ESSLLI 2008 (2008)

    Google Scholar 

  5. Baroni, M., Zamparelli, R.: Nouns are vectors, adjectives are matrices: Representing adjective-noun constructions in semantic space. In: Proceedings of EMNLP, Boston, MA, pp. 1183–1193 (2010)

    Google Scholar 

  6. Bernardi, R., Moortgat, M.: Continuation semantics for the Lambek-Grishin calculus. Information and Computation 208(5), 397–416 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  7. Church, K.W., Hanks, P.: Word association norms, mutual information and lexicography. Proceedings of the 27th Annual Conference of the Association of Computational Linguistics (ACL 1989) (1989)

    Google Scholar 

  8. Clark, S.: Type Driven Syntax and Semantics for Composing Meaning Vectors. In: Quantum Physics and Linguistics: A Compositional, Diagrammatic Discourse. Oxford University Press (2012) (in press)

    Google Scholar 

  9. Clark, S., Coecke, B., Sadrzadeh, M.: A compositional distributional model of meaning. In: Bruza, P., Lawless, W., van Rijsbergen, K., Coecke, B., Sofge, D., Clark, S. (eds.) Proceedings of the Second Symposium on Quantum Interaction, pp. 133–140 (2008)

    Google Scholar 

  10. Clark, S., Curran, J.: Wide-coverage efficient statistical parsing with CCG and log-linear models. Computational Linguistics 33(4), 493–552 (2007)

    Article  MATH  Google Scholar 

  11. Clarke, D.: A context-theoretic framework for compositionality in distributional semantics. Computational Linguistics 1(54) (2011)

    Google Scholar 

  12. Coecke, B., Sadrzadeh, M., Clark, S.: Mathematical foundations for a compositional distributed model of meaning. Lambek Festschirft, Linguistic Analysis 36, 36 (2010)

    Google Scholar 

  13. Coecke, B., Grefenstette, E., Sadrzadeh, M.: Lambek vs. Lambek: Vector space semantics and string diagrams for lambek calculus (2012) (unpublished)

    Google Scholar 

  14. Curran, J., Clark, S., Bos, J.: Linguistically motivated large-scale nlp with c&c and boxer. In: Proceedings of ACL (Demo and Poster Sessions), Prague, Czech Republic, pp. 33–36 (2007)

    Google Scholar 

  15. Deerwster, S., Dumai, S.T., Furnas, G.W., Landauer, T.K., Harshman, R.: Indexing by latent semantic analysis. In: J. Am. Soc. Information Science and Technology (1990)

    Google Scholar 

  16. Erk, K.: Supporting inferences in semantic space: representing words as regions. In: Proceedings of IWCS, Tilburg, Netherlands, pp. 104–115 (2009)

    Google Scholar 

  17. Firth, J.R.: A synopsis of linguistic theory 1930-1955. Studies in Linguistic Analysis (1957); Reprinted in Palmer, F.R. (ed.) Selected Papers of J.R. Firth 1952-1959. Longman, London (1968)

    Google Scholar 

  18. Garrette, D., Erk, K., Mooney, R.: Integrating logical representations with probabilistic information using markov logic. In: Proceedings of the International Conference on Computational Semantics, Oxford, England, pp. 105–114 (January 2011)

    Google Scholar 

  19. Geffet, M., Dagan, I.: The distributional inclusion hypotheses and lexical entailment. In: Proceedings of the 43rd Annual Meeting of the ACL, pp. 107–114 (2005)

    Google Scholar 

  20. Grefenstette, E., Dinu, G., Zhang, Y.-Z., Sadrzadeh, M., Baroni, M.: Multi-step regression learning for compositional distributional semantics. In: Proceedings of IWCS, Potsdam, Germany (2013)

    Google Scholar 

  21. Grefenstette, E., Sadrzadeh, M.: Experimental support for a categorical compositional distributional model of meaning. In: Proceedings of EMNLP, Edinburgh, UK, pp. 1394–1404 (2011)

    Google Scholar 

  22. Grefenstette, E., Sadrzadeh, M.: Experimenting with transitive verbs in a DisCoCat. In: Proceedings of GEMS, Edinburgh, UK, pp. 62–66 (2011)

    Google Scholar 

  23. Grice, H.P.: Logic and conversation. Syntax and Semantics (1975); Reprinted in Studies in the Way of Words Grice, H.P. (ed.), pp. 22–40. Harvard University Press, Cambridge (1989)

    Google Scholar 

  24. Vasques, M.X.G.: Quantifying determiners from the distributional semantics view. Master’s thesis, Free University of Bozen-Bolzano. Erasmus Mundus European Master Program in Langauge and Communication Technologies (2012)

    Google Scholar 

  25. Harris, Z.: Distributional structure. Word 10(23), 146–162 (1954)

    Article  Google Scholar 

  26. Honnibal, M., Curran, J.R., Bos, J.: Rebanking CCGBank for improved interpretation. In: Proceedings of the 48th Annual Meeting of ACuL, pp. 207–215 (2007)

    Google Scholar 

  27. Jones, K.S.: A statistical interpretation of term specificity and its application in retrieval. Journal of Documentation 28(11) (1972)

    Google Scholar 

  28. Kartsaklis, D., Sadrzadeh, M., Pulman, S., Coecke, B.: Reasoning about meaning in natural language with compact closed categories and frobenius algebras (2012) (unpublished)

    Google Scholar 

  29. Kotlerman, L., Dagan, I., Szpektor, I., Zhitomirsky-Geffet, M.: Directional distributional similarity for lexical inference. Natural Language Engineering (2010)

    Google Scholar 

  30. Lambek, J.: The mathematics of sentence structure. American Mathematical Monthly 65, 154–170 (1958)

    Article  MathSciNet  MATH  Google Scholar 

  31. Lambek, J.: Type grammars revisited. In: Lecomte, A., Perrier, G., Lamarche, F. (eds.) LACL 1997. LNCS (LNAI), vol. 1582, pp. 1–27. Springer, Heidelberg (1999)

    Chapter  Google Scholar 

  32. Lambek, J.: A computational algebraic approach to english grammar. Syntax (2004)

    Google Scholar 

  33. McDonald, S., Ramscar, M.: Testing the distributional hypothesis: The influence of context on judgements of semantic similarity. In: Proceedings of CogSci, pp. 611–616 (2001)

    Google Scholar 

  34. Menini, S.: A distributional approach to determiners. Master’s thesis, University of Trento (2012)

    Google Scholar 

  35. Mitchell, J., Lapata, M.: Composition in distributional models of semantics. Cognitive Science 34(8), 1388–1429 (2010)

    Article  Google Scholar 

  36. Montague, R.: English as a formal language. Linguaggi Nella Società e Nella Tecnica, 189–224 (1970)

    Google Scholar 

  37. Moortgat, M.: Categorial Type Logics. In: van Benthem, J., ter Meulen, A. (eds.) Handbook of Logic and Language, pp. 93–178. The MIT Press, Cambridge (1997)

    Chapter  Google Scholar 

  38. Morrill, G.: Type Logical Grammar. Kluwer, Dordrecht (1994)

    Book  MATH  Google Scholar 

  39. Paramita: Exploiting ccg derivations within distributional semantic models. Master’s thesis, Free University of Bozen-Bolzano. Erasmus Mundus European Master Program in Langauge and Communication Technologies (2012)

    Google Scholar 

  40. Paterson, K., Filik, R., Moxey, L.: Quantifiers and discourse processing. Language and Linguistics Compass, 1–29 (2011)

    Google Scholar 

  41. Pham, N., Bernardi, R., Zhang, Y.Z., Baroni, M.: Sentence paraphrase detection: When determiners and word order make the difference. In: Proceedings of the IWCS 2013 Workshop: Towards a Formal Distributional Semantics (2013)

    Google Scholar 

  42. Preller, A., Sadrzadeh, M.: Bell states as negation in natural languages. ENTCS. QPL, University of Oxford (2009)

    Google Scholar 

  43. Socher, R., Huval, B., Manning, C., Ng, A.: Semantic compositionality through recursive matrix-vector spaces. In: Proceedings of EMNLP, Jeju Island, Korea, pp. 1201–1211 (2012)

    Google Scholar 

  44. Steedman, M.: The Syntactic Process. MIT Press, Cambridge (2000)

    MATH  Google Scholar 

  45. Turney, P., Pantel, P.: From frequency to meaning: Vector space models of semantics. Journal of Artificial Intelligence Research 37, 141–188 (2010)

    MathSciNet  MATH  Google Scholar 

  46. Vecchi, E.M., Baroni, M., Zamparelli, R.: (linear) maps of the impossible: Capturing semantic anomalies in distributional space. In: Proceedings of the ACL DISCo Workshop, pp. 1–9 (2011)

    Google Scholar 

  47. Weaver: Translation. In: Machine Translation of Languages. MIT Press, Cambridge (1955)

    Google Scholar 

  48. Weeds, J., Weir, D., McCarthy, D.: Characterising measures of lexical distributional similarity. In: Proceedings of the 20th International Conference of Computational Linguistics, COLING 2004, pp. 1015–1021 (2004)

    Google Scholar 

  49. Widdows, D.: Orthogonal negation in vector spaces for modelling word-meanings and document retrieval. In: Proceedings of the 41st Annual Meeting on Association for Computational Linguistics, ACL 2003, vol. 1, pp. 136–143. Association for Computational Linguistics (2003)

    Google Scholar 

  50. Wittgenstein, L.: Philosophical Investigations. Blackwell, Oxford (1953); Translated by G.E.M. Anscombe

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. DISI, University of Trento, Italy

    Raffaella Bernardi

Authors
  1. Raffaella Bernardi
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Philosophy, Education and Quantitative Economics, Gabriele D’Annunzio University, Chieti-Pescara, Via dei Vestini 31, 60100, Chieti, Italy

    Claudia Casadio

  2. Department of Computer Science, Oxford University, Wolfson Building, Parks Road, OX1 3QD, Oxford, UK

    Bob Coecke

  3. Utrecht Institute of Linguistics OTS, Utrecht University, Trans 10,, 3512 JK, Utrecht, The Netherlands

    Michael Moortgat

  4. Department of Mathematics, University of Ottawa, 585 King Edward, K1N 6N5, Ottawa, ON, Canada

    Philip Scott

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Bernardi, R. (2014). Distributional Semantics: A Montagovian View. In: Casadio, C., Coecke, B., Moortgat, M., Scott, P. (eds) Categories and Types in Logic, Language, and Physics. Lecture Notes in Computer Science, vol 8222. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-54789-8_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-54789-8_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-54788-1

  • Online ISBN: 978-3-642-54789-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation