Abstract
Metaphor is a pervasive phenomenon in our daily use of natural language. Metaphor detection has been playing an important role in a variety of NLP tasks. Most existing approaches to this task rely heavily on the use of human-crafted features built from linguistic knowledge resource, which greatly limits their applicability. This paper presents four BiLSTM-based models for metaphor detection. The first three models use a sub-sequence as the input to BiLSTM network, each with a special kind of sub-sequence extracted from the input sentence. The last model is an ensemble model which aggregate the outputs from the first three models to get the final output. Experimental results have shown the effectiveness of our models.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
- 3.
- 4.
- 5.
- 6.
- 7.
- 8.
References
Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent Dirichlet allocation. In: Advances in Neural Information Processing Systems, pp. 601–608 (2002)
Graves, A., Schmidhuber, J.: Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural Netw. 18(5), 602–610 (2005)
Graves, A., Mohamed, A., Hinton, G.: Speech recognition with deep recurrent neural networks. In: The Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 6645–6649 (2013)
Graves, A.: Generating sequences with recurrent neural networks. arXiv preprint arXiv:1308.0850 (2013)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)
Heintz, I., Gabbard, R., Srinivasan, M., Barner, D., Black, D.S., Freedman, M., Weischedel, R.: Automatic extraction of linguistic metaphor with LDA topic modeling. In: Proceedings of the First Workshop on Metaphor in NLP, pp. 58–66 (2013)
Jang, H., Jo, Y., Shen, Q., Miller, M., Moon, S., Rosé, C.P.: Metaphor detection with topic transition, emotion and cognition in context. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, pp. 216–225 (2016)
Klebanov, B.B., Leong, C.W., Heilman, M., Flor, M.: Different texts, same metaphor: unigrams and beyond. In: Proceedings of the Second Workshop on Metaphor in NLP, pp. 11–17 (2014)
Klebanov, B.B., Leong, C.W., Flor, M.: Supervised word-level metaphor detection: experiments with concreteness and reweighting of examples. In: Proceedings of the Third Workshop on Metaphor in NLP, pp. 11–20 (2015)
Lakoff, G., Johnson, M.: Metaphors We Live By. University of Chicago press, Chicago (2008)
Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems, pp. 3111–3119 (2013)
Schulder, M., Hovy, E.: Metaphor detection through term relevance. In: Proceedings of the Second Workshop on Metaphor in NLP, pp. 18–26 (2014)
Shutova, E., Teufel, S.: Metaphor corpus annotated for source-target domain mappings. In: Proceedings of LREC, pp. 3255–3261 (2010)
Shutova, E.: Design and evaluation of metaphor processing systems. Comput. Linguist. 41(4), 579–623 (2015)
Srivastava, N., Hinton, G.E., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)
Turney, P.D., Neuman, Y., Assaf, D., Cohen, Y.: Literal and metaphorical sense identification through concrete and abstract context. In: Proceedings of the 2011 Conference on the Empirical Methods in Natural Language Processing, pp. 680–690 (2011)
Tsvetkov, Y., Boytsov, L., Gershman, A., Nyberg, E., Dyer, C.: Metaphor detection with cross-lingual model transfer. In: Proceedings of the Annual Meeting of the Association for Computational Linguistics, pp. 248–258 (2014)
Acknowledgments
This work is partially supported by National High-Tech R&D Program of China (863 Program) (No. 2015AA015404), the 2016 Civil Aviation Safety Capacity Development Funding Project, and the project “Aircraft Operation Resource Data Exchange and Integration”. We are grateful to the anonymous reviewers for their valuable comments.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Sun, S., Xie, Z. (2018). BiLSTM-Based Models for Metaphor Detection. In: Huang, X., Jiang, J., Zhao, D., Feng, Y., Hong, Y. (eds) Natural Language Processing and Chinese Computing. NLPCC 2017. Lecture Notes in Computer Science(), vol 10619. Springer, Cham. https://doi.org/10.1007/978-3-319-73618-1_36
Download citation
DOI: https://doi.org/10.1007/978-3-319-73618-1_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-73617-4
Online ISBN: 978-3-319-73618-1
eBook Packages: Computer ScienceComputer Science (R0)