Abstract
With the development of the network, the research of user reviews has become more important in academia and industry, because user reviews gradually influence the reputation of products and services. Argument mining has recently become a hot topic, and it is currently in the center of attention of the text mining research community. We can deeply dig out information contained in the user reviews with argument mining technology. This paper makes a corpus of hotel reviews and presents a novel scheme to model arguments, their components and relations in hotel reviews in English. In order to capture the structure of argumentative discourse, the annotation scheme includes the annotation of Major Claim, Claim, Premise, Background and Recommendation as well as Support and Attack relations. The sentiment polarity of argument components contains Positive, Negative and Neutral. We conduct a manual annotation study with 300 annotators on 1427 hotel reviews. And the final corpus collects 85 hotel reviews according to inter-rater agreement and it will encourage future study in argument recognition.
The work is supported by both National scientific and Technological Innovation Zero (No. 17-H863-01-ZT-005-005-01) and State’s Key Project of Research and Development Plan (No. 2016QY03D0505).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
References
Fleiss, J.L.: Measuring nominal scale agreement among many raters. Psychol. Bull. 76(5), 378–382 (1971)
Goudas, T., Louizos, C., Petasis, G., Karkaletsis, V.: Argument extraction from news, blogs, and social media. In: Likas, A., Blekas, K., Kalles, D. (eds.) SETN 2014. LNCS (LNAI), vol. 8445, pp. 287–299. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07064-3_23
Goudas, T., Louizos, C., Petasis, G., Karkaletsis, V.: Argument extraction from news, blogs, and the social web. Int. J. Artif. Intell. Tools 24(05), 1540024 (2015)
Krippendorff, K.: Content Analysis: An Introduction to Its Methodology. SAGE Publications, Thousand Oaks (1980)
Landis, J.R., Koch, G.G.: The measurement of observer agreement for categorical data. Biometrics 33(1), 159–174 (1977)
Lippi, M., Torroni, P.: Argument mining: a machine learning perspective. In: Black, E., Modgil, S., Oren, N. (eds.) TAFA 2015. LNCS (LNAI), vol. 9524, pp. 163–176. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-28460-6_10
Lippi, M., Torroni, P.: Context-independent claim detection for argument mining. In: IJCAI 2015, pp. 185–191 (2015)
Lippi, M., Torroni, P.: Argumentation mining: state of the art and emerging trends. ACM Trans. Internet Technol. (TOIT) 16(2), 10 (2016)
Mochales, R., Moens, M.F.: Study on the structure of argumentation in case law, vol. 20, no. 41, pp. 11–20 (2008)
Mochales, R., Moens, M.F.: Argumentation mining. Artif. Intell. Law 19(1), 1–22 (2011)
Moens, M.F.: Argumentation mining: where are we now, where do we want to be and how do we get there? pp. 1–6 (2013)
Moens, M.F., Boiy, E., Palau, R.M., Reed, C.: Automatic detection of arguments in legal texts. In: Proceedings of the 11th International Conference on Artificial Intelligence and Law, pp. 225–230. ACM (2007)
Park, J., Cardie, C.: Identifying appropriate support for propositions in online user comments. In: Proceedings of the First Workshop on Argumentation Mining, pp. 29–38. Association for Computational Linguistics (2014). https://doi.org/10.3115/v1/W14-2105
Rooney, N., Wang, H., Browne, F.: Applying kernel methods to argumentation mining. In: FLAIRS Conference (2012)
Stab, C., Gurevych, I.: Annotating argument components and relations in persuasive essays. In: Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, pp. 1501–1510. Dublin City University and Association for Computational Linguistics (2014)
Stab, C., Gurevych, I.: Identifying argumentative discourse structures in persuasive essays. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 46–56. Association for Computational Linguistics (2014). https://doi.org/10.3115/v1/D14-1006
Stab, C., Gurevych, I.: Parsing argumentation structures in persuasive essays. Comput. Linguist. 43(3), 619–659 (2017). https://doi.org/10.1162/COLI_a_00295
Wachsmuth, H., Trenkmann, M., Stein, B., Engels, G.: Modeling review argumentation for robust sentiment analysis. In: Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, pp. 553–564. Dublin City University and Association for Computational Linguistics, Dublin, August 2014. http://www.aclweb.org/anthology/C14-1053
Wachsmuth, H., Trenkmann, M., Stein, B., Engels, G., Palakarska, T.: A review corpus for argumentation analysis. In: Gelbukh, A. (ed.) CICLing 2014. LNCS, vol. 8404, pp. 115–127. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-642-54903-8_10
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Duan, X., Liao, M., Zhao, X., Wu, W., Lv, P. (2019). A Hotel Review Corpus for Argument Mining. In: Sun, F., Liu, H., Hu, D. (eds) Cognitive Systems and Signal Processing. ICCSIP 2018. Communications in Computer and Information Science, vol 1005. Springer, Singapore. https://doi.org/10.1007/978-981-13-7983-3_29
Download citation
DOI: https://doi.org/10.1007/978-981-13-7983-3_29
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-7982-6
Online ISBN: 978-981-13-7983-3
eBook Packages: Computer ScienceComputer Science (R0)