Skip to main content
SpringerLink
Log in

Friends and Enemies of Clinton and Trump: Using Context for Detecting Stance in Political Tweets

  • Conference paper
  • First Online:
Advances in Computational Intelligence (MICAI 2016)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10061))

Included in the following conference series:

Abstract

Stance detection, the task of identifying the speaker’s opinion towards a particular target, has attracted the attention of researchers. This paper describes a novel approach for detecting stance in Twitter. We define a set of features in order to consider the context surrounding a target of interest with the final aim of training a model for predicting the stance towards the mentioned targets. In particular, we are interested in investigating political debates in social media. For this reason we evaluated our approach focusing on two targets of the SemEval-2016 Task 6 on Detecting stance in tweets, which are related to the political campaign for the 2016 U.S. presidential elections: Hillary Clinton vs. Donald Trump. For the sake of comparison with the state of the art, we evaluated our model against the dataset released in the SemEval-2016 Task 6 shared task competition. Our results outperform the best ones obtained by participating teams, and show that information about enemies and friends of politicians help in detecting stance towards them.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    They are the candidates who won the Party Presidential Primaries for the Democratic and Republican parties, respectively.

  2. 2.

    http://alt.qcri.org/semeval2016/task6/.

  3. 3.

    This tweet was extracted from the training set of SemEval-2016 Task 6.

  4. 4.

    Notice that not all the reports describing systems and approaches of teams participating at SemEval-2016 Task 6 are available in [8].

  5. 5.

    https://github.com/mirkolai/Friends-and-Enemies-of-Clinton-and-Trump.

  6. 6.

    For example, the term vote is strongly related to politics, but it is not present in commonly used SA lexica such as: AFINN, Hu & Liu, and LIWC.

  7. 7.

    Articles: Democratic Party presidential primaries, 2016 and Republican Party presidential candidates, 2016.

  8. 8.

    https://en.wikipedia.org/wiki/J._Christopher_Stevens.

  9. 9.

    Notice that this is the first publicly available Twitter dataset annotated with both stance and sentiment.

  10. 10.

    http://scikit-learn.org/.

  11. 11.

    The authors experimented with n-grams, char-grams and majority class to establish the baselines for the task.

References

  1. Liu, B.: Sentiment Analysis and Opinion Mining. Synthesis Lectures on Human Language Technologies vol. 5, pp. 1–167. Morgan & Claypool Publishers, San Rafael (2012)

    Google Scholar 

  2. Pontiki, M., Galanis, D., Papageorgiou, H., Androutsopoulos, I., Manandhar, S., AL-Smadi, M., Al-Ayyoub, M., Zhao, Y., Qin, B., De Clercq, O., Hoste, V., Apidianaki, M., Tannier, X., Loukachevitch, N., Kotelnikov, E., Bel, N., Jiménez-Zafra, S.M., Eryiğit, G.: Semeval-2016 task 5: aspect based sentiment analysis. In: Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016), pp. 19–30. ACL (2016)

    Google Scholar 

  3. Mohammad, S., Kiritchenko, S., Sobhani, P., Zhu, X., Cherry, C.: SemEval-2016 task 6: detecting stance in tweets. In: Bethard et al. [8], pp. 31–41 (2016)

    Google Scholar 

  4. Bosco, C., Lai, M., Patti, V., Virone, D.: Tweeting and being ironic in the debate about a political reform: the French annotated corpus twitter-mariagepourtous. In: Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), pp. 1619–1626. ELRA (2016)

    Google Scholar 

  5. Stranisci, M., Bosco, C., Hernández Farías, D.I., Patti, V.: Annotating sentiment and irony in the online Italian political debate on #labuonascuola. In: Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), pp. 2892–2899. ELRA (2016)

    Google Scholar 

  6. Maldonado, M., Sierra, V.: Twitter predicting the 2012 US presidential election? Lessons learned from an unconscious value co-creation platform. J. Organ. End User Comput. (JOEUC) 28, 10–30 (2016)

    Article  Google Scholar 

  7. Schumacher, E., Eskenazi, M.: A readability analysis of campaign speeches from the 2016 US presidential campaign. CoRR abs/1603.05739 (2016)

    Google Scholar 

  8. Bethard, S., Carpuat, M., Cer, D., Jurgens, D., Nakov, P., Zesch, T. (eds.): Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016). Association for Computational Linguistics, San Diego (2016)

    Google Scholar 

  9. Mohammad, S.M., Turney, P.D.: Crowdsourcing a word-emotion association lexicon. Computat. Intell. 29, 436–465 (2013)

    Article  MathSciNet  Google Scholar 

  10. Wilson, T., Wiebe, J., Hoffmann, P.: Recognizing contextual polarity in phrase-level sentiment analysis. In: Proceedings of the Conference on HLT and Empirical Methods in Natural Language Processing, pp. 347–354. ACL (2005)

    Google Scholar 

  11. Hu, M., Liu, B.: Mining and summarizing customer reviews. In: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2004, Seattle, WA, USA, pp. 168–177. ACM (2004)

    Google Scholar 

  12. Mohammad, S., Kiritchenko, S., Zhu, X.: NRC-Canada: building the state-of-the-art in sentiment analysis of tweets. In: Proceedings of the Seventh International Workshop on Semantic Evaluation Exercises (SemEval-2013), Atlanta, Georgia, USA (2013)

    Google Scholar 

  13. Zarrella, G., Marsh, A.: MITRE at SemEval-2016 task 6: transfer learning for stance detection. In: Bethard et al. [8], pp. 470–475 (2016)

    Google Scholar 

  14. Wei, W., Zhang, X., Liu, X., Chen, W., Wang, T.: pkudblab at SemEval-2016 task 6: a specific convolutional neural network system for effective stance detection. In: Bethard et al. [8], pp. 396–400 (2016)

    Google Scholar 

  15. Tutek, M., Sekulic, I., Gombar, P., Paljak, I., Culinovic, F., Boltuzic, F., Karan, M., Alagić, D., Šnajder, J.: TakeLab at SemEval-2016 task 6: stance classification in tweets using a genetic algorithm based ensemble. In: Bethard et al. [8], pp. 476–480 (2016)

    Google Scholar 

  16. Zhang, Z., Lan, M.: ECNU at SemEval 2016 task 6: relevant or not? Supportive or not? A two-step learning system for automatic detecting stance in tweets. In: Bethard et al. [8], pp. 463–469 (2016)

    Google Scholar 

  17. Elfardy, H., Diab, M.: CU-GWU perspective at SemEval-2016 task 6: ideological stance detection in informal text. In: Bethard et al. [8], pp. 446–451 (2016)

    Google Scholar 

  18. Liu, C., Li, W., Demarest, B., Chen, Y., Couture, S., Dakota, D., Haduong, N., Kaufman, N., Lamont, A., Pancholi, M., Steimel, K., Kübler, S.: IUCL at SemEval-2016 task 6: an ensemble model for stance detection in twitter. In: Bethard et al. [8], pp. 406–412 (2016)

    Google Scholar 

  19. Vijayaraghavan, P., Sysoev, I., Vosoughi, S., Roy, D.: Deepstance at SemEval-2016 task 6: detecting stance in tweets using character and word-level CNNs. In: Bethard et al. [8], pp. 425–431 (2016)

    Google Scholar 

  20. Krejzl, P., Steinberger, J.: UWB at SemEval-2016 task 6: stance detection. In: Bethard et al. [8], pp. 420–424 (2016)

    Google Scholar 

  21. Bøhler, H., Asla, P., Marsi, E., Sætre, R.: IDI\(@\)NTNU at SemEval-2016 task 6: detecting stance in tweets using shallow features and glove vectors for word representation. In: Bethard et al. [8], pp. 457–462 (2016)

    Google Scholar 

  22. Igarashi, Y., Komatsu, H., Kobayashi, S., Okazaki, N., Inui, K.: Tohoku at SemEval-2016 task 6: feature-based model versus convolutional neural network for stance detection. In: Bethard et al. [8], pp. 413–419 (2016)

    Google Scholar 

  23. Wojatzki, M., Zesch, T.: ltl.uni-due at SemEval-2016 task 6: stance detection in social media using stacked classifiers. In: Bethard et al. [8], pp. 440–445 (2016)

    Google Scholar 

  24. Patra, B.G., Das, D., Bandyopadhyay, S.: JU_NLP at SemEval-2016 task 6: detecting stance in tweets using support vector machines. In: Bethard et al. [8], pp. 452–456 (2016)

    Google Scholar 

  25. Misra, A., Ecker, B., Handleman, T., Hahn, N., Walker, M.: NLDS-UCSC at SemEval-2016 task 6: a semi-supervised approach to detecting stance in tweets. In: Bethard et al. [8], pp. 432–439 (2016)

    Google Scholar 

  26. Dias, M., Becker, K.: INF-UFRGS-OPINION-MINING at SemEval-2016 task 6: automatic generation of a training corpus for unsupervised identification of stance in tweets. In: Bethard et al. [8], pp. 390–395 (2016)

    Google Scholar 

  27. Augenstein, I., Vlachos, A., Bontcheva, K.: USFD at SemEval-2016 task 6: any-target stance detection on twitter with autoencoders. In: Bethard et al. [8], pp. 401–405 (2016)

    Google Scholar 

  28. Nielsen, F.Å.: A new ANEW: evaluation of a word list for sentiment analysis in microblogs. CoRR abs/1103.2903 (2011)

    Google Scholar 

  29. Pennebaker, J.W., Francis, M.E., Booth, R.J.: Linguistic Inquiry and Word Count: LIWC 2001. Lawrence Erlbaum Associates, Mahwah (2001)

    Google Scholar 

  30. Whissell, C.: Using the revised dictionary of affect in language to quantify the emotional undertones of samples of natural language. Psychol. Rep. 105, 509–521 (2009)

    Article  Google Scholar 

  31. Mohammad, S., Kiritchenko, S., Sobhani, P., Zhu, X., Cherry, C.: A dataset for detecting stance in tweets. In: Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016). ELRA (2016)

    Google Scholar 

  32. Chan, T.F., Golub, G.H., LeVeque, R.J.: Updating formulae and a pairwise algorithm for computing sample variances. Technical report, Stanford University, Stanford (1979)

    Google Scholar 

  33. Hernández Farías, D.I., Patti, V., Rosso, P.: Irony detection in twitter: the role of affective content. ACM Trans. Internet Technol. 16, 19:1–19:24 (2016)

    Google Scholar 

  34. Sulis, E., Hernández Farías, D.I., Rosso, P., Patti, V., Ruffo, G.: Figurative messages and affect in twitter: differences between #irony, #sarcasm and #not. knowledge-based systems. New Ave. Knowl. Bases Nat. Lang. Process. 108, 132–143 (2016)

    Google Scholar 

Download references

Acknowledgments

The National Council for Science and Technology (CONACyT Mexico) has funded the research work of Delia Irazú Hernández Farías (218109/313683). The work of Paolo Rosso has been partially funded by the SomEMBED TIN2015-71147-C2-1-P MINECO research project and by the Generalitat Valenciana under the grant ALMAMATER (PrometeoII/2014/030). The work of Viviana Patti was partially carried out at the Universitat Politècnica de València within the framework of a fellowship of the University of Turin co-funded by Fondazione CRT (World Wide Style Program 2).

Author information

Authors and Affiliations

  1. Dipartimento di Informatica, Università degli Studi di Torino, Turin, Italy

    Mirko Lai, Delia Irazú Hernández Farías & Viviana Patti

  2. Pattern Recognition and Human Language Technologies Research Center, Universitat Politécnica de Valéncia, Valencia, Spain

    Mirko Lai, Delia Irazú Hernández Farías & Paolo Rosso

Authors
  1. Mirko Lai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Delia Irazú Hernández Farías
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Viviana Patti
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Paolo Rosso
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mirko Lai .

Editor information

Editors and Affiliations

  1. Instituto Politécnico Nacional, Centro de Investigación en Computación, Mexico City, Mexico

    Grigori Sidorov

  2. Universidad Autónoma Metropolitana, Mexico City, Mexico

    Oscar Herrera-Alcántara

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Lai, M., Hernández Farías, D.I., Patti, V., Rosso, P. (2017). Friends and Enemies of Clinton and Trump: Using Context for Detecting Stance in Political Tweets. In: Sidorov, G., Herrera-Alcántara, O. (eds) Advances in Computational Intelligence. MICAI 2016. Lecture Notes in Computer Science(), vol 10061. Springer, Cham. https://doi.org/10.1007/978-3-319-62434-1_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-62434-1_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-62433-4

  • Online ISBN: 978-3-319-62434-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation