Skip to main content
SpringerLink
Log in

Sentiment analysis: dynamic and temporal clustering of product reviews

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

The increased availability of online reviews requires a relevant solution to draw chronological insights from review streams. This paper introduces temporal sentiment analysis by adopting the automatic contextual analysis and ensemble clustering (ACAEC) algorithm. ACAEC is a clustering algorithm which utilizes contextual analysis and a clustering ensemble learning. We propose chronological sentiment analysis using window sequential clustering (WSC) and segregated window clustering (SWC). WSC is a dynamic analysis, whereas SWC is solely based on the temporal characteristic of reviews. ACAEC is the base learning algorithm of WSC and SWC. ACAEC’s ensemble approach is enhanced using an additional weight scheme and an additional learner to improve WSC’s outcome. To understand the produced sentiment pattern, an unsupervised review selection is introduced which is based on review polarity. We also introduce consistency, a free-label measure to assess the algorithm’s performance. For this study, new sets of reviews are introduced, these being four airlines and an Australian property agent. In terms of accuracy and stability, the proposed methods are effective in processing a review series. Experiments show that the average accuracy rates of SWC and WSC reach 87.54% and 83.87%, respectively. In addition, it is robust against the so-called imbalanced windows problem. The suggested solutions are unsupervised i. e. domain-independent and suitable for the analysis of a large review series.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Notes

  1. The datasets can be accessed using this link

    http://homepage.cs.latrobe.edu.au/liufei/Supervision/index.html

  2. http://sentiwordnet.isti.cnr.it/

  3. http://labs.cybozu.co.jp/en/

  4. https://sourceforge.net/projects/jazzy

  5. The datasets can be accessed using this link

    http://homepage.cs.latrobe.edu.au/liufei/Supervision/index.html

References

  1. Ahmadian S, Joorabloo N, Jalili M, Meghdadi M, Afsharchi M, Ren Y (2018) A temporal clustering approach for social recommender systems. In: 2018 IEEE/ACM international conference on advances in social networks analysis and mining (ASONAM). IEEE, pp 1139–1144

  2. AL-Sharuee MT, Liu F, Pratama M (2018) Sentiment analysis: an automatic contextual analysis and ensemble clustering approach and comparison. Data Knowl Eng 115:194–213

    Article  Google Scholar 

  3. Alves ALF, Baptista CdS, Firmino AA, de Oliveira MG, de Figueirêdo HF (2014) Temporal analysis of sentiment in tweets: a case study with FIFA confederations cup in Brazil. In: Decker H, Lhotsk’a L, Link S, Spies M, Wagner RR (eds) Database and expert systems applications. Springer International Publishing, Cham, pp 81–88

    Chapter  Google Scholar 

  4. Baccianella S, Esuli A, Sebastiani F (2010) Sentiwordnet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: Paper presented at the 7th international conference on language resources and evaluation (LREC), Valletta, Malta, pp 2200–2204

  5. Beyerer J, Richter M, Nagel M (2017) Pattern recognition: introduction, features, classifiers and principles. Walter de Gruyter GmbH & Co KG

  6. Chan SW, Chong MW (2017) Sentiment analysis in financial texts. Decis Support Syst 94:53–64

    Article  Google Scholar 

  7. Chen T, Guestrin C (2016) XGBoost: a scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 785–794

  8. Chen C, Wang Z, Lei Y, Li W (2016) Content-based influence modeling for opinion behavior prediction. In: Proceedings of COLING 2016, the 26th international conference on computational linguistics: technical papers, pp 2207–2216

  9. Cichosz P (2015) Data mining algorithms: explained using R. Wiley, Chichester

    Book  Google Scholar 

  10. Dietterich TG (2000a) Ensemble methods in machine learning. In: Multiple classifier systems. Springer Berlin Heidelberg, pp 1–15

  11. Eslami SP, Ghasemaghaei M, Hassanein K (2018) Which online reviews do consumers find Most helpful? A multi-method investigation. Decis Support Syst 113:32–42

    Article  Google Scholar 

  12. Feldman R (2013) Techniques and applications for sentiment analysis. Commun ACM 56:82–89

    Article  Google Scholar 

  13. Fukuhara T, Nishida T (2007) Understanding sentiment of people from news articles: temporal sentiment analysis of social events. In: Proceedings of international conference on weblogs and social media (ICWSM)

  14. Haixiang G, Yijing L, Shang J, Mingyun G, Yuanyue H, Bing G (2017) Learning from class-imbalanced data: review of methods and applications. Expert Syst Appl 73:220–239

    Article  Google Scholar 

  15. Hansen LK, Salamon P (1990) Neural network ensembles. IEEE Trans Pattern Anal Mach Intell 12:993–1001

    Article  Google Scholar 

  16. Hu YH, Chen YL, Chou HL (2017) Opinion mining from online hotel reviews-a text summarization approach. Inf Process Manag 53:436–449

    Article  Google Scholar 

  17. Hüsch M, Schyska BU, von Bremen L (2018) CorClustST—correlation–based clustering of big spatio–temporal datasets. Futur Gener Comput Syst

  18. Hutto CJ, Gilbert E (2014) VADER: a parsimonious rule-based model for sentiment analysis of social media text. In: Eighth international AAAI conference on weblogs and social media (ICWSM-14)

  19. Khatua A, Khatua A, Cambria E (2019) A tale of two epidemics: contextual Word2vec for classifying twitter streams during outbreaks. Inf Process Manag 56:247–257

    Article  Google Scholar 

  20. Kiritchenko S, Zhu X, Mohammad SM (2014) Sentiment analysis of short informal texts. J Artif Intell Res 50:723–762

    Article  Google Scholar 

  21. Kisilevich S, Mansmann F, Nanni M, Rinzivillo S (2009) Spatio–temporal clustering. In: Data mining and knowledge discovery handbook. Springer, pp 855–874

  22. Kranjc J, Smailović J, Podpečan V, Grčar M, Znidaršič M, Lavrač N (2015) Active learning for sentiment analysis on data streams: methodology and workflow implementation in the Clowdflows platform. Inf Process Manag 51:187–203

    Article  Google Scholar 

  23. Kuncheva LI (2014) Combining pattern classifiers: methods and algorithms. Wiley

  24. Kušen E, Strembeck M (2018) Politics, sentiments, and misinformation: an analysis of the twitter discussion on the 2016 Austrian presidential elections. Online Social Networks and Media 5:37–50

    Article  Google Scholar 

  25. Li G, Liu F (2014) Sentiment analysis based on clustering: a framework in improving accuracy and recognizing neutral opinions. Appl Intell 40:441–452

    Article  Google Scholar 

  26. Liang J, Bai L, Dang C, Cao F (2012) The k-means-type algorithms versus imbalanced data distributions. IEEE Trans Fuzzy Syst 20:728–745

    Article  Google Scholar 

  27. Liu B (2012) Sentiment analysis and opinion mining. Synthesis Lectures on Human Language Technologies 5:1–167

    Article  Google Scholar 

  28. Lukeš J, Søgaard A (2018) Sentiment analysis under temporal shift. In: Proceedings of the 9th workshop on computational approaches to subjectivity, sentiment and social media analysis, pp 65–71

  29. Manning CD, Raghavan P, Schütze H et al (2008) Introduction to information retrieval, vol 1. Cambridge University press, Cambridge

    Book  Google Scholar 

  30. Medagoda N, Shanmuganathan S (2015) Keywords based temporal sentiment analysis. In: 2015 12th international conference on fuzzy systems and knowledge discovery (FSKD), pp 1418–1425. https://doi.org/10.1109/FSKD.2015.7382152

  31. Monireh E, Hossein YA, Amit S (2017) Challenges of sentiment analysis for dynamic events. IEEE Intell Syst 32:70–75

    Google Scholar 

  32. Nguyen LT, Wu P, Chan W, Peng W, Zhang Y (2012) Predicting collective sentiment dynamics from time-series social media. In: Proceedings of the first international workshop on issues of sentiment discovery and opinion mining, Beijing, China. ACM, p 6

  33. Pang B, Lee L, Vaithyanathan S (2002) Thumbs up?: sentiment classification using machine learning techniques. In: Proceedings of the 2002 conference on empirical methods in natural language processing, (EMNLP 2002), Philadelphia, PA, USA. Association for Computational Linguistics, pp 79–86

  34. Pratama M, Za’in C, Ashfahani A, Ong YS, Ding W (2019) Automatic construction of multi-layer perceptron network from streaming examples. In: Proceedings of the 28th ACM international conference on information and knowledge management. ACM, pp 1171–1180

  35. Qian Y, Zhang Y, Ma X, Yu H, Peng L (2019) Ears: emotion-aware recommender system based on hybrid information fusion. Information Fusion 46:141–146

    Article  Google Scholar 

  36. Rashkin H, Bell E, Choi Y, Volkova S (2017) Multilingual connotation frames: a case study on social Media for Targeted Sentiment Analysis and Forecast. In: Proceedings of the 55th annual meeting of the Association for Computational Linguistics (volume 2: short papers), pp 459–464

  37. Ravi K, Ravi V, Prasad PSRK (2017) Fuzzy formal concept analysis based opinion mining for CRM in financial services. Appl Soft Comput 60:786–807

    Article  Google Scholar 

  38. Salehan M, Kim DJ (2016) Predicting the performance of online consumer reviews: a sentiment mining approach to big data analytics. Decis Support Syst 81:30–40

    Article  Google Scholar 

  39. Shu K, Sliva A, Sampson J, Liu H (2018) Understanding cyber attack behaviors with sentiment information on social media. In: International conference on social computing, behavioral-cultural modeling and prediction and behavior representation in modeling and simulation. Springer, pp 377–388

  40. Si J, Mukherjee A, Liu B, Li Q, Li H, Deng X (2013) Exploiting topic based twitter sentiment for stock prediction. In: Proceedings of the 51st annual meeting of the Association for Computational Linguistics, Sofia, Bulgaria, pp 24–29

  41. Smailović J, Grčar M, Lavrač N, Znidaršič M (2014) Stream-based active learning for sentiment analysis in the financial domain. Inf Sci 285:181–203

    Article  Google Scholar 

  42. Subramani S, Wang H, Islam MR, Ulhaq A, O’Connor M (2018) Child abuse and domestic abuse: content and feature analysis from social media disclosures. In: Proceedings of databases theory and applications, 29th Australasian database conference, ADC 2018, Gold Coast, QLD, Australia. Springer, pp 174–185

  43. Vanstone BJ, Gepp A, Harris G (2019) Do news and sentiment play a role in stock Price prediction? Appl Intell:1–6

  44. Wang G, Zhang Z, Sun J, Yang S, Larson CA (2015) Pos-rs: a random subspace method for sentiment classification based on part-of-speech analysis. Inf Process Manag 51:458–479

    Article  Google Scholar 

  45. Xia R, Xu F, Yu J, Qi Y, Cambria E (2016) Polarity shift detection, elimination and ensemble: a three-stage model for document-level sentiment analysis. Inf Process Manag 52:36–45

    Article  Google Scholar 

  46. Xing S, Wang Q, Zhao X, Li T et al (2019) Content-aware point-of-interest recommendation based on convolutional neural network. Appl Intell 49:858–871

    Article  Google Scholar 

  47. Yu Y, Duan W, Cao Q (2013) The impact of social and conventional media on firm equity value: a sentiment analysis approach. Decis Support Syst 55:919–926

    Article  Google Scholar 

  48. Zhou G, Zhou Y, Guo X, Tu X, He T (2015) Cross-domain sentiment classification via topical correspondence transfer. Neurocomputing 159:298–305

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge the financial support from the Iraqi Ministry of Higher Education and Scientific Research (MoHESR).

Author information

Authors and Affiliations

  1. Department of Computer Science and Information Technology, La Trobe University, Bundoora, Victoria, 3086, Australia

    Murtadha Talib AL-Sharuee & Fei Liu

  2. School of Computer Science and Engineering, Nanyang Technological University, Singapore, Singapore

    Mahardhika Pratama

Authors
  1. Murtadha Talib AL-Sharuee
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fei Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mahardhika Pratama
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Murtadha Talib AL-Sharuee.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

AL-Sharuee, M.T., Liu, F. & Pratama, M. Sentiment analysis: dynamic and temporal clustering of product reviews. Appl Intell 51, 51–70 (2021). https://doi.org/10.1007/s10489-020-01668-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-020-01668-6

Keywords

Search

Navigation