Abstract
Session-based recommendation (SR) is important in online applications for its ability to predict user’s next interactions solely based on ongoing sessions. To recommend proper items at proper time are two key aspects in SR. The sequence of items in a session implies user’s preferences shift, which may give us clues about when the user interacted. The graph constructed based on a session can give latent structural dependencies between items, which may give us clues about which items users interacted with. They complement each other and collaborate to boost the performance of recommendation. Based on the motivation, we propose a novel sequence and graph structure co-awareness session-based recommendation model, namely SeqGo for short. In this model, a gated recurrent unit is employed to obtain sequence information and a gated graph neural network to get graph structure information. A two-stage fusion strategy is built to combine these two types of information to generate the representation of the general interest of users. The gating mechanism is used to calculate the relative importance of sequence and graph structure information. Then, multi-head masked self-attention is applied to assign different weights to different items and ignore irrelevant items. The user's general interest and the last item representing the user's current interest are combined to get the session representation to predict the probability of clicking on the next items. Experiment results on two real-world datasets show that SeqGo outperforms the state-of-the-art baselines.
Similar content being viewed by others
References
Phuong TM, Thanh TC, Bach NX (2019) Neural session-aware recommendation. IEEE Access 7:86884–86896. https://doi.org/10.1109/ACCESS.2019.2926074
Cao Y, Zhang W, Song B, Pan W, Xu C (2020) Position-aware context attention for session-based recommendation. Neurocomputing 376:65–72. https://doi.org/10.1016/j.neucom.2019.09.016
Yu R, Liu Q, Ye Y et al (2020) Collaborative list-and-pairwise filtering from implicit feedback. IEEE Trans Knowl Data Eng 99:1–1
Wang S, Cao L, Wang Y (2019) A survey on session-based recommender systems. https://arxiv.org/abs/1902.04864. Accessed 13 Feb 2019
Guo Y, Zhang D, Ling Y, Chen H (2020) A Joint neural network for session-aware recommendation. IEEE Access 8:74205–74215. https://doi.org/10.1109/ACCESS.2020.2984287
Peng B, Ren Z, Parthasarathy S, Ning X (2021) HAM: hybrid associations models for sequential recommendation. IEEE Trans Knowl Data Eng. https://doi.org/10.1109/TKDE.2021.3049692
Wu S, Tang Y, Zhu Y, et al. (2019) Session-based recommendation with graph neural networks. In: AAAI '19: Proceedings of the 33th AAAI Conference on Artificial Intelligence. https://doi.org/10.1609/aaai.v33i01.3301346
Xu C, Zhao P, Liu Y, et al. (2019) Graph contextualized self-attention network for session-based recommendation. In: IJCAI '19: Proceedings of the 28th International Joint Conference on Artificial Intelligence 3940–3946. https://doi.org/10.24963/ijcai.2019/547
Hidasi B, Karatzoglou A, Baltrunas L, Tikk D (2015) Session-based recommendations with recurrent neural networks. https://arxiv.org/abs/1511.06939. Accessed 21 Nov 2015
Tan YK, Xu X, Liu Y (2016) Improved recurrent neural networks for session-based recommendations. In: DLRS '19: Proceedings of the 1st Workshop on Deep Learning for Recommender Systems 17–22. https://doi.org/10.1145/2988450.2988452
Davidson J, Liebald B, Liu J, et al. (2010) The YouTube video recommendation system. In: RecSys '10: Proceedings of the 4th ACM Conference on Recommender Systems 293–296. https://doi.org/10.1145/1864708.1864770
Jannach D, Ludewig M (2017) When recurrent neural networks meet the neighborhood for session-based recommendation. In: RecSys '17: Proceedings of the 11th ACM Conference on Recommender Systems 306–310. https://doi.org/https://doi.org/10.1145/3109859.3109872
Hidasi B, Karatzoglou A (2018) Recurrent neural networks with top-k gains for session-based recommendations. In: CIKM '18: Proceedings of the 27th ACM International Conference on Information and Knowledge Management 843–852. https://doi.org/10.1145/3269206.3271761
Li J, Ren P, Chen Z, et al. (2017) Neural attentive session-based recommendation. In: CIKM '17: Proceedings of the 26th ACM International Conference on Information and Knowledge Management 1419–1428. https://doi.org/10.1145/3132847.3132926
Liu Q, Zeng Y, Mokhosi R, Zhang H (2018) STAMP: short-term attention/memory priority model for session-based recommendation. In: KDD '18: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 1831–1839. https://doi.org/10.1145/3219819.3219950
Hidasi B, Quadrana M, Karatzoglou A, Tikk D (2016) Parallel recurrent neural network architectures for feature-rich session-based recommendations. In: RecSys '16: Proceedings of the 10th ACM conference on Recommender systems 241–248. https://doi.org/10.1145/2959100.2959167
Bogina V, Kuflik T (2017) incorporating dwell time in session-based recommendations with recurrent neural networks. In: RecSys '17: Proceedings of the Poster Track of the 11th ACM Conference on Recommender Systems 1922:57–59. http://ceur-ws.org/Vol-1922/paper11.pdf
Quadrana M, Karatzoglou A, Hidasi B, Cremonesi P (2017) Personalizing session-based recommendations with hierarchical recurrent neural networks. In: RecSys '17: Proceedings of the 11th ACM Conference on Recommender Systems 130–137. https://doi.org/10.1145/3109859.3109896
Li Z, Zhao H, Liu Q, et al. (2018) Learning from history and present: next-item recommendation via discriminatively exploiting user behaviors. In: KDD '18: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 1734–1743. https://doi.org/10.1145/3219819.3220014
Gori M, Monfardini G, Scarselli F (2005) A new model for learning in graph domains. In: IJCNN '05: Proceedings of the 2005 IEEE International Joint Conference on Neural Networks 729–734. https://doi.org/10.1109/IJCNN.2005.1555942
Scarselli F, Gori M, Tsoi AC et al (2009) The graph neural network model. IEEE Trans Neural Netw 20:61–80. https://doi.org/10.1109/TNN.2008.2005605
Li Y, Tarlow D, Brockschmidt M, Zemel R (2016) Gated graph sequence neural networks. In: ICLR '16: Proceedings of the 4th International Conference on Learning Representations.
Koren Y (2008) Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: KDD '08: Proceedings of the 14th ACM SIGKDD conference on Knowledge discovery and data mining 426–434. https://doi.org/10.1145/1401890.1401944
Rendle S, Freudenthaler C, Gantner Z, Schmidt-Thieme L (2009) BPR: bayesian personalized ranking from implicit feedback. In: UAI '09: Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence 452–461.
Sarwar B, Karypis G, Konstan J, Riedl J (2001) Item-based collaborative filtering recommendation algorithms. In: WWW '01: Proceedings of the 10th international conference on World Wide Web 285–295. https://doi.org/10.1145/371920.372071
Linden G, Smith B, York J (2008) Amazon.com recommendations: item-to-item collaborative filtering. IEEE Internet Comput 7:76–80. https://doi.org/10.1109/MIC.2003.1167344
He Q, Jiang D, Liao Z, et al. (2009) Web query recommendation via sequential query prediction. In: ICDE '09: Proceedings of the 2009 IEEE International Conference on Data Engineering. https://doi.org/10.1109/ICDE.2009.71
Rendle S, Freudenthaler C, Schmidt-Thieme L (2010) Factorizing personalized Markov chains for next-basket recommendation. In: WWW '10: Proceedings of the 19th international conference on World wide web 811–820. https://doi.org/10.1145/1772690.1772773
Aghdam MH, Hariri N, Mobasher B, Burke R (2015) Adapting recommendations to contextual changes using hierarchical hidden markov models. In: RecSys '15: Proceedings of the 9th ACM Conference on Recommender Systems 241–244. https://doi.org/10.1145/2792838.2799684
He R, McAuley J (2016) Fusing similarity models with markov chains for sparse sequential recommendation. In: ICDM '16: Proceedings of the 2016 IEEE International Conference on Data Mining. https://doi.org/10.1109/ICDM.2016.0030
Wang S, Cao L, Wang Y, et al. (2019) Modeling multi-purpose sessions for next-item recommendations via mixture-channel purpose routing networks. In: IJCAI '19: Proceedings of the 28th International Joint Conference on Artificial Intelligence. https://www.ijcai.org/Proceedings/2019/523
Wang S, Cao L, Hu L, et al. (2018) Attention-based transactional context embedding for next-item recommendation. In: AAAI '18: Proceedings of the 32th AAAI Conference on Artificial Intelligence. https://doi.org/10.1609/aaai.v33i01.3301346
Zhou J, Cui G, Zhang Z et al (2020) Graph neural networks: a review of methods and applications. AI Open 1:57–81. https://doi.org/10.1016/j.aiopen.2021.01.001
Liu L, Wang L, Lian T (2021) CaSe4SR: using category sequence graph to augment session-based recommendation. Knowl Based Syst 212. https://linkinghub.elsevier.com/retrieve/pii/S0950705120306870
Donkers T, Loepp B, Ziegler J (2017) Sequential user-based recurrent neural network recommendations. In: RecSys '17: Proceedings of the 11th ACM Conference on Recommender Systems 152–160. https://doi.org/10.1145/3109859.3109877
Wang M, Ren P, Mei L, et al. (2019) A collaborative session-based recommendation approach with parallel memory modules. In: SIGIR'19: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval 345–354. https://doi.org/10.1145/3331184.3331210
Vaswani A, Shazeer N, Parmar N, et al. (2017) Attention is all you need. In: NIPS '17: Proceedings of the 31st Annual Conference on Neural Information Processing Systems 5999–6009.
Kang W, McAuley J (2018) Self-attentive sequential recommendation. In: ICDM '18: Proceedings of the IEEE 18th International Conference on Data Mining. https://doi.org/10.1109/ICDM.2018.00035
Li J, Wang Y, McAuley J (2018) Time interval aware self-attention for sequential recommendation. In: WSDM '20: Proceedings of the 13th International Conference on Web Search and Data Mining 322–330. https://doi.org/10.1145/3336191.3371786
Sun F, Liu J, Wu J, et al. (2019) BERT4Rec: sequential recommendation with bidirectional encoder representations from transformer. In: CIKM '19: Proceedings of the 28th ACM International Conference on Information and Knowledge Management 1441–1450. https://doi.org/10.1145/3357384.3357895
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: CVPR '16: Proceedings of the 29th IEEE Conference on Computer Vision and Pattern Recognition. https://doi.org/10.1109/CVPR.2016.90
Srivastava N, Hinton G, Krizhevsky A et al (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15:1929–1958
Ludewig M, Mauro N, Latifi S, Jannach D (2021) Empirical analysis of session-based recommendation algorithms. User Model User-Adap Inter 31:149–181. https://doi.org/10.1007/s11257-020-09277-1
Acknowledgements
This work was supported by National Natural Science Foundation of China under Grant No. 61872260.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Qiao, J., Wang, L. & Duan, L. Sequence and graph structure co-awareness via gating mechanism and self-attention for session-based recommendation. Int. J. Mach. Learn. & Cyber. 12, 2591–2605 (2021). https://doi.org/10.1007/s13042-021-01343-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13042-021-01343-3