Abstract
As important information provided by recommender systems, knowledge graphs are widely applied in computer science and many other fields. The recommender system performance can be significantly improved by leveraging the knowledge graph between the user and item. Various recommendation approaches have been proposed based on the knowledge graph in recent years; however, most of the existing models only apply item-level user representations or attention mechanisms to users and items in the same way and ignore the fact that user and item attributes are significantly different. Hence, these models are not an effectively exploited attribute information and circumscribe the further improvement of recommender performance. In this paper, a novel approach of dynamic co-attention with an attribute regularizer (DCAR) for a knowledge-aware recommender system is proposed to explore the latent connections between the user level and item level. The model dynamically adjusts the dynamic co-attention mechanism through the attribute similarity between the target user and the candidate item. Specifically, an attribute regularizer between user and item is designed to improve the quality of attribute embedding. Experimental results on two realistic datasets show that our proposed model can significantly improve recommender system effectiveness and represents an advancement beyond the compared deep models.
Similar content being viewed by others
References
Sarwar BM, Karypis G, Konstan JA, Riedl J (2001) Item-based collaborative filtering recommendation algorithms. In: Proceedings of the tenth international world wide web conference, pp 285–295
Wen P, Yuan W, Qin Q, Sang S, Zhang Z (2020) Neural attention model for recommendation based on factorization machines. Applied Intelligence 51:1829–1844
Wang H, Zhang F, Wang J, Zhao M, Li W, Xie X, Guo M (2018) Ripplenet: Propagating user preferences on the knowledge graph for recommender systems. In: Proceedings of the 27th ACM international conference on information and knowledge management, pp 417–426
Yang D, Song Z, Xue L, Xiao Y (2020) A knowledge-enhanced recommendation model with attribute-level co-attention. In: Proceedings of the 43rd International ACM SIGIR conference on research and development in information retrieval, pp 1909–1912
Zhang T, Zhao P, Liu Y, S Sheng V, Xu J, Wang D, Liu G, Zhou X (2019) Feature-level deeper self-attention network for sequential recommendation. In: Proceedings of the twenty-eighth international joint conference on artificial intelligence, pp 4320–4326
Bordes A, Usunier N, García-Durán A, Weston J, Yakhnenko O (2013) Translating embeddings for modeling multi-relational data. In: 27th Annual conference on neural information processing systems, pp 2787–2795
Wang Z, Zhang J, Feng J, Chen Z (2014) Knowledge graph embedding by translating on hyperplanes. In: Proceedings of the twenty-eighth AAAI conference on artificial intelligence, pp 1112–1119
Xiao H, Huang M, Hao Y, Zhu X (2015) Transa: An adaptive approach for knowledge graph embedding. arXiv:1509.05490
Ji G, He S, Xu L, Liu K, Zhao J (2015) Knowledge graph embedding via dynamic mapping matrix. In: Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing of the asian federation of natural language processing, pp 687–696
Lin Y, Liu Z, Sun M, Liu Y, Zhu X (2015) Learning entity and relation embeddings for knowledge graph completion. In: Proceedings of the twenty-ninth AAAI conference on artificial intelligence, pp 2181–2187
Nickel M, Tresp V, Kriegel H (2011) A three-way model for collective learning on multi-relational data. In: Proceedings of the 28th international conference on machine learning, pp 809–816
Yang B, Yih W, He X, Gao J, Deng L (2015) Embedding entities and relations for learning and inference in knowledge bases. In: 3rd international conference on learning representations
Liu Q, Jiang H, Ling Z, Wei S, Hu Y (2016) Probabilistic reasoning via deep learning: Neural association models. arXiv:1603.07704
Bahdanau D, Cho K, Bengio Y (2015) Neural machine translation by jointly learning to align and translate. In: 3rd International conference on learning representations
Yan C, Chen Y, Wan Y, Wang P (2020) Modeling low- and high-order feature interactions with fm and self-attention network
Cheng Z, Ding Y, He X, Zhu L, Song X, Kankanhalli MS (2018) A3̂ncf: An adaptive aspect attention model for rating prediction. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence, pp 3748–3754
Chin JY, Zhao K, Joty SR, Cong G (2018) ANR: aspect-based neural recommender. In: Proceedings of the 27th ACM International conference on information and knowledge management, pp 147–156
Gao X, Feng F, He X, Huang H, Guan X, Feng C, Ming Z, Chua T (2020) Hierarchical attention network for visually-aware food recommendation. IEEE Trans Multimed 22:1647–1659
Tay Y, Luu AT, Hui SC (2018) Multi-pointer co-attention networks for recommendation. In: Proceedings of the 24th ACM SIGKDD International conference on knowledge discovery & data mining, pp 2309–2318
Zhang S, Tay Y, Yao L, Sun A (2018) Next item recommendation with self-attention. arXiv:1808.06414
Ying H, Zhuang F, Zhang F, Liu Y, Xu G, Xie X, Xiong H, Wu J (2018) Sequential recommender system based on hierarchical attention networks. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence, pp 3926–3932
Zhang C, Li T, Ren Z, Hu Z, Ji Y (2019) Taxonomy-aware collaborative denoising autoencoder for personalized recommendation. Appl Intell 49:2101–2118
Lee J, Abu-El-Haija S, Varadarajan B, Natsev A (2018) Collaborative deep metric learning for video understanding. In: Proceedings of the 24th ACM SIGKDD International conference on knowledge discovery & data mining, pp 481–490
Wang H, Zhang F, Zhao M, Li W, Xie X, Guo M (2019) Multi-task feature learning for knowledge graph enhanced recommendation. In: The world wide web conference, pp 2000–2010
Wang H, Leskovec J, Zhang F, Zhao M, Li W, Zhang M, Wang Z (2019) Knowledge-aware graph neural networks with label smoothness regularization for recommender systems. In: Proceedings of the ACM SIGKDD international conference on knowledge discovery and data mining, pp 968–977
Wang Z, Lin G, Tan H, Chen Q, Liu X (2020) CKAN: collaborative knowledge-aware attentive network for recommender systems. In: Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, pp 219–228
Wang X, Huang T, Wang D, Yuan Y, Liu Z, He X, Chua T (2021) Learning intents behind interactions with knowledge graph for recommendation. arXiv:2102.07057
Zhou G, Zhu X, Song C, Fan Y, Zhu H, Ma X, Yan Y, Jin J, Li H, Gai K (2018) Deep interest network for click-through rate prediction. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, pp 1059–1068
Yang C, Sun M, Yi X, Li W (2018) Stylistic chinese poetry generation via unsupervised style disentanglement. In: Proceedings of the 2018 conference on empirical methods in natural language processing, pp 3960–3969
Hu L, Xu S, Li C, Yang C, Shi C, Duan N, Xie X, Zhou M (2020) Graph neural news recommendation with unsupervised preference disentanglement. In: Proceedings of the 58th annual meeting of the association for computational linguistics, pp 4255–4264
He X, He Z, Song J, Liu Z, Jiang YG, Chua T (2018) NAIS: Neural attentive item similarity model for recommendation. IEEE Trans Knowl Data Eng 30:2354–2366
He X, Liao L, Zhang H, Nie L, Hu X, Chua T (2017) Neural collaborative filtering. In: Proceedings of the 26th international conference on world wide web, pp 173–182
Kingma DP, Ba J (2015) Adam: A method for stochastic optimization. In: 3rd international conference on learning representations
Xu B, Xu Y, Liang J, Xie C, Liang B, Cui W, Xiao Y (2017) Cn-dbpedia: A never-ending chinese knowledge extraction system. In: Advances in artificial intelligence: from theory to practice - 30th international conference on industrial engineering and other applications of applied intelligent systems, vol 10351, pp 428–438
Xiao J, Ye H, He X, Zhang H, Wu F, Chua T (2017) Attentional factorization machines: Learning the weight of feature interactions via attention networks. In: Proceedings of the twenty-sixth international joint conference on artificial intelligence, pp 3119–3125
Acknowledgements
This work is supported by the National Natural Science Foundation of China under Grants No. 61472096, No. 61272186, No. 61472095, No. 61502410, the Fundamental Research Funds for the Central Universities(No. 3072021CF0609).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Fully documented templates are available in the elsarticle package on http://www.ctan.org/tex-archive/macros/latex/contrib/elsarticle.
Rights and permissions
About this article
Cite this article
Yin, G., Chen, F., Dong, Y. et al. Knowledge-aware recommendation model with dynamic co-attention and attribute regularize. Appl Intell 52, 3807–3824 (2022). https://doi.org/10.1007/s10489-021-02598-7
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-021-02598-7