Abstract
Collaborative prediction refers to the task of predicting user preferences on the basis of ratings by other users. Collaborative prediction suffers from the cold start problem where predictions of ratings for new items or predictions of new users’ preferences are required. Various methods have been developed to overcome this limitation, exploiting side information such as content information and demographic user data. In this paper we present a matrix factorization method for incorporating side information into collaborative prediction. We develop Weighted Nonnegative Matrix Co-Tri-Factorization (WNMCTF) where we jointly minimize weighted residuals, each of which involves a nonnegative 3-factor decomposition of target or side information matrix. Numerical experiments on MovieLens data confirm the useful behavior of WNMCTF when operating from a cold start.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Lee, D.D., Seung, H.S.: Learning the parts of objects by non-negative matrix factorization. Nature 401, 788–791 (1999)
Lee, D.D., Seung, H.S.: Algorithms for non-negative matrix factorization. In: Advances in Neural Information Processing Systems (NIPS). vol. 13. MIT Press, Cambridge (2001)
Ding, C., Li, T., Peng, W., Park, H.: Orthogonal nonnegative matrix tri-factorizations for clustering. In: Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), Philadelphia, PA (2006)
Choi, S.: Algorithms for orthogonal nonnegative matrix factorization. In: Proceedings of the International Joint Conference on Neural Networks (IJCNN), Hong Kong (2008)
Yoo, J., Choi, S.: Orthogonal nonnegative matrix factorization: Multiplicative updates on Stiefel manifolds. In: Fyfe, C., Kim, D., Lee, S.-Y., Yin, H. (eds.) IDEAL 2008. LNCS, vol. 5326, pp. 140–147. Springer, Heidelberg (2008)
Cichocki, A., Lee, H., Kim, Y.D., Choi, S.: Nonnegative matrix factorization with α-divergence. Pattern Recognition Letters 29(9), 1433–1440 (2008)
Dhillon, I.S., Sra, S.: Generalized nonnegative matrix approximations with Bregman divergences. In: Advances in Neural Information Processing Systems (NIPS), vol. 18. MIT Press, Cambridge (2006)
Kompass, R.: A generalized divergence measure for nonnegative matrix factorization. Neural Computation 19, 780–791 (2007)
Yoo, J., Choi, S.: Probabilistic matrix tri-factorization. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Taipei, Taiwan (2009)
Kim, Y.D., Choi, S.: Nonnegative Tucker decomposition. In: Proceedings of the IEEE CVPR 2007 Workshop on Component Analysis Methods, Minneapolis, Minnesota (2007)
Kim, Y.D., Cichocki, A., Choi, S.: Nonnegative Tucker decomposition with alpha-divergence. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Las Vegas, Nevada (2008)
Srebro, N., Jaakkola, T.: Weighted low-rank approximation. In: Proceedings of the International Conference on Machine Learning (ICML), Washington DC (2003)
Rennie, J.D.M., Srebro, N.: Fast maximum margin matrix factorization for collaborative prediction. In: Proceedings of the International Conference on Machine Learning (ICML), Bonn, Germany (2005)
Zhang, S., Wang, W., Ford, J., Makedon, F.: Learning from incomplete ratings using non-negative matrix factorization. In: Proceedings of the SIAM International Conference on Data Mining, SDM (2006)
Mao, Y., Saul, L.K.: Modeling distances in large-scale networks by matrix factorization. In: Proceedings of the ACM Internet Measurement Conference, Taormina, Sicily, Italy (2004)
Kim, Y.D., Choi, S.: Weighted nonnegative matrix factorization. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Taipei, Taiwan (2009)
Melville, P., Mooney, R.J., Nagarajan, R.: Content-boosted collaborative filtering for improved recommendations. In: Proceedings of the AAAI National Conference on Artificial Intelligence (AAAI), Edmonton, Canada, pp. 187–192 (2002)
Popescul, A., Ungar, L.H., Pennock, D.M., Lawrence, S.: Probabilistic models for unified collaborative and content-based recommendation in sparse-data environment. In: Proceedings of the International Conference on Uncertainty in Artificial Intelligence, UAI (2001)
Schein, A.I., Popescul, A., Pennock, D.M.: Generative models for cold-start recommendations. In: Proceedings of the SIGIR Workshop on Recommender Systems, New Orleans, LA (2001)
Basilico, J., Hofmann, T.: Unifying collaborative and content-based filtering. In: Proceedings of the International Conference on Machine Learning (ICML), Banff, Canada, pp. 65–72 (2004)
Park, S.T., Pennock, D., Madani, O., Good, N., DeCoste, D.: NaĂŻve filterbots for robust cold-start recommendations. In: Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), Philadelphia, PA (2006)
Agarwal, D., Merugu, S.: Predictive discrete latent factor models for large scale dyadic data. In: Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), San Jose, California, USA (2007)
Yu, K., Yu, S., Tresp, V.: Multi-label informed latent semantic indexing. In: Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), Salvador, Brazil (2005)
Zhu, S., Yu, K., Chi, Y., Gong, Y.: Combining content and link for classification using matrix factorization. In: Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), Amsterdam, The Netherlands (2007)
Lee, H., Choi, S.: Group nonnegative matrix factorization for EEG classification. In: Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS), Clearwater Beach, Florida (2009)
Singh, A.P., Gordon, G.J.: Relational learning via collective matrix factorization. In: Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), Las Vegas, Nevada (2008)
Long, B., Zhang, Z., Yu, P.S.: Co-clustering by block value decomposition. In: Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), Chicago, IL (2005)
Li, T., Ding, C.: The relationships among various nonnegative matrix factorization methods for clustering. In: Proceedings of the IEEE International Conference on Data Mining (ICDM), Hong Kong (2006)
Chen, G., Wang, F., Zhang, C.: Collaborative filtering using orthogonal nonnegative tri-factorization. In: Proceedings of the IEEE International Conference on Data Mining (ICDM), Omaha, NE (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yoo, J., Choi, S. (2009). Weighted Nonnegative Matrix Co-Tri-Factorization for Collaborative Prediction. In: Zhou, ZH., Washio, T. (eds) Advances in Machine Learning. ACML 2009. Lecture Notes in Computer Science(), vol 5828. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-05224-8_30
Download citation
DOI: https://doi.org/10.1007/978-3-642-05224-8_30
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-05223-1
Online ISBN: 978-3-642-05224-8
eBook Packages: Computer ScienceComputer Science (R0)