Abstract
In this paper we take a look at the predominant form of human computer interaction as used in image retrieval, called interactive search, and discuss a new approach called artificial imagination. This approach addresses two of the grand challenges in this field as identified by the research community: reducing the amount of iterations before the user is satisfied and the small sample problem. Artificial imagination will deepen the level of interaction with the user by giving the computer the ability to think along by synthesizing (‘imagining’) example images that ideally match all or parts of the picture the user has in mind. We discuss two methods of how to synthesize new images, of which the evolutionary synthesis approach receives our main focus.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Rocchio, J.J.: Relevance Feedback in Information Retrieval. In: Salton, G. (ed.) The Smart Retrieval System: Experiments in Automatic Document Processing, Prentice-Hall, Englewood Cliffs (1971)
Cohen, I., Sebe, N., Garg, A., Lew, M.S., Huang, T.S.: Facial expression recognition from video sequences. In: ICME. Proceedings of the IEEE International Conference on Multimedia and Expo, Lausanne, Switzerland, vol. 1, pp. 641–644. IEEE Computer Society Press, Los Alamitos (2002)
Bach, J.R., Fuller, C., Gupta, A., Hampapur, A., Horowitz, B., Humphrey, R., Jain, R., Shu, C.-F: Virage Image Search Engine: An Open Framework for Image Management. In: Proceedings of the SPIE Storage and Retrieval for Still Image and Video Databases, pp. 76–87 (1996)
Chang, S.-F., Chen, W., Sundaram, H.: Semantic Visual Templates: Linking Visual Features to Semantics. In: Proceedings of the IEEE International Conference on Image Processing, pp. 531–535. IEEE Computer Society Press, Los Alamitos (1998)
Chen, Y., Zhou, X.S., Huang, T.S.: One-class SVM for Learning in Image Retrieval. In: Proceedings of IEEE International Conference on Image Processing, pp. 815–818. IEEE, Los Alamitos (2001)
Haas, M., Rijsdam, J., Thomee, B., Lew, M.S.: Relevance Feedback: Perceptual Learning and Retrieval in Bio-computing, Photos, and Video. In: Proceedings of the 6th ACM SIGMM International Workshop on Multimedia Information Retrieval, pp. 151–156 (October 2004)
He, X., Ma, W.-Y., King, O., Li, M., Zhang, H.: Learning and Inferring a Semantic Space from User’s Relevance Feedback for Image Retrieval. In: Proceedings of the ACM Multimedia, pp. 343–346. ACM Press, New York (2002)
Huiskes, M.J.: Aspect-based Relevance Learning for Image Retrieval. In: Leow, W.-K., Lew, M.S., Chua, T.-S., Ma, W.-Y., Chaisorn, L., Bakker, E.M. (eds.) CIVR 2005. LNCS, vol. 3568, pp. 639–649. Springer, Heidelberg (2005)
Lew, M.S., Sebe, N., Djeraba, C., Jain, R.: Content-based Multimedia Information Retrieval: State of the Art and Challenges. ACM Transactions on Multimedia Computing, Communications, and Applications 2(1), 1–19 (2006)
Sebe, N., Lew, M.S.: Wavelet Based Texture Classification. In: Proceedings of the International Conference on Pattern Recognition, vol. III, pp. 959–962 (2000)
Zhou, X.S., Huang, T.S.: Relevance Feedback in Image Retrieval: A Comprehensive Review. Multimedia Systems Journal 8(6), 536–544 (2003)
Böhm, C., Berchtold, S.: Searching in High-Dimensional Spaces: Index Structures for Improving the Performance of Multimedia Databases. ACM Computing Surveys 33(3), 322–373 (2001)
Yin, P.-Y., Bhanu, B., Chang, K.-C., Dong, A.: Integrating Relevance Feedback Techniques for Image Retrieval Using Reinforcement Learning. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(10), 1536–1551 (2005)
Tieu, K., Viola, P.: Boosting Image Retrieval. International Journal of Computer Vision 56(1), 17–36 (2004)
Guo, G., Zhang, H.-J., Li, S.Z.: Boosting for Content-Based Audio Classification and Retrieval: An Evaluation. In: Proceedings of the IEEE Conference on Multimedia and Expo, IEEE Computer Society Press, Los Alamitos (2001)
Muller, H., Muller, W., Marchand-Maillet, S., Pun, T., Squire, D.: Strategies for Positive and Negative Relevance Feedback in Image Retrieval. In: Proceedings of 15th International Conference on Pattern Recognition, pp. 1043–1046 (2000)
Lin, Y.-Y., Liu, T.-L., Liu, C.H.-T.: Semantic manifold learning for image retrieval. In: Proceedings of the 13th annual ACM international conference on Multimedia, pp. 249–258. ACM Press, New York (2005)
Tong, S., Chang, E.: Support Vector Machine Active Learning for Image Retrieval. In: Proceedings of the 9th ACM International Conference on Multimedia, pp. 107–118. ACM Press, New York (2001)
Manjunath, B.S., Salembier, P., Sikora, T.: Introduction to MPEG-7: Multimedia Content Description Interface. John Wiley & Sons, Chichester (2002)
Therrien, C.: Decision, Estimation, and Classification. John Wiley & Sons, Chichester (1989)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Thomee, B., Huiskes, M.J., Bakker, E.M., Lew, M. (2007). An Artificial Imagination for Interactive Search. In: Lew, M., Sebe, N., Huang, T.S., Bakker, E.M. (eds) Human–Computer Interaction. HCI 2007. Lecture Notes in Computer Science, vol 4796. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75773-3_3
Download citation
DOI: https://doi.org/10.1007/978-3-540-75773-3_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-75772-6
Online ISBN: 978-3-540-75773-3
eBook Packages: Computer ScienceComputer Science (R0)