Skip to main content
SpringerLink
Log in

Cross-Cultural Multimedia Computing with Impression-Based Semantic Spaces

  • Chapter
Conceptual Modelling and Its Theoretical Foundations

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7260))

Abstract

Over the past decade, the rapid progress of multimedia data management technology has realized the large scale of media data transfer and resource-accumulation in the world. The multimedia computing technology has also been creating new information provision environments in the world-wide scope. Innovative integrations of large scale multimedia data management and computing technology will lead to a new information society.

In the design of multimedia systems, one of the most important issues is how to search and analyze media data (images, music, movies and documents), according to impressions and contexts. We have proposed and introduced a "Kansei" and semantic associative search method based on our “Mathematical Model of Meaning (MMM) [11], [13], [14]”. The concept of "Kansei" includes several meanings on sensitive recognition, such as "impression", "human senses", "feelings", "sensitivity", "psychological reaction" and "physiological reaction". This model realizes "Kansei" processing and semantic associative search for media data, according to user’s impressions and contexts. This model is applied to compute semantic correlations between keywords, images, music and documents dynamically in a context-dependent way.

The main feature of this model is to realize semantic associative search in the 2000 dimensional orthogonal semantic space with semantic projection functions. This space is created for dynamically computing semantic equivalence or similarity between keywords and media data.

We have constructed "Cross-Cultural Multimedia Computing Systems” for sharing and analyzing different cultures with semantic associative functions applied to “cultural & multimedia data,” as a new platform of cross-cultural collaborative environments. This environment enables to create a remote, interactive and real-time cultural and academic research exchange among different countries and cultures.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Brown, N.: Evolutionary models of music: From sexual selection to group to group selection. In: Perspectives in Ethology, pp. 231–281. Plenum Publishers, New York (2000)

    Chapter  Google Scholar 

  2. Cross, I.: Music, cognition, culture and evolution. Annals of the New York Academy of Sciences 930, 28–42 (2001)

    Article  Google Scholar 

  3. Goethe, W.J.: Theory of Colours, Trans. Charles Lock Eastlake, Cambridge. The M.I.T. Press, Massachusetts (1982)

    Google Scholar 

  4. Harada, A. (ed.): Report of modeling the evaluation structure of KANSEI. Univ. of Tsukuba (1997)

    Google Scholar 

  5. Hevner, K.: Expression in Music: A Discussion of Experimental Studies and Theories. Psychological Review 42, 186–204 (1935)

    Article  Google Scholar 

  6. Hevner, K.: Experimental Studies of the Elements of Expression in Music. American Journal of Psychology 48, 246–268 (1936)

    Article  Google Scholar 

  7. Hofstede, G.H., Hofstede, G.J.: Cultures and Organizations: Software of the Mind. McGraw-Hill Professional (2005)

    Google Scholar 

  8. Ijichi, A., Kiyoki, Y.: A Kansei Metadata Generation Method for Music Data Dealing with Dramatic Interpretation. In: Information Modelling and Knowledge Bases, vol. XVI, pp. 170–182. IOS Press (May 2005)

    Google Scholar 

  9. Imai, S., Kurabayashi, S., Kiyoki, Y.: A Music Retrieval System Supporting Intuitive Visualization by the Color Sense of Tonality. In: Proceedings of the 24th IASTED International Multi-Conference Databases and Applications (DBA 2006), pp. 153–159 (Feburary 2006)

    Google Scholar 

  10. Kitagawa, T., Kiyoki, Y.: Fundamental Framework for Media Data Retrieval Systems using Media-lexico Transformation Operator in the case of musical MIDI data. In: Information Modeling and Knowledge Bases, vol. XII. IOS Press (2001)

    Google Scholar 

  11. Kiyoki, Y., Kitagawa, T., Hayama, T.: A Metadatabase System for Semantic Image Search by a Mathematical Model of Meaning. ACM SIGMOD Record 23(4), 34–41 (1994)

    Article  Google Scholar 

  12. Kiyoki, Y., Kitagawa, T.: A Semantic Sssociative Search Method for Knowledge Acquisition. In: Information Modelling and Knowledge Bases, vol. VI, pp. 121–130. IOS Press (1995)

    Google Scholar 

  13. Kiyoki, Y., Kitagawa, T., Hitomi, Y.: A Fundamental Framework for Realizing Semantic Interoperability in a Multidatabase Environment. International Journal of Integrated Computer-Aided Engineering (Special Issue on Multidatabase and Interoperable Systems) 2(1), 3–20 (1995)

    Google Scholar 

  14. Kiyoki, Y., Kitagawa, T., Hayama, T.: A Metadatabase System for Semantic Image Search by a Mathematical Model of Meaning. In: Sheth, A., Klas, W. (eds.) Multimedia Data Management – using Metadata to Integrate and Apply Digital Media, ch. 7, McGrawHill (March 1998)

    Google Scholar 

  15. Kiyoki, Y.: A Semantic Associative Search Method for WWW Information Resources. In: Proceedings of 1st International Conference on Web Information Systems Engineering (2000) (invited paper)

    Google Scholar 

  16. Kiyoki, Y., Ishihara, S.: A Semantic Search Space Integration Method for Meta-level Knowledge Acquisition from Heterogeneous Databases. In: Information Modelling and Knowledge Bases, vol. XIV, pp. 86–103. IOS Press (May 2002)

    Google Scholar 

  17. Kiyoki, Y., Chen, X.: A Semantic Associative Computation Method for Automatic Decorative Multimedia Creation with ”Kansei” Information. In: The Sixth Asia-Pacific Conference on Conceptual Modelling (APCCM 2009), 9 pages (January 2009) (invited paper)

    Google Scholar 

  18. Kobayashi, S.: Color Image Scale (The Nippon Color & Design Research Institute ed., translated by Louella Matsunaga, Kodansha International, 1992)

    Google Scholar 

  19. Le, M.H.: The role of Music in Second Language Learning: A Vietnamese Perspective. For Presentation at Combined 1999 Conference of the Australian Association for Research in Education and the New Zealand Association for Research in Education (1999)

    Google Scholar 

  20. Nguyen, T.N.D., Sasaki, S., Kiyoki, Y.: 5D World PicMap: Imagination-based Image Search System with Spatiotemporal Analyzers. In: Proceedings of IADIS e-Society 2011 Conference, Avila, Spain, 8 pages (March 2011)

    Google Scholar 

  21. Sasaki, S., Takahashi, Y, Y., Kiyoki, Y.: The 4D World Map System with Semantic and Spatiotemporal Analyzers. In: Information Modelling and Knowledge Bases, vol. XXI, 18 pages. IOS Press (2010)

    Google Scholar 

  22. Sheth, A., Klas, W. (eds.): Multimedia Data Management - Using Metadata to Integrate and Apply Digital Media. MacGraw-Hill (March 1998)

    Google Scholar 

  23. Thalheim, B.: Entity-relationship modeling – Foundations of database technology. Springer, Berlin (2000)

    Book  MATH  Google Scholar 

  24. Thalheim, B.: Application Development Based on Database Components. In: Information Modelling and Knowledge Bases, vol. 16, pp. 28–45. IOS Press (2004)

    Google Scholar 

  25. Trang, N.N., Sasaki, S., Kiyoki, Y.: A Cross-Cultual Music Museum System With Impression-Based Analyzing Functions. In: Proceedings of IADIS e-Society 2011 Conference, Avila, Spain, 8 pages (March 2011)

    Google Scholar 

  26. Dissanayake, E.: Antecedents of the temporal arts in early mother-infant interaction. In: The Origins of Music, pp. 389–410. MIT Press, Cambridge (2000)

    Google Scholar 

  27. King, W.R.: A Research Agenda for the Relationships between Culture and Knowledge Management. Knowledge and Process Management 14, 226–236 (2007)

    Article  Google Scholar 

  28. Tosa, N., Matsuoka, S., Thomas, H.: Cultural Computing: SENetic Computer. In: ACM SIGGRAPH 2004 Emerging Technologies, Los Angeles, California, p. 11 (2004)

    Google Scholar 

  29. Rauterberg, M.: From Personal to Cultural Computing: how to assess a cultural experience. In: uDayIV - Information Butzbar Machen, Pasbst Sience Publ. (2006)

    Google Scholar 

  30. Nakatsu, R., Rauterberg, M., Salem, B.: Forms and theories of communication: from multimedia to Kansei Mediation. Multimedia Systems 11, 304–312 (2006)

    Article  Google Scholar 

  31. Heimbürger, A., Sasaki, S., Yoshida, N., Venäläinen, T., Linna, P., Welzer, T.: Cross-Cultural Collaborative Systems: Towards Cultural Computing. In: Information Modelling and Knowledge Bases, vol. XXI, pp. 403–417 (May 2010)

    Google Scholar 

  32. Nguyen, N., Sasaki, S., Uraki, A., Kiyoki, Y.: A Semantic Metadata Extraction for Cross-cultural Music Environments by using Culture-based Music Samples and Filtering Functions. In: Proceedings of International Conference on Computer, Electrical, and Systems Science, and Engineering (ICCESSE 2010), May 26-28 (2010)

    Google Scholar 

  33. Holsti, O., North, R.: Comparative Data from Content Analysis: Perception of History and Economic Variables in the 1914 Crisis. In: Merritt, R.L., Rokkan, S. (eds.) Comparing Nations: The Use of Quantitative Data in Cross-National Research, pp. 169–190 (1966)

    Google Scholar 

  34. Zinnes, D.: A comparison of Hostile Behavior of Decision-Makers in Simulated historical Data. World Politics 18, 474–502 (1966)

    Article  Google Scholar 

  35. Batini, C., et al.: A Comparative analysis of methodologies for database schema integration. ACM Computing Surveys 18(4), 324–364 (1986)

    Article  Google Scholar 

  36. Egenhofer, M.J., et al.: Metric Details for Natural-Language Spatial Relations. ACM Trans. Information Systems 16(4), 295–321 (1998)

    Article  Google Scholar 

  37. Egenhofer, M.J.: Spatial SQL: A Query and Presentation Language. IEEE Transactions on Knowledge and Data Engineering 6(1), 86–95 (1994)

    Article  Google Scholar 

  38. Guting, R.H.: An Introduction to Spatial Database Systems. VLDB Journal 3, 357–399 (1994)

    Article  Google Scholar 

  39. Litwin, W.: An overview of the multidatabase system MRDSM. In: Proceedings of the 1985 ACM Annual Conference on The Range of Computing, pp. 524–533 (1985)

    Google Scholar 

  40. Litwin, W., et al.: Interoperability of multiple autonomous databases. ACM Computing Surveys (CSUR) 22(3), 267–293 (1990)

    Article  Google Scholar 

  41. Yoshida, N., Kiyoki, Y.: An associative search method based on symbolic filtering and semantic ordering. In: Proceedings of the 7th IFIP 2.6 Working Conference on Database Semantics, pp. 215–237 (1997)

    Google Scholar 

  42. Hosokawa, Y., Kiyoki, Y.: Functional and parallel query processing and query optimization for multidatabase systems. In: Proc. the 17 th IASTED International Conference on Applied Informatics, pp. 101–106 (1999)

    Google Scholar 

  43. Ishibashi, N., Kiyoki, Y.: Meta-Chronicle: A Spatial and Temporal Multidatabase System and its Application to Histories. In: Proceedings of IEEE International Symposium on Applications and the Internet (SAINT 2004) - the International Workshop on Cyberspace Technologies and Societies (IWCTS 2004), pp. 515–522 (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Graduate School of Media and Governance, Keio University, SFC, 5322 Endo, Fujisawa, Kanagawa, 252-0816, Japan

    Yasushi Kiyoki, Shiori Sasaki, Nhung Nguyen Trang & Nguyen Thi Ngoc Diep

Authors
  1. Yasushi Kiyoki
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shiori Sasaki
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nhung Nguyen Trang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nguyen Thi Ngoc Diep
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Antje Düsterhöft Meike Klettke Klaus-Dieter Schewe

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Kiyoki, Y., Sasaki, S., Trang, N.N., Diep, N.T.N. (2012). Cross-Cultural Multimedia Computing with Impression-Based Semantic Spaces. In: Düsterhöft, A., Klettke, M., Schewe, KD. (eds) Conceptual Modelling and Its Theoretical Foundations. Lecture Notes in Computer Science, vol 7260. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-28279-9_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-28279-9_21

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-28278-2

  • Online ISBN: 978-3-642-28279-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation