Abstract
This paper describes our attempt to build a communicative medium for capturing and re-experiencing conversations situated in the real space. We first show a system that captures and interprets conversation scenes by ubiquitous sensors. Based on the system, we present three approaches to visualise and facilitate users to access the extracted conversation scenes, i.e., chronological summarisation of videos, spatio-temporal collage of videos, and ambient sound display.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Nishida, T.: Towards intelligent media technology for communicative intelligence. In: Bolc, L., Michalewicz, Z., Nishida, T. (eds.) IMTCI 2004. LNCS (LNAI), vol. 3490, pp. 1–7. Springer, Heidelberg (2005)
Sumi, Y., Ito, S., Matsuguchi, T., Mase, K.: Collaborative capturing and interpretation of interactions. In: Pervasive 2004 Workshop on Memory and Sharing of Experiences, April 2004, pp. 1–7 (2004), http://www.ii.ist.i.kyoto-u.ac.jp/~sumi/pervasive04
Stiefelhagen, R., Yang, J., Waibel, A.: Modeling focus of attention for meeting indexing. In: ACM Multimedia 1999, pp. 3–10. ACM, New York (1999)
Müller, C., Sumi, Y., Mase, K., Tsuchikawa, M.: Experience sharing by retrieving captured conversations using non-verbal features. In: The First ACM Workshop on Continuous Archival and Retrieval of Personal Experiences (CARPE 2004), pp. 93–98 (2004)
Pentland, A.: Smart rooms. Scientific American 274(4), 68–76 (1996)
Brooks, R.A., Coen, M., Dang, D., De Bonet, J., Kramer, J., Lozano-Pérez, T., Mellor, J., Pook, P., Stauffer, C., Stein, L., Torrance, M., Wessler, M.: The intelligent room project. In: Proceedings of the Second International Cognitive Technology Conference (CT 1997), pp. 271–278. IEEE, Los Alamitos (1997)
Kidd, C.D., Orr, R., Abowd, G.D., Atkeson, C.G., Essa, I.A., MacIntyre, B., Mynatt, E., Startner, T.E., Newstetter, W.: The aware home: A living laboratory for ubiquitous computing research. In: Streitz, N.A., Hartkopf, V. (eds.) CoBuild 1999. LNCS, vol. 1670, pp. 190–197. Springer, Heidelberg (1999)
Bobick, A.F., Intille, S.S., Davis, J.W., Baird, F., Pinhanez, C.S., Campbell, L.W., Ivanov, Y.A., Schütte, A., Wilson, A.: The KidsRoom: A perceptually-based interactive and immersive story environment. Presence 8(4), 369–393 (1999)
Brumitt, B., Meyers, B., Krumm, J., Kern, A., Shafer, S.: EasyLiving: Technologies for intelligent environments. In: Thomas, P., Gellersen, H.-W. (eds.) HUC 2000. LNCS, vol. 1927, pp. 12–29. Springer, Heidelberg (2000)
Mann, S.: Humanistic intelligence: WearComp as a new framework for intelligence signal processing. Proceedings of the IEEE 86(11), 2123–2125 (1998)
Kawamura, T., Kono, Y., Kidode, M.: Wearable interfaces for a video diary: Towards memory retrieval, exchange, and transportation. In: The 6th International Symposium on Wearable Computers (ISWC 2002), pp. 31–38. IEEE, Los Alamitos (2002)
Chiu, P., Kapuskar, A., Reitmeier, S., Wilcox, L.: Meeting capture in a media enriched conference room. In: Streitz, N.A., Hartkopf, V. (eds.) CoBuild 1999. LNCS, vol. 1670, pp. 79–88. Springer, Heidelberg (1999)
Benelli, G., Bianchi, A., Marti, P., Not, E., Sennati, D.: HIPS: Hyper-interaction within physical space. In: Proceedings of IEEE International Conference on Multimedia Computing (1999)
Sparacino, F.: The Museum Wearables: Real-time sensor-driven understanding of visitors’ interests for personalized visually-augmented museum experiences. In: Proceedings of Museums and the Web (2002)
Sumi, Y., Mase, K.: Supporting the awareness of shared interests and experiences in communities. International Journal of Human-Computer Studies 56(1), 127–146 (2002)
Mynatt, E.D., Back, M., Want, R., Baer, M., Ellis, J.B.: Designing audio aura. In: Proceedings of CHI 1998, pp. 566–573. ACM, New York (1998)
Rekimoto, J., Ayatsuka, Y., Hayashi, K.: Augment-able reality: Situated communication through physical and digital spaces. In: The Second International Symposium on Wearable Computers, pp. 68–75. IEEE, Los Alamitos (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sumi, Y. et al. (2005). Collage of Video and Sound for Raising the Awareness of Situated Conversations. In: Bolc, L., Michalewicz, Z., Nishida, T. (eds) Intelligent Media Technology for Communicative Intelligence. IMTCI 2004. Lecture Notes in Computer Science(), vol 3490. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11558637_19
Download citation
DOI: https://doi.org/10.1007/11558637_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29035-3
Online ISBN: 978-3-540-31738-8
eBook Packages: Computer ScienceComputer Science (R0)