Abstract
In this paper, we propose a concept for using combined multimodal queries in the context of digital music libraries. Whereas usual mechanisms for content-based music retrieval only consider a single query mode, such as query-by-humming, full-text lyrics-search or query-by-example using short audio snippets, our proposed concept allows to combine those different modalities into one integrated query. Our particular contributions consist of concepts for query formulation, combined content-based retrieval and presentation of a suitably ranked result list. The proposed concepts have been realized within the context of the PROBADO Music Repository and allow for music retrieval based on combining full-text lyrics search and score-based query-by-example search.
This work was supported in part by Deutsche Forschungsgemeinschaft (DFG) under grant INST 11925/1-1.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Musipedia: http://www.musipedia.org/
Typke, R.: Melodyhound: Search within the music (2006), http://melodyhound.com/
Kurth, F., Damm, D., Fremerey, C., Müller, M., Clausen, M.: A framework for managing multimodal digitized music collections. In: Christensen-Dalsgaard, B., Castelli, D., Ammitzbøll Jurik, B., Lippincott, J. (eds.) ECDL 2008. LNCS, vol. 5173, pp. 334–345. Springer, Heidelberg (2008)
de Kretser, O., Moffat, A., Shimmin, T., Zobel, J.: Methodologies for distributed information retrieval. In: Proceedings of the 18th International Conference on Distributed Computing Systems (ICDCS 1998), pp. 66–73 (1998)
Henrich, A., Robbert, G.: Combining multimedia retrieval and text retrieval to search structured documents in digital libraries. In: DELOS Workshop: Information Seeking, Searching and Querying in Digital Libraries (2000)
Kailing, K., peter Kriegel, H., Schönauer, S.: Content-based image retrieval using multiple representations (2008)
Hu, N., Dannenberg, R., Tzanetakis, G.: Polyphonic audio matching and alignment for music retrieval. In: Proceedings of the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (October 2003)
Bartsch, M.A., Wakefield, G.H.: Audio thumbnailing of popular music using chroma-based representations. IEEE Transactions on Multimedia 7(1), 96–104 (2005)
Müller, M., Fremerey, C., Kurth, F., Damm, D.: Mapping sheet music to audio recordings. In: Proceedings of the 9th International Conference on Music Information Retrieval, ISMIR 2008 (2008)
W3C: Web services, http://www.w3.org/2002/ws/
Müller, M., Kurth, F., Damm, D., Fremerey, C., Clausen, M.: Lyrics-based audio retrieval and multimodal navigation in music collections. In: Kovács, L., Fuhr, N., Meghini, C. (eds.) ECDL 2007. LNCS, vol. 4675, pp. 112–123. Springer, Heidelberg (2007)
Kurth, F., Müller, M.: Efficient Index-based Audio Matching. IEEE Transactions on Audio, Speech and Language Processing 16(2), 382–395 (2008)
Witten, I.H., Moffat, A., Bell, T.C.: Managing Gigabytes, 2nd edn. Van Nostrand Reinhold (1999)
Byrd, D., Schindele, M.: Prospects for improving OMR with multiple recognizers. In: Proceedings of the 7th International Conference on Music Information Retrieval (ISMIR 2006), pp. 41–46 (2006)
Jones, G.: Sharpeye music reader (2008), http://www.visiv.co.uk/
Kurth, F., Müller, M., Fremerey, C., Chang, Y., Clausen, M.: Automated synchronization of scanned sheet music with audio recordings. In: Proceedings of the 8th International Conference on Music Information Retrieval (ISMIR 2007), September 2007, pp. 261–266 (2007)
Krottmaier, H., Kurth, F., Steenweg, T., Appelrath, H.J., Fellner, D.: Probado — a generic repository integration framework. In: Kovács, L., Fuhr, N., Meghini, C. (eds.) ECDL 2007. LNCS, vol. 4675, pp. 518–521. Springer, Heidelberg (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Damm, D., Kurth, F., Fremerey, C., Clausen, M. (2009). A Concept for Using Combined Multimodal Queries in Digital Music Libraries. In: Agosti, M., Borbinha, J., Kapidakis, S., Papatheodorou, C., Tsakonas, G. (eds) Research and Advanced Technology for Digital Libraries. ECDL 2009. Lecture Notes in Computer Science, vol 5714. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04346-8_26
Download citation
DOI: https://doi.org/10.1007/978-3-642-04346-8_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04345-1
Online ISBN: 978-3-642-04346-8
eBook Packages: Computer ScienceComputer Science (R0)