What do you think?
Rate this book
A digital library framework for heterogeneous music collections: from document acquisition to cross-modal interaction
Abstract
In this paper, we present a digital library system for managing heterogeneous music collections. The heterogeneity refers to various document types and formats as well as to different modalities, e. g., CD-audio recordings, scanned sheet music, and lyrics. The system offers a full-fledged, widely automated document processing chain: digitization, indexing, annotation, access, and presentation. Our system is implemented as a generic and modular music repository based on a service-oriented software architecture. As a particular strength of our approach, the various documents representing aspects of a piece of music are jointly considered in all stages of the document processing chain. Our user interfaces allow for a multimodal and synchronized presentation of documents (WYSIWYH: what you see is what you hear), a
score- or lyrics-based navigation in audio, as well as a cross- and multimodal retrieval. Hence, our music repository may be called a truly cross-modal library system. In our paper, we describe the system components, outline the techniques of the document processing chain, and illustrate the implemented functionalities for user interaction. We describe how the system is put into practice at the Bavarian State Library (BSB) Munich as a part of the German PROBADO Digital Library Initiative (PDLI).
Keywords
Music digital library system · Multimodality · Cross-modal navigation · Content-based retrieval · Music synchronization · Music information retrieval
In this paper, we present a digital library system for managing heterogeneous music collections. The heterogeneity refers to various document types and formats as well as to different modalities, e. g., CD-audio recordings, scanned sheet music, and lyrics. The system offers a full-fledged, widely automated document processing chain: digitization, indexing, annotation, access, and presentation. Our system is implemented as a generic and modular music repository based on a service-oriented software architecture. As a particular strength of our approach, the various documents representing aspects of a piece of music are jointly considered in all stages of the document processing chain. Our user interfaces allow for a multimodal and synchronized presentation of documents (WYSIWYH: what you see is what you hear), a
score- or lyrics-based navigation in audio, as well as a cross- and multimodal retrieval. Hence, our music repository may be called a truly cross-modal library system. In our paper, we describe the system components, outline the techniques of the document processing chain, and illustrate the implemented functionalities for user interaction. We describe how the system is put into practice at the Bavarian State Library (BSB) Munich as a part of the German PROBADO Digital Library Initiative (PDLI).
Keywords
Music digital library system · Multimodality · Cross-modal navigation · Content-based retrieval · Music synchronization · Music information retrieval
20 pages, ebook
Published June 20, 2012
1 person want to read
Ratings & Reviews
Friends & Following
Create a free account to discover what your friends think of this book!
Community Reviews
Displaying 1 of 1 review
August 2, 2016
A clear and technical account of a formidable initiative to provide cross-modal digital access to music. The same piece of music may be represented as sheet music, audio recordings, video recordings of performances or lyrics. We may be interested in cross-modal access to such pieces, for example identify the place in the lyrics where certain words appear, as well as the place in the score where they are sung, their actual performance in an audio recording or even a video recording. In fact, in general we may be interested in finding something on one of these modes and what it corresponds to in other modes.
The authors present a platform for this sort of thing and delve into some of the complexities they have had to overcome . This is part of a music digitalization project which had, by the time the paper had written included some 95.000 pages of scanned sheet music and 4.000 digital audio recording, mainly of classic-romantic pieces of music such as piano sonatas, string quartets and orchestral works for the Bavarian State Library (BSB) in Munich.
Highly recommended for the technically inclined reader interested in a digital library workflow and processing chain from content acquisition to semi-automatic indexing, search, and presentation of music content.
The authors present a platform for this sort of thing and delve into some of the complexities they have had to overcome . This is part of a music digitalization project which had, by the time the paper had written included some 95.000 pages of scanned sheet music and 4.000 digital audio recording, mainly of classic-romantic pieces of music such as piano sonatas, string quartets and orchestral works for the Bavarian State Library (BSB) in Munich.
Highly recommended for the technically inclined reader interested in a digital library workflow and processing chain from content acquisition to semi-automatic indexing, search, and presentation of music content.
Displaying 1 of 1 review