Automated Alignment and Annotation of Audio-Visual Presentations

Abstract

Recordings of audio-visual presentations are a potentially valuable component of digital libraries. These recordings can be archived to enable remote access to audio presentations including lectures and seminars. Recordings of presentations often contain multiple information streams involving visual and audio data. If the full benefit of these recordings is to be realised these multiple media streams must be properly integrated to enable rapid navigation. This paper describes the application of information retrieval techniques within a system to automatically synchronise an audio soundtrack with electronic slides from a presentation. A novel component of the system is the detection of sections of the presentation unsupported by prepared slides, such as discussion and question answering, and automatic development of keypoint slides for these elements of the presentation.